gitbutler/DEVELOPMENT.md
Sebastian Thiel 13deabdebd
find large files more quickly thanks to gix based dirwalk
Also make sure that important `gix` crates are always compiled
with optimization for proper performance.

This is particularly useful when optimizing performance as not
everything has to be done in release mode.

However, it also causes CI to be slower as it compiles some
dependencies longer.

The problem realy is that `tauri dev` doesn't support custom profiles,
so there is only `dev` and `release`.
2024-08-28 21:19:47 +02:00

11 KiB

How to Hack on GitButler

Alrighty, you want to get compiling. We love you already. Your parents raised you right. Let's get started.


Table of Contents


Overview

So how does this whole thing work?

It's a Tauri app, which is basically like an Electron app, in that we can develop a desktop app from one source with multiple OS targets and write the UI in HTML and Javascript. Except instead of Node for the filesystem access part, Tauri uses Rust.

So everything that hits disk is in Rust, everything that the user sees is in HTML/JS. Specifically we use Svelte in Typescript for that layer.


The Basics

OK, let's get it running.

Prerequisites

First of all, this is a Tauri app, which is a Rust app. So go install Rust. The Tauri site has a good primer for the various platforms here.

The next major thing is pnpm (because we're a little cooler than people who use npm), so check out how to install that here.

Install dependencies

Next, install the app dependencies.

I hope you have some disk space for 300M of node_modules, because this bad boy will fill er up:

$ pnpm install

You'll have to re-run this occasionally when our deps change.

Note

We use turborepo as our monorepo tooling and by default Vercel collects some basic telemetry. If you'd like to disable this, please run pnpm exec turbo telemetry disable once in the project's root directory after installing dependencies.

Run the app

First, run cargo build such that supplementary bins such as gitbutler-git-askpass and gitbutler-git-setsid are created:

$ cargo build

Now you should be able to run the app in development mode:

$ pnpm dev:desktop

By default it will not print debug logs to console. If you want debug logs, set LOG_LEVEL environment variable:

$ LOG_LEVEL=debug pnpm dev:desktop

Lint & format

In order to have a PR accepted, you need to make sure everything passes our Linters, so make sure to run these before submitting. Our CI will shame you if you don't.

Javascript:

$ pnpm lint
$ pnpm format

Rust:

$ cargo clippy   # see linting errors
$ cargo fmt      # format code

Debugging

Now that you have the app running, here are some hints for debugging whatever it is that you're working on.

Logs

The app writes logs into:

  1. stdout in development mode
  2. The Tauri logs directory

One can get performance log when launching the application locally as follows:

GITBUTLER_PERFORMANCE_LOG=1 LOG_LEVEL=debug pnpm tauri dev

For more realistic performance logging, use local release builds with --release.

GITBUTLER_PERFORMANCE_LOG=1 LOG_LEVEL=debug pnpm tauri dev --release

Since release builds are configured for public releases, they are very slow to compile. Speed them up by sourcing the following file.

export CARGO_PROFILE_RELEASE_DEBUG=0
export CARGO_PROFILE_RELEASE_INCREMENTAL=false
export CARGO_PROFILE_RELEASE_LTO=false
export CARGO_PROFILE_RELEASE_CODEGEN_UNITS=256
export CARGO_PROFILE_RELEASE_OPT_LEVEL=2

Tokio

We are also collecting tokio's runtime tracing information that could be viewed using tokio-console:

  • development:
    $ tokio-console
    
  • nightly:
    $ tokio-console http://127.0.0.1:6668
    
  • production:
    $ tokio-console http://127.0.0.1:6667
    

Building

To build the app in production mode, run:

$ pnpm tauri build --features devtools --config crates/gitbutler-tauri/tauri.conf.nightly.json

This will make an asset similar to our nightly build.

Building on Windows

Building on Windows is a bit of a tricky process. Here are some helpful tips.

Nightly Compiler

As a few crates require nightly features on Windows, a rust-toolchain.toml is provided to have rustup use the right compiler version.

If for some reason this cannot be used or doesn't kick-in, one can also set an override.

rustup override add nightly-2024-07-01

If a stable nightly isn't desired or necessary, the latest nightly compiler can also be used:

rustup override add nightly

File permissions

We use pnpm, which requires a relatively recent version of Node.js. Make sure that the latest stable version of Node.js is installed and on the PATH, and then npm i -g pnpm.

Sometimes npm's prefix is incorrect on Windows, we can check this via:

npm config get prefix

If it's not C:\Users\<username>\AppData\Roaming\npm or another folder that is normally writable, then we can set it in Powershell:

mkdir -p $APPDATA\npm
npm config set prefix $env:APPDATA\npm

Afterwards, add this folder to your PATH.

Perl

A Perl interpreter is required to be installed in order to configure the openssl-sys crate. We've used Strawberry Perl without issue. Make sure it's installed and perl is available on the PATH (it is by default after installation, just make sure to restart the terminal after installing). Scoop users can install this via scoop install perl.

Note that it might appear that the build has hung or frozen on the openssl-sys crate. It's not, it's just that Cargo can't report the status of a C/C++ build happening under the hood, and openssl is large. It'll take a while to compile.

Crosscompilation

This paragraph is about crosscompilation to x86_64-MSVC from ARM Windows, a configuration typical for people with Apple Silicon and Parallels VMs, which only allow ARM Windows to be used.

The windows dependency on gitbutler-git doesn't currently compile on ARM, which means cross-compilation to x86-64 is required to workaround that. Besides, most users will probably still be on INTEL machines, making this capability a common requirement.

In a Git bash, with MSVC for x86-64 installed on the system, run the following to prepare the environment.

export TRIPLE_OVERRIDE=x86_64-pc-windows-msvc
export CARGO_BUILD_TARGET=x86_64-pc-windows-msvc
export OPENSSL_SRC_PERL="c:/Strawberry/perl/bin/perl.exe"

Here is how to produce a nightly release build:

pnpm tauri build --features windows,devtools --config  crates/gitbutler-tauri/tauri.conf.nightly.json

And this is how to get a local developer debug build:

pnpm tauri dev --features windows --target x86_64-pc-windows-msvc

Note that it's necessary to repeat the --target specification as otherwise the final copy operation doesn't work, triggered by tauri itself.


Design

We use Figma for our design work. If you're a designer (and even if you're not), you want to contribute to the design of GitButler, or your work involves UI, you could duplicate our design file.

GitButler design: Figma file 🎨


Contributing

Now that you're up and running, if you want to change something and open a PR for us, make sure to read CONTRIBUTING.md to make sure you're not wasting your time.


Some Other Random Notes

Most of this is for internal GitButler use, but maybe everyone else will find it interesting too.


Icon generation

I always forget how to do this, but when we update our app icon, run this to import it.

$ pnpm tauri icon path/to/icon.png

Release

Building is done via GitHub Action. Go to the link and select Run workflow from the desired branch.

Versioning

When running the release action, you will have to choose one of major, minor, or patch release type. Action will generate a new version based on your input and current version found at https://app.gitbutler.com/releases.

Publishing

To publish a version that you've just build, use Release Manager.


Development mode OAuth login

By default, you will not be able to log into GitButler using Github/Google because the base url does not match. To be able to do this add ( or update ) the following line to your .env.development file. You will need to create the file if it does not exist.

PUBLIC_API_BASE_URL=https://app.gitbutler.com/

Joining the GitButler Team

If you are interested in joining our small but tightly knit engineering team, we are currently looking for the following roles:

Code Hitlist

This is a list of crates/modules that we want to eliminate or split into smaller crates: