1
1
mirror of https://github.com/rui314/mold.git synced 2024-10-26 21:20:46 +03:00
mold/README.md

269 lines
10 KiB
Markdown
Raw Normal View History

2020-10-21 08:55:50 +03:00
# mold: A Modern Linker
2020-10-21 06:52:11 +03:00
2023-07-23 10:30:41 +03:00
<i>This repository contains a free version of the mold linker.
If you are looking for a commercial version that supports macOS
2023-03-22 11:36:05 +03:00
please visit the
[repository of the sold linker](https://github.com/bluewhalesystems/sold).</i>
2022-11-19 07:03:50 +03:00
2023-03-22 11:35:22 +03:00
mold is a faster drop-in replacement for existing Unix linkers. It is several
2023-03-22 11:36:05 +03:00
times quicker than the LLVM lld linker, the second-fastest open-source linker,
which I initially developed a few years ago. mold aims to enhance developer
productivity by minimizing build time, particularly in rapid
2023-03-22 11:35:22 +03:00
debug-edit-rebuild cycles.
2020-10-21 06:52:11 +03:00
2023-03-22 11:36:05 +03:00
Here is a performance comparison of GNU gold, LLVM lld, and mold when linking
final debuginfo-enabled executables for major large programs on a simulated
8-core, 16-thread machine.
2021-03-21 07:51:34 +03:00
2021-12-12 15:19:12 +03:00
![Link speed comparison](docs/comparison.png)
2021-03-21 07:51:34 +03:00
2021-12-13 09:28:26 +03:00
| Program (linker output size) | GNU gold | LLVM lld | mold
|-------------------------------|----------|----------|--------
| Chrome 96 (1.89 GiB) | 53.86s | 11.74s | 2.21s
| Clang 13 (3.18 GiB) | 64.12s | 5.82s | 2.90s
| Firefox 89 libxul (1.64 GiB) | 32.95s | 6.80s | 1.42s
2023-03-22 11:36:05 +03:00
mold is so fast that it is only 2x _slower_ than the `cp` command on the same
machine. If you find that mold is not faster than other linkers, please feel
free to [file a bug report](https://github.com/rui314/mold/issues).
2021-03-21 07:51:34 +03:00
mold supports x86-64, i386, ARM64, ARM32, 64-bit/32-bit little/big-endian
2023-03-22 11:35:22 +03:00
RISC-V, 32-bit PowerPC, 64-bit big-endian PowerPC ELFv1, 64-bit little-endian
2023-08-13 04:39:08 +03:00
PowerPC ELFv2, s390x, 64-bit/32-bit LoongArch, SPARC64, m68k, SH-4, and DEC
Alpha.
2021-12-15 04:44:10 +03:00
mold/macOS is commercial software. For mold/macOS, please visit
https://github.com/bluewhalesystems/sold.
2023-03-22 11:36:05 +03:00
## Why does linking speed matter?
2021-12-12 15:19:12 +03:00
2023-03-22 11:36:05 +03:00
If you are using a compiled language such as C, C++, or Rust, a build consists
2023-03-22 11:35:22 +03:00
of two phases. In the first phase, a compiler compiles source files into
object files (`.o` files). In the second phase, a linker takes all object
2023-03-22 11:36:05 +03:00
files and combines them into a single executable or shared library file.
2021-04-18 15:41:36 +03:00
2023-03-22 11:36:05 +03:00
The second phase can be time-consuming if your build output is large. mold can
speed up this process, saving you time and preventing distractions while
waiting for a lengthy build to finish. The difference is most noticeable
during rapid debug-edit-rebuild cycles.
2021-04-19 16:25:13 +03:00
2023-03-22 11:36:05 +03:00
## Installation
2021-12-22 13:59:39 +03:00
2023-03-22 11:36:05 +03:00
Binary packages for the following systems are currently available:
2021-12-22 13:59:39 +03:00
[![Packaging status](https://repology.org/badge/vertical-allrepos/mold.svg)](https://repology.org/project/mold/versions)
2023-03-22 11:36:05 +03:00
## How to Build
2023-03-22 11:36:05 +03:00
mold is written in C++20, so if you build mold yourself, you will need a
recent version of a C++ compiler and a C++ standard library. We recommend GCC
10.2 or Clang 12.0.0 (or later) and libstdc++ 10 or libc++ 7 (or later).
2023-03-22 11:36:05 +03:00
### Install Dependencies
To install build dependencies, run `./install-build-deps.sh` in this
2023-03-22 11:36:05 +03:00
directory. It will detect your Linux distribution and attempt to install the
necessary packages. You may need to run it as root.
### Compile mold
```shell
git clone https://github.com/rui314/mold.git
2022-09-27 06:53:08 +03:00
mkdir mold/build
cd mold/build
2023-11-29 11:58:00 +03:00
git checkout v2.4.0
2022-09-27 06:53:08 +03:00
../install-build-deps.sh
cmake -DCMAKE_BUILD_TYPE=Release -DCMAKE_CXX_COMPILER=c++ ..
2023-08-23 08:38:50 +03:00
cmake --build . -j $(nproc)
sudo cmake --build . --target install
```
2023-03-22 11:36:05 +03:00
You might need to pass a C++20 compiler command name to `cmake`. In the
example above, `c++` is passed. If that doesn't work for you, try a specific
version of a compiler, such as `g++-10` or `clang++-12`.
2023-03-22 11:36:05 +03:00
By default, `mold` is installed to `/usr/local/bin`. You can change the
installation location by passing `-DCMAKE_INSTALL_PREFIX=<directory>`.
For other cmake options, see the comments in `CMakeLists.txt`.
2021-03-24 12:38:08 +03:00
2023-03-22 11:36:05 +03:00
If you are not using a recent enough Linux distribution, or if `cmake` does
not work for you for any reason, you can use Docker to build mold in a Docker
environment. To do so, run `./dist.sh` in this directory instead of using
`cmake`. The shell script will pull a Docker image, build mold and auxiliary
files inside it, and package them into a single tar file named
2023-03-22 11:35:22 +03:00
`mold-$version-$arch-linux.tar.gz`. You can extract the tar file anywhere and
2023-03-22 11:36:05 +03:00
use the mold executable within it.
2021-04-19 17:08:29 +03:00
2021-03-26 11:06:35 +03:00
## How to use
2021-12-27 06:14:30 +03:00
<details><summary>A classic way to use mold</summary>
2023-03-22 11:36:05 +03:00
On Unix, the linker command (usually `/usr/bin/ld`) is indirectly invoked by
the compiler driver (typically `cc`, `gcc`, or `clang`), which is in turn
indirectly invoked by `make` or another build system command.
2021-12-27 06:14:30 +03:00
2023-03-22 11:36:05 +03:00
If you can specify an additional command line option for your compiler driver
by modifying the build system's config files, add one of the following flags
to use mold instead of `/usr/bin/ld`:
2023-03-22 11:36:05 +03:00
- For Clang: pass `-fuse-ld=mold`
2023-03-22 11:36:05 +03:00
- For GCC 12.1.0 or later: pass `-fuse-ld=mold`
2023-03-22 11:36:05 +03:00
- For GCC before 12.1.0: the `-fuse-ld` option does not accept `mold` as a
valid argument, so you need to use the `-B` option instead. The `-B` option
tells GCC where to look for external commands like `ld`.
2023-03-22 11:35:22 +03:00
If you have installed mold with `make install`, there should be a directory
named `/usr/libexec/mold` (or `/usr/local/libexec/mold`, depending on your
2023-03-22 11:36:05 +03:00
`$PREFIX`), and the `ld` command should be there. The `ld` is actually a
symlink to `mold`. So, all you need is to pass `-B/usr/libexec/mold` (or
2023-03-22 11:35:22 +03:00
`-B/usr/local/libexec/mold`) to GCC.
2021-12-27 06:14:30 +03:00
If you haven't installed `ld.mold` to any `$PATH`, you can still pass
2023-03-22 11:36:05 +03:00
`-fuse-ld=/absolute/path/to/mold` to clang to use mold. However, GCC does not
accept an absolute path as an argument for `-fuse-ld`.
2021-12-29 15:36:06 +03:00
2021-12-27 06:14:30 +03:00
</details>
<details><summary>If you are using Rust</summary>
Create `.cargo/config.toml` in your project directory with the following:
```toml
2021-12-27 06:14:30 +03:00
[target.x86_64-unknown-linux-gnu]
linker = "clang"
rustflags = ["-C", "link-arg=-fuse-ld=/path/to/mold"]
```
2023-03-22 11:36:05 +03:00
where `/path/to/mold` is an absolute path to the mold executable. In the
example above, we use `clang` as a linker driver since it always accepts the
2023-03-22 11:35:22 +03:00
`-fuse-ld` option. If your GCC is recent enough to recognize the option, you
may be able to remove the `linker = "clang"` line.
```toml
[target.x86_64-unknown-linux-gnu]
2022-10-09 06:32:55 +03:00
rustflags = ["-C", "link-arg=-fuse-ld=/path/to/mold"]
```
2023-03-22 11:36:05 +03:00
If you want to use mold for all projects, add the above snippet to
2022-10-09 06:32:55 +03:00
`~/.cargo/config.toml`.
2021-12-27 06:14:30 +03:00
</details>
<details><summary>If you are using Nim</summary>
Create `config.nims` in your project directory with the following:
```nim
when findExe("mold").len > 0 and defined(linux):
switch("passL", "-fuse-ld=mold")
```
2023-03-22 11:36:05 +03:00
where `mold` must be included in the `PATH` environment variable. In this
example, `gcc` is used as the linker driver. Use the `-fuse-ld` option if your
GCC is recent enough to recognize this option.
2023-03-22 11:36:05 +03:00
If you want to use mold for all projects, add the above snippet to
2023-03-22 11:35:22 +03:00
`~/.config/config.nims`.
</details>
2021-12-27 06:14:30 +03:00
<details><summary>mold -run</summary>
2021-03-26 11:06:35 +03:00
2023-03-22 11:35:22 +03:00
It is sometimes very hard to pass an appropriate command line option to `cc`
2023-03-22 11:36:05 +03:00
to specify an alternative linker. To address this situation, mold has a
feature to intercept all invocations of `ld`, `ld.lld`, or `ld.gold` and
redirect them to itself. To use this feature, run `make` (or another build
2023-03-22 11:35:22 +03:00
command) as a subcommand of mold as follows:
2021-03-24 12:38:08 +03:00
```shell
2021-12-13 09:28:26 +03:00
mold -run make <make-options-if-any>
2021-03-24 12:38:08 +03:00
```
2023-03-22 11:36:05 +03:00
Internally, mold invokes the given command with the `LD_PRELOAD` environment
2023-03-22 11:35:22 +03:00
variable set to its companion shared object file. The shared object file
intercepts all function calls to `exec(3)`-family functions to replace
2023-03-22 11:36:05 +03:00
`argv[0]` with `mold` if it is `ld`, `ld.gold`, or `ld.lld`.
2021-03-26 11:06:35 +03:00
2021-12-27 06:14:30 +03:00
</details>
2022-06-03 14:38:05 +03:00
<details><summary>GitHub Actions</summary>
2023-03-22 11:36:05 +03:00
You can use our [setup-mold](https://github.com/rui314/setup-mold) GitHub
Action to speed up GitHub-hosted continuous builds. Although GitHub Actions
run on a two-core machine, mold is still significantly faster than the default
GNU linker, especially when linking large programs.
2022-06-03 14:38:05 +03:00
2022-04-10 04:03:06 +03:00
</details>
2022-02-13 09:16:05 +03:00
<details><summary>Verify that you are using mold</summary>
2023-03-22 11:36:05 +03:00
mold leaves its identification string in the `.comment` section of an output
file. You can print it out to verify that you are actually using mold.
2021-03-24 12:38:08 +03:00
```shell
2022-04-20 05:00:48 +03:00
$ readelf -p .comment <executable-file>
2021-03-24 12:38:08 +03:00
String dump of section '.comment':
[ 0] GCC: (Ubuntu 10.2.0-5ubuntu1~20.04) 10.2.0
[ 2b] mold 9a1679b47d9b22012ec7dfbda97c8983956716f7
```
2023-03-22 11:36:05 +03:00
If `mold` is present in the `.comment` section, the file was created by mold.
2021-03-24 12:38:08 +03:00
2022-02-13 09:16:05 +03:00
</details>
2022-08-14 10:06:15 +03:00
<details><summary>Online manual</summary>
2023-03-22 11:35:22 +03:00
Since mold is a drop-in replacement, you should be able to use it without
2023-03-22 11:36:05 +03:00
reading its manual. However, if you need it, [mold's man page](docs/mold.md)
is available. You can read the same manual by running `man mold`.
2022-08-14 10:06:15 +03:00
</details>
2021-12-12 15:19:12 +03:00
## Why is mold so fast?
2023-03-22 11:36:05 +03:00
One reason is that it utilizes faster algorithms and more efficient data
structures compared to other linkers. Another reason is that mold is highly
parallelized.
2021-12-12 15:19:12 +03:00
2023-03-22 11:36:05 +03:00
Here is a side-by-side comparison of per-core CPU usage for lld (left) and
mold (right), linking the same program, a Chromium executable.
2021-12-12 15:19:12 +03:00
![CPU usage comparison in htop animation](docs/htop.gif)
2023-03-22 11:35:22 +03:00
As you can see, mold uses all available cores throughout its execution and
2023-03-22 11:36:05 +03:00
finishes quickly. In contrast, lld fails to utilize available cores most of
the time. In this demo, the maximum parallelism is artificially capped at 16,
2023-03-22 11:35:22 +03:00
so that the bars fit in the GIF.
2021-12-12 15:19:12 +03:00
2023-03-22 11:36:05 +03:00
For details, please see the [design notes](docs/design.md).
2022-05-05 16:37:42 +03:00
2022-11-19 06:31:58 +03:00
## Sponsors
2022-08-04 10:22:01 +03:00
We accept donations via [GitHub Sponsors](https://github.com/sponsors/rui314)
2023-03-22 11:36:05 +03:00
and [OpenCollective](https://opencollective.com/mold-linker). We thank
everyone who sponsors our project. In particular, we'd like to acknowledge the
following people and organizations who have sponsored $128/month or more:
2022-08-04 10:22:01 +03:00
2022-11-19 06:31:58 +03:00
### Corporate sponsors
2023-07-29 15:13:50 +03:00
<a href="https://mercury.com"><img src="docs/mercury-logo.png" align=center height=120 width=400 alt=Mercury></a>
<a href="https://cybozu-global.com"><img src="docs/cyboze-logo.png" align=center height=120 width=133 alt=Cybozu></a>
<a href="https://www.emergetools.com"><img src="docs/emerge-tools-logo.png" align=center height=120 width=240 alt="Emerge Tools"></a><br>
2022-11-19 06:31:58 +03:00
2023-01-28 04:34:28 +03:00
- [G-Research](https://www.gresearch.co.uk)
2022-11-19 06:31:58 +03:00
- [Signal Slot Inc.](https://github.com/signal-slot)
2023-11-29 11:48:11 +03:00
- [GlareDB](https://github.com/GlareDB)
2022-11-19 06:31:58 +03:00
### Individual sponsors
2022-08-04 10:22:01 +03:00
- [Wei Wu](https://github.com/lazyparser)
2022-11-19 06:31:58 +03:00
- [kyle-elliott](https://github.com/kyle-elliott)
2023-11-29 11:48:11 +03:00
- [Bryant Biggs](https://github.com/bryantbiggs)
- [kraptor23](https://github.com/kraptor23)
- [Jinkyu Yi](https://github.com/jincreator)