1
1
mirror of https://github.com/rui314/mold.git synced 2024-10-26 21:20:46 +03:00
mold/README.md

285 lines
11 KiB
Markdown
Raw Normal View History

2020-10-21 08:55:50 +03:00
# mold: A Modern Linker
2020-10-21 06:52:11 +03:00
[![CI](https://github.com/rui314/mold/actions/workflows/ci.yml/badge.svg)](https://github.com/rui314/mold/actions/workflows/ci.yml)
[![build result](https://build.opensuse.org/projects/home:marxin:mold/packages/mold/badge.svg?type=default)](https://build.opensuse.org/package/show/home:marxin:mold/mold)
2023-03-22 11:35:22 +03:00
<i>This is a repo of a free, AGPL-licensed version of the linker. If you are
looking for a commercial, non-AGPL version of the same linker, please visit
the [repo of the sold linker](https://github.com/bluewhalesystems/sold).</i>
2022-11-19 07:03:50 +03:00
2023-03-22 11:35:22 +03:00
mold is a faster drop-in replacement for existing Unix linkers. It is several
times faster than the LLVM lld linker, the second-fastest open-source linker
which I originally created a few years ago. mold is designed to increase
developer productivity by reducing build time, especially in rapid
debug-edit-rebuild cycles.
2020-10-21 06:52:11 +03:00
2023-03-22 11:35:22 +03:00
Here is a performance comparison of GNU gold, LLVM lld, and mold for linking
final debuginfo-enabled executables of major large programs on a simulated
8-core 16-threads machine.
2021-03-21 07:51:34 +03:00
2021-12-12 15:19:12 +03:00
![Link speed comparison](docs/comparison.png)
2021-03-21 07:51:34 +03:00
2021-12-13 09:28:26 +03:00
| Program (linker output size) | GNU gold | LLVM lld | mold
|-------------------------------|----------|----------|--------
| Chrome 96 (1.89 GiB) | 53.86s | 11.74s | 2.21s
| Clang 13 (3.18 GiB) | 64.12s | 5.82s | 2.90s
| Firefox 89 libxul (1.64 GiB) | 32.95s | 6.80s | 1.42s
2023-03-22 11:35:22 +03:00
mold is so fast that it is only 2x _slower_ than `cp` on the same machine.
Feel free to [file a bug](https://github.com/rui314/mold/issues) if you find
mold is not faster than other linkers.
2021-03-21 07:51:34 +03:00
mold supports x86-64, i386, ARM64, ARM32, 64-bit/32-bit little/big-endian
2023-03-22 11:35:22 +03:00
RISC-V, 32-bit PowerPC, 64-bit big-endian PowerPC ELFv1, 64-bit little-endian
PowerPC ELFv2, s390x, SPARC64, m68k, SH-4 and DEC Alpha.
2021-12-15 04:44:10 +03:00
mold/macOS is commercial software. For mold/macOS, please visit
https://github.com/bluewhalesystems/sold.
2021-12-12 15:19:12 +03:00
## Why does the speed of linking matter?
2023-03-22 11:35:22 +03:00
If you are using a compiled language such as C, C++ or Rust, a build consists
of two phases. In the first phase, a compiler compiles source files into
object files (`.o` files). In the second phase, a linker takes all object
files to combine them into a single executable or a shared library file.
2021-04-18 15:41:36 +03:00
2023-03-22 11:35:22 +03:00
The second phase takes a long time if your build output is large. mold can
make it faster, saving your time and keeping you from being distracted while
waiting for a long build to finish. The difference is most noticeable when you
are in rapid debug-edit-rebuild cycles.
2021-04-19 16:25:13 +03:00
2021-12-22 13:59:39 +03:00
## Install
2022-04-28 15:23:55 +03:00
Binary packages for the following systems are currently available.
2021-12-22 13:59:39 +03:00
[![Packaging status](https://repology.org/badge/vertical-allrepos/mold.svg)](https://repology.org/project/mold/versions)
## How to build
2023-03-22 11:35:22 +03:00
mold is written in C++20, so if you build mold yourself, you need a recent
version of a C++ compiler and a C++ standard library. GCC 10.2 or Clang 12.0.0
(or later) as well as libstdc++ 10 or libc++ 7 (or later) are recommended.
### Install dependencies
To install build dependencies, run `./install-build-deps.sh` in this
directory. It recognizes your Linux distribution and tries to install
necessary packages. You may want to run it as root.
### Compile mold
```shell
git clone https://github.com/rui314/mold.git
2022-09-27 06:53:08 +03:00
mkdir mold/build
cd mold/build
2023-03-16 09:01:09 +03:00
git checkout v1.11.0
2022-09-27 06:53:08 +03:00
../install-build-deps.sh
cmake -DCMAKE_BUILD_TYPE=Release -DCMAKE_CXX_COMPILER=c++ ..
cmake --build . -j $(nproc)
sudo cmake --install .
```
2023-03-22 11:35:22 +03:00
You may need to pass a C++20 compiler command name to `cmake`. In the above
case, `c++` is passed. If it doesn't work for you, try a specific version of a
compiler such as `g++-10` or `clang++-12`.
2023-03-22 11:35:22 +03:00
By default, `mold` is installed to `/usr/local/bin`. You can change that by
passing `-DCMAKE_INSTALL_PREFIX=<directory>`. For other cmake options, see the
comments in `CMakeLists.txt`.
2021-03-24 12:38:08 +03:00
If you don't use a recent enough Linux distribution, or if for any reason
2022-09-27 06:53:08 +03:00
`cmake` in the above commands doesn't work for you, you can use Docker to
build it in a Docker environment. To do so, just run `./dist.sh` in this
2023-03-22 11:35:22 +03:00
directory instead of `cmake`. The shell script pulls a Docker image, builds
mold and auxiliary files inside it, and packs them into a single tar file
`mold-$version-$arch-linux.tar.gz`. You can extract the tar file anywhere and
use `mold` executable in it.
2021-04-19 17:08:29 +03:00
2021-03-26 11:06:35 +03:00
## How to use
2021-12-27 06:14:30 +03:00
<details><summary>A classic way to use mold</summary>
2023-03-22 11:35:22 +03:00
On Unix, the linker command (which is usually `/usr/bin/ld`) is invoked
indirectly by the compiler driver (which is usually `cc`, `gcc` or `clang`),
which is typically in turn indirectly invoked by `make` or some other build
system command.
2021-12-27 06:14:30 +03:00
2023-03-22 11:35:22 +03:00
If you can specify an additional command line option to your compiler driver
by modifying build system's config files, add one of the following flags to
use `mold` instead of `/usr/bin/ld`:
2021-12-29 15:36:06 +03:00
- Clang: pass `-fuse-ld=mold`
- GCC 12.1.0 or later: pass `-fuse-ld=mold`
2023-03-22 11:35:22 +03:00
- GCC before 12.1.0: `-fuse-ld` does not accept `mold` as a valid argument, so
you need to use `-B` option instead. `-B` is an option to tell GCC where to
look for external commands such as `ld`.
2023-03-22 11:35:22 +03:00
If you have installed mold with `make install`, there should be a directory
named `/usr/libexec/mold` (or `/usr/local/libexec/mold`, depending on your
`$PREFIX`), and `ld` command should be there. The `ld` is actually a symlink
to `mold`. So, all you need is to pass `-B/usr/libexec/mold` (or
`-B/usr/local/libexec/mold`) to GCC.
2021-12-27 06:14:30 +03:00
If you haven't installed `ld.mold` to any `$PATH`, you can still pass
2023-03-22 11:35:22 +03:00
`-fuse-ld=/absolute/path/to/mold` to clang to use mold. GCC does not take an
absolute path as an argument for `-fuse-ld` though.
2021-12-29 15:36:06 +03:00
2021-12-27 06:14:30 +03:00
</details>
<details><summary>If you are using Rust</summary>
Create `.cargo/config.toml` in your project directory with the following:
```toml
2021-12-27 06:14:30 +03:00
[target.x86_64-unknown-linux-gnu]
linker = "clang"
rustflags = ["-C", "link-arg=-fuse-ld=/path/to/mold"]
```
2023-03-22 11:35:22 +03:00
where `/path/to/mold` is an absolute path to `mold` exectuable. In the above
example, we use `clang` as a linker driver as it can always take the
`-fuse-ld` option. If your GCC is recent enough to recognize the option, you
may be able to remove the `linker = "clang"` line.
```toml
[target.x86_64-unknown-linux-gnu]
2022-10-09 06:32:55 +03:00
rustflags = ["-C", "link-arg=-fuse-ld=/path/to/mold"]
```
2022-10-09 06:32:55 +03:00
If you want to use mold for all projects, put the above snippet to
`~/.cargo/config.toml`.
2021-12-27 06:14:30 +03:00
</details>
<details><summary>If you are using Nim</summary>
Create `config.nims` in your project directory with the following:
```nim
when findExe("mold").len > 0 and defined(linux):
switch("passL", "-fuse-ld=mold")
```
2023-03-22 11:35:22 +03:00
where `mold` must be included in the PATH environment variable. In this
example The above example uses `gcc` as the linker driver. Use the `fuse-ld`
option. If your GCC is recent enough to recognize this option.
2023-03-22 11:35:22 +03:00
If you want to use mold for all projects, put the above snippet to
`~/.config/config.nims`.
</details>
2021-12-27 06:14:30 +03:00
<details><summary>mold -run</summary>
2021-03-26 11:06:35 +03:00
2023-03-22 11:35:22 +03:00
It is sometimes very hard to pass an appropriate command line option to `cc`
to specify an alternative linker. To deal with the situation, mold has a
feature to intercept all invocations of `ld`, `ld.lld` or `ld.gold` and
redirect it to itself. To use the feature, run `make` (or another build
command) as a subcommand of mold as follows:
2021-03-24 12:38:08 +03:00
```shell
2021-12-13 09:28:26 +03:00
mold -run make <make-options-if-any>
2021-03-24 12:38:08 +03:00
```
2021-03-26 11:06:35 +03:00
Internally, mold invokes a given command with `LD_PRELOAD` environment
2023-03-22 11:35:22 +03:00
variable set to its companion shared object file. The shared object file
intercepts all function calls to `exec(3)`-family functions to replace
`argv[0]` with `mold` if it is `ld`, `ld.gold` or `ld.lld`.
2021-03-26 11:06:35 +03:00
2021-12-27 06:14:30 +03:00
</details>
2022-06-03 14:38:05 +03:00
<details><summary>GitHub Actions</summary>
You can use our <a href=https://github.com/rui314/setup-mold>setup-mold</a>
2023-03-22 11:35:22 +03:00
GitHub Action to speed up GitHub-hosted continuous build. GitHub Actions runs
on a two-core machine, but mold is still significantly faster than the default
GNU linker there especially when a program being linked is large.
2022-06-03 14:38:05 +03:00
2022-04-10 04:03:06 +03:00
</details>
2022-02-13 09:16:05 +03:00
<details><summary>Verify that you are using mold</summary>
2023-03-22 11:35:22 +03:00
mold leaves its identification string in `.comment` section in an output file.
You can print it out to verify that you are actually using mold.
2021-03-24 12:38:08 +03:00
```shell
2022-04-20 05:00:48 +03:00
$ readelf -p .comment <executable-file>
2021-03-24 12:38:08 +03:00
String dump of section '.comment':
[ 0] GCC: (Ubuntu 10.2.0-5ubuntu1~20.04) 10.2.0
[ 2b] mold 9a1679b47d9b22012ec7dfbda97c8983956716f7
```
If `mold` is in `.comment`, the file is created by mold.
2022-02-13 09:16:05 +03:00
</details>
2022-08-14 10:06:15 +03:00
<details><summary>Online manual</summary>
2023-03-22 11:35:22 +03:00
Since mold is a drop-in replacement, you should be able to use it without
reading its manual. But just in case you need it, [mold's man
page](docs/mold.md) is also available. You can read the same manual by `man
mold`.
2022-08-14 10:06:15 +03:00
</details>
2021-12-12 15:19:12 +03:00
## Why is mold so fast?
2023-03-22 11:35:22 +03:00
One reason is because it simply uses faster algorithms and efficient data
structures than other linkers do. The other reason is that the new linker is
highly parallelized.
2021-12-12 15:19:12 +03:00
2023-03-22 11:35:22 +03:00
Here is a side-by-side comparison of per-core CPU usage of lld (left) and mold
(right). They are linking the same program, Chromium executable.
2021-12-12 15:19:12 +03:00
![CPU usage comparison in htop animation](docs/htop.gif)
2023-03-22 11:35:22 +03:00
As you can see, mold uses all available cores throughout its execution and
finishes quickly. On the other hand, lld failed to use available cores most of
the time. In this demo, the maximum parallelism is artificially capped to 16
so that the bars fit in the GIF.
2021-12-12 15:19:12 +03:00
2021-12-13 09:28:26 +03:00
For details, please read [design notes](docs/design.md).
2022-05-05 16:37:42 +03:00
## License
2023-03-22 11:35:22 +03:00
mold is available under AGPL. Note that that does not mean that you have to
license your program under AGPL if you use mold to link your program. An
output of the mold linker is a derived work of the object files and libraries
you pass to the linker but not a derived work of the mold linker itself.
Besides that, you can also buy a commercial, non-AGPL license with technical
support from our company, Blue Whale Systems PTE LTD. If you are a big
company, please consider obtaining it before making hundreds or thousands of
developers of your company to depend on mold. mold is mostly a single-person
open-source project, and just like other open-source projects, we are not
legally obligated to keep maintaining it. A legally-binding commercial license
contract addresses the concern. By purchasing a license, you are guaranteed
that mold will be maintained for you. Please visit [our
website](https://bluewhale.systems) for the details of the commercial license.
2022-08-04 10:22:01 +03:00
2022-11-19 06:31:58 +03:00
## Sponsors
2022-08-04 10:22:01 +03:00
We accept donations via [GitHub Sponsors](https://github.com/sponsors/rui314)
2023-03-22 11:35:22 +03:00
and [OpenCollective](https://opencollective.com/mold-linker). We thank you to
everybody who sponsors our project. In particular, we'd like to acknowledge
the following people and organizations who have sponsored $128/month or more:
2022-08-04 10:22:01 +03:00
2022-11-19 06:31:58 +03:00
### Corporate sponsors
<a href="https://mercury.com/"><img src="docs/mercury-logo.png" align=center height=120 width=400 alt=Mercury></a>
<a href="https://cybozu-global.com/"><img src="docs/cyboze-logo.png" align=center height=120 width=133 alt=Cybozu></a>
2022-11-19 06:31:58 +03:00
2022-11-19 07:27:49 +03:00
- [Uber](https://uber.com)
2023-01-28 04:34:28 +03:00
- [G-Research](https://www.gresearch.co.uk)
2022-11-19 06:31:58 +03:00
- [Signal Slot Inc.](https://github.com/signal-slot)
### Individual sponsors
2022-08-04 10:22:01 +03:00
- [300baud](https://github.com/300baud)
2022-11-19 06:31:58 +03:00
- [Johan Andersson](https://github.com/repi)
2022-08-04 10:22:01 +03:00
- [Wei Wu](https://github.com/lazyparser)
2022-11-19 06:31:58 +03:00
- [kyle-elliott](https://github.com/kyle-elliott)