7a9c2df173
Summary: In some cases applying delta chain to a big binary file can cause an OOM. The problem was in the `Vec::split_off()` method. It creates two vectors with the same capacity. So if we have 30Mb binary that has 1000 fragments applied to it, it results in 30 Gb memory usage. The easy fix was to run shrink_to_fit() method after Vec::split_off(). While that would work, it seems that `combine_chain()` optimization doesn't really help - I ran parsing of a huge revlog, and performance was similar. So instead of adding shrink_to_fit() method I suggest to remove `combine_chain()` optimization completely. Reviewed By: lukaspiatkowski Differential Revision: D5953806 fbshipit-source-id: 93111a2b6db0b76da235cf7ada727b325600d25c |
||
---|---|---|
async-compression/src | ||
asyncmemo/src | ||
blobrepo/src | ||
blobstore | ||
bookmarks | ||
cmds | ||
eden-server/src | ||
futures-ext/src | ||
heads | ||
hgcli/src | ||
hgproto/src | ||
hooks/src | ||
linknodes | ||
mercurial/src | ||
mercurial-bundles/src | ||
mercurial-graphql/src | ||
mercurial-types | ||
metaconfig/src | ||
py_tar_utils | ||
repoinfo/src | ||
revset/src | ||
server/src | ||
sshrelay/src | ||
tests | ||
vfs/src | ||
CONTRIBUTING.md | ||
LICENSE | ||
README.md | ||
rustfmt.toml |
Mononoke
Mononoke is a next-generation server for the Mercurial source control system, meant to scale up to accepting thousands of commits every hour across millions of files. It is primarily written in the Rust programming language.
Caveat Emptor
Mononoke is still in early stages of development. We are making it available now because we plan to start making references to it from our other open source projects such as Eden.
The version that we provide on GitHub does not build yet.
This is because the code is exported verbatim from an internal repository at Facebook, and not all of the scaffolding from our internal repository can be easily extracted. The key areas where we need to shore things up are:
- Full support for a standard
cargo build
. - Open source replacements for Facebook-internal services (blob store, logging etc).
The current goal is to get Mononoke working on Linux. Other Unix-like OSes may be supported in the future.