A Scalable, User-Friendly Source Control System.
Go to file
Stanislau Hlebik 7a9c2df173 mononoke: remove combine_chain optimization
Summary:
In some cases applying delta chain to a big binary file can cause an OOM. The problem was in the `Vec::split_off()` method. It creates two vectors with the same capacity. So if we have 30Mb binary that has 1000 fragments applied to it, it results in 30 Gb memory usage.

The easy fix was to run shrink_to_fit() method after Vec::split_off(). While that would work, it seems that `combine_chain()` optimization doesn't really help - I ran parsing of a huge revlog, and performance was similar. So instead of adding shrink_to_fit() method I suggest to remove `combine_chain()` optimization completely.

Reviewed By: lukaspiatkowski

Differential Revision: D5953806

fbshipit-source-id: 93111a2b6db0b76da235cf7ada727b325600d25c
2017-10-03 11:50:46 -07:00
async-compression/src Initial commit 2017-07-27 18:00:19 -07:00
asyncmemo/src rust: asyncmemo: add failure test 2017-08-29 12:36:18 -07:00
blobrepo/src mononoke: filelog metadata problem fix 2017-09-26 00:36:55 -07:00
blobstore Removes usage of BoxFuture and BoxStream from futures crate in blobstore/fileblob 2017-09-28 15:38:23 -07:00
bookmarks remove deprecated tokio APIs from filebookmarks 2017-09-28 22:10:04 -07:00
cmds blobimport: add an option to postpone compaction 2017-09-22 08:33:25 -07:00
eden-server/src mononoke: use cpupool in eden server 2017-10-03 11:50:46 -07:00
futures-ext/src rust: futures-ext: use ! for errors that can't happen 2017-09-19 16:11:54 -07:00
heads heads: rename Unit to Effect 2017-09-26 09:37:35 -07:00
hgcli/src Initial commit 2017-07-27 18:00:19 -07:00
hgproto/src update and pull in uuid + subprocess 2017-09-08 17:05:38 -07:00
hooks/src add a prototype to implement hooks 2017-09-05 22:52:51 -07:00
linknodes linknodes: initial interface + in-memory implementation 2017-09-26 04:35:12 -07:00
mercurial/src mononoke: handle null manifest pointer specially 2017-10-03 09:05:52 -07:00
mercurial-bundles/src rename Path to MPath 2017-09-22 17:27:03 -07:00
mercurial-graphql/src rename Path to MPath 2017-09-22 17:27:03 -07:00
mercurial-types mononoke: remove combine_chain optimization 2017-10-03 11:50:46 -07:00
metaconfig/src mononoke: filelog metadata problem fix 2017-09-26 00:36:55 -07:00
py_tar_utils move tar_utils.py from update_rust into an open sourceable location 2017-09-14 13:52:23 -07:00
repoinfo/src mononoke: repoinfo: use u64 for Generation type 2017-09-21 16:52:35 -07:00
revset/src Use merge_* test fixtures in setdifference revset tests 2017-10-03 07:55:08 -07:00
server/src server: read config repo instead of command line arguments to start the server 2017-09-22 09:22:18 -07:00
sshrelay/src Initial commit 2017-07-27 18:00:19 -07:00
tests mononoke: use cpupool in eden server 2017-10-03 11:50:46 -07:00
vfs/src rename Path to MPath 2017-09-22 17:27:03 -07:00
CONTRIBUTING.md Initial commit 2017-07-27 18:00:19 -07:00
LICENSE Initial commit 2017-07-27 18:00:19 -07:00
README.md mention in README that Mononoke supports Mercurial 2017-07-28 14:41:37 -07:00
rustfmt.toml config for rustfmt-nightly 0.2.6 2017-09-18 10:50:27 -07:00

Mononoke

Mononoke is a next-generation server for the Mercurial source control system, meant to scale up to accepting thousands of commits every hour across millions of files. It is primarily written in the Rust programming language.

Caveat Emptor

Mononoke is still in early stages of development. We are making it available now because we plan to start making references to it from our other open source projects such as Eden.

The version that we provide on GitHub does not build yet.

This is because the code is exported verbatim from an internal repository at Facebook, and not all of the scaffolding from our internal repository can be easily extracted. The key areas where we need to shore things up are:

  • Full support for a standard cargo build.
  • Open source replacements for Facebook-internal services (blob store, logging etc).

The current goal is to get Mononoke working on Linux. Other Unix-like OSes may be supported in the future.