A Scalable, User-Friendly Source Control System.
Go to file
Matthew Dippel bf8a175125 lazy_index_node method for SkiplistIndex
Summary:
Implemented the method lazy_index_node, which takes a starting node and a maximum depth value, and returns a future representing the computation to index all nodes beneath the start, up until previously indexed nodes, or nodes at depth at least the maximum desired depth. This will allow for partial indexing during warmup and during queries, in an environment where indexing the entire set of nodes reachable from the current master will be prohibitively expensive. This also includes a few synchronous helper methods, such as computing the skip list edges assuming a reasonable number of nodes below the desired node have been indexed.

This also includes tests to make sure that the behavior is as expected for things like, confirming the nodes you would expect to be indexed are actually indexed after a lazy_index_node call. The real test will be if this is consistent for reachability queries. It's possible that reachability query tests, and in particular how these methods are used by reachability queries, will expose some bugs. These tests will be introduced when I add the actual reachability query to this index. But I feel confident that the methods in this diff will require at most minimal modification going forward.

Reviewed By: StanislavGlebik

Differential Revision: D8959089

fbshipit-source-id: a025034dfac11215a412114de70a0233d7598f30
2018-07-30 15:06:04 -07:00
apiserver switch to slog-async 2018-07-30 13:06:40 -07:00
async-compression async-compression: replace tokio_core with tokio::runtime 2018-07-17 04:54:59 -07:00
asyncmemo Add travis-CI integration by adding .travis.yml file. 2018-07-26 10:09:32 -07:00
blobrepo mononoke: refactor handle_parents 2018-07-30 06:36:31 -07:00
blobrepo_utils bonsai-verify: add a way to weaken checks for merge commits older than a date 2018-07-29 21:21:33 -07:00
blobstore re-exporting types from other crate is not a good idea 2018-07-26 14:23:07 -07:00
bonsai-hg-mapping id for unique (repo_id, hg_cs_id) in mysql schema 2018-07-12 07:21:17 -07:00
bonsai-utils bonsai-utils/test: prep for adding FileTypeChanged state 2018-07-29 21:21:33 -07:00
bookmarks Add Cargo.toml files to crates. (#7) 2018-07-09 19:52:27 -07:00
bundle2-resolver mononoke: use ChangesetMetadata 2018-07-18 04:21:42 -07:00
bytes-ext add cargo build support for local development 2018-02-22 04:30:32 -08:00
cache-warmup/src Removed RepoGenCache structure, and repoinfo crate. 2018-07-12 14:22:17 -07:00
changesets Add Cargo.toml files to crates. (#7) 2018-07-09 19:52:27 -07:00
cmdlib/src mononoke: backout cachelib integration for blob caching 2018-07-26 10:09:32 -07:00
cmds bonsai-verify: add a way to weaken checks for merge commits older than a date 2018-07-29 21:21:33 -07:00
common Add Cargo.toml files to crates. (#7) 2018-07-09 19:52:27 -07:00
docs CODEMOD: rename mercurial::Parents to HgParents 2018-04-16 03:40:25 -07:00
eden_server Add Cargo.toml files to crates. (#7) 2018-07-09 19:52:27 -07:00
failure_ext 'Re-sync with internal repository' 2018-07-26 09:09:45 -07:00
filenodes filenodes: use Memcache to cache get_all_filenodes results 2018-07-27 13:21:20 -07:00
futures-ext futures-ext: add is_empty and not_empty combinators to StreamExt 2018-07-26 15:05:57 -07:00
hgcli hgcli: replace tokio_core usage with tokio::runtime 2018-07-17 04:54:58 -07:00
hgproto Add Cargo.toml files to crates. (#7) 2018-07-09 19:52:27 -07:00
hooks mononoke: rename BlobChangeset and ChangesetContent 2018-07-26 10:09:31 -07:00
hooks_old/src mercurial_types: remove D* types and move mercurial types around 2018-06-07 13:19:16 -07:00
mercurial mononoke: backout cachelib integration for blob caching 2018-07-26 10:09:32 -07:00
mercurial-bundles mononoke: b2x:commonheads parsing 2018-07-17 13:08:49 -07:00
mercurial-types mercurial-types: add ways of checking whether an entry is a tree or a file 2018-07-29 21:21:33 -07:00
metaconfig mononoke: backout cachelib integration for blob caching 2018-07-26 10:09:32 -07:00
mononoke-api/src support ls operation 2018-07-26 10:09:32 -07:00
mononoke-types mononoke: add get_changeset_id to BonsaiChangeset 2018-07-30 06:36:31 -07:00
netstring/src 'Re-sync with internal repository' 2018-07-26 09:09:45 -07:00
py_tar_utils move tar_utils.py from update_rust into an open sourceable location 2017-09-14 13:52:23 -07:00
reachabilityindex/src lazy_index_node method for SkiplistIndex 2018-07-30 15:06:04 -07:00
ready_state/src server: split server binary crate into 4 separate crates 2018-07-17 04:54:58 -07:00
repo_client/src mononoke stats: add latency of wireprotocol, getfiles, gettreepack and getbundle to ods 2018-07-26 10:09:32 -07:00
repo_listener/src mononoke stats: add latency of wireprotocol, getfiles, gettreepack and getbundle to ods 2018-07-26 10:09:32 -07:00
revset mononoke: backout cachelib integration for blob caching 2018-07-26 10:09:32 -07:00
server mononoke: backout cachelib integration for blob caching 2018-07-26 10:09:32 -07:00
sshrelay Add Cargo.toml files to crates. (#7) 2018-07-09 19:52:27 -07:00
storage Add Cargo.toml files to crates. (#7) 2018-07-09 19:52:27 -07:00
tests add get_changeset operation 2018-07-26 10:09:32 -07:00
vfs Add Cargo.toml files to crates. (#7) 2018-07-09 19:52:27 -07:00
.gitignore add .gitignore 2018-03-13 11:58:20 -07:00
.travis.yml Add travis-CI integration by adding .travis.yml file. 2018-07-26 10:09:32 -07:00
Cargo.toml mononoke: backout cachelib integration for blob caching 2018-07-26 10:09:32 -07:00
CONTRIBUTING.md Initial commit 2017-07-27 18:00:19 -07:00
LICENSE Initial commit 2017-07-27 18:00:19 -07:00
packman.yml packman config file for admin tool 2018-06-04 22:09:49 -07:00
README.md mention in README that Mononoke supports Mercurial 2017-07-28 14:41:37 -07:00
rustfmt.toml updates for rustfmt 0.3.4 2018-01-05 12:07:01 -08:00

Mononoke

Mononoke is a next-generation server for the Mercurial source control system, meant to scale up to accepting thousands of commits every hour across millions of files. It is primarily written in the Rust programming language.

Caveat Emptor

Mononoke is still in early stages of development. We are making it available now because we plan to start making references to it from our other open source projects such as Eden.

The version that we provide on GitHub does not build yet.

This is because the code is exported verbatim from an internal repository at Facebook, and not all of the scaffolding from our internal repository can be easily extracted. The key areas where we need to shore things up are:

  • Full support for a standard cargo build.
  • Open source replacements for Facebook-internal services (blob store, logging etc).

The current goal is to get Mononoke working on Linux. Other Unix-like OSes may be supported in the future.