bf8a175125
Summary: Implemented the method lazy_index_node, which takes a starting node and a maximum depth value, and returns a future representing the computation to index all nodes beneath the start, up until previously indexed nodes, or nodes at depth at least the maximum desired depth. This will allow for partial indexing during warmup and during queries, in an environment where indexing the entire set of nodes reachable from the current master will be prohibitively expensive. This also includes a few synchronous helper methods, such as computing the skip list edges assuming a reasonable number of nodes below the desired node have been indexed. This also includes tests to make sure that the behavior is as expected for things like, confirming the nodes you would expect to be indexed are actually indexed after a lazy_index_node call. The real test will be if this is consistent for reachability queries. It's possible that reachability query tests, and in particular how these methods are used by reachability queries, will expose some bugs. These tests will be introduced when I add the actual reachability query to this index. But I feel confident that the methods in this diff will require at most minimal modification going forward. Reviewed By: StanislavGlebik Differential Revision: D8959089 fbshipit-source-id: a025034dfac11215a412114de70a0233d7598f30 |
||
---|---|---|
apiserver | ||
async-compression | ||
asyncmemo | ||
blobrepo | ||
blobrepo_utils | ||
blobstore | ||
bonsai-hg-mapping | ||
bonsai-utils | ||
bookmarks | ||
bundle2-resolver | ||
bytes-ext | ||
cache-warmup/src | ||
changesets | ||
cmdlib/src | ||
cmds | ||
common | ||
docs | ||
eden_server | ||
failure_ext | ||
filenodes | ||
futures-ext | ||
hgcli | ||
hgproto | ||
hooks | ||
hooks_old/src | ||
mercurial | ||
mercurial-bundles | ||
mercurial-types | ||
metaconfig | ||
mononoke-api/src | ||
mononoke-types | ||
netstring/src | ||
py_tar_utils | ||
reachabilityindex/src | ||
ready_state/src | ||
repo_client/src | ||
repo_listener/src | ||
revset | ||
server | ||
sshrelay | ||
storage | ||
tests | ||
vfs | ||
.gitignore | ||
.travis.yml | ||
Cargo.toml | ||
CONTRIBUTING.md | ||
LICENSE | ||
packman.yml | ||
README.md | ||
rustfmt.toml |
Mononoke
Mononoke is a next-generation server for the Mercurial source control system, meant to scale up to accepting thousands of commits every hour across millions of files. It is primarily written in the Rust programming language.
Caveat Emptor
Mononoke is still in early stages of development. We are making it available now because we plan to start making references to it from our other open source projects such as Eden.
The version that we provide on GitHub does not build yet.
This is because the code is exported verbatim from an internal repository at Facebook, and not all of the scaffolding from our internal repository can be easily extracted. The key areas where we need to shore things up are:
- Full support for a standard
cargo build
. - Open source replacements for Facebook-internal services (blob store, logging etc).
The current goal is to get Mononoke working on Linux. Other Unix-like OSes may be supported in the future.