sapling/eden/mononoke
Stefan Filip ea89b541e1 segmented_changelog: add Dag struct and location_to_name functionality
Summary:
The IdDag provides graph algorithms using Segments.
The IdMap allows converting from the SegmentedChangelogId domain to the
ChangesetId domain.
The Dag struct wraps IdDag and IdMap in order to provide graph algorithms using
the common application level identifiers for commits (ChangesetId).

The construction of the Dag is currently mocked with something that can only be
used in a test environment (unit tests but also integration tests).

This diff also implements a location_to_name function. This is the most
important new functionality that segmented changelog clients require. It
recovers the hash of a commit for which the client only has a segmented
changelog Id. The current assumption is that clients have identifiers for all
merge commit parents so the path to a known commit always follow a set
of first parents.

The IdMap queries will have to be changed to async in the future, but IdDag
queries we expect to stay sync.

Reviewed By: quark-zju

Differential Revision: D20635577

fbshipit-source-id: 4f9bd8dd4a5bd9b0de55f51086f3434ff507963c
2020-03-27 13:48:52 -07:00
..
apiserver hgproto: use Option<MPath> instead of Bytes for path in GettreepackArgs 2020-03-17 15:07:54 -07:00
benchmark mononoke: add repo name in BlobRepo 2020-03-10 08:32:33 -07:00
blobimport_lib/src mononoke/filestore: update store_bytes to chunk content 2020-03-06 07:43:07 -08:00
blobrepo mononoke: move ContextConcurrencyBlobstore to RepoBlobstore 2020-03-16 05:30:11 -07:00
blobrepo_utils mononoke: remove in_memory_writes* method 2020-03-10 07:51:28 -07:00
blobstore mononoke/blobstore: make multiplexed blobstore OSS buildable 2020-03-27 11:40:12 -07:00
blobstore_sync_queue mononoke/blobstore: make multiplexed blobstore OSS buildable 2020-03-27 11:40:12 -07:00
bonsai_git_mapping improve the check for conflicts during insert 2020-03-10 05:47:05 -07:00
bonsai_globalrev_mapping rust: Rename futures_preview:: to futures:: 2020-03-03 11:01:20 -08:00
bonsai_hg_mapping rust-shed: add no-op memcache_stub implementation to the shed 2020-03-10 01:07:46 -07:00
bookmarks mononoke: make metaconfig OSS buildable 2020-03-27 08:13:47 -07:00
cache_warmup/src mononoke/cache_warmup: conditionally use microwave for faster warmup 2020-03-05 11:57:43 -08:00
changesets rust-shed: add no-op memcache_stub implementation to the shed 2020-03-10 01:07:46 -07:00
cmdlib mononoke: add repo name in BlobRepo 2020-03-10 08:32:33 -07:00
cmds mononoke: make blobstore/sqlblob buildable in OSS 2020-03-27 08:13:47 -07:00
commit_rewriting mononoke: make commit validator manifest-diff-based 2020-03-13 07:46:48 -07:00
common mononoke: make metaconfig OSS buildable 2020-03-27 08:13:47 -07:00
config_structs/repos mononoke: make metaconfig OSS buildable 2020-03-27 08:13:47 -07:00
derived_data Deprecate rust-crypto in eden/monanoke/derived_data 2020-03-19 19:00:06 -07:00
edenapi_server/src mononoke/{edenapi,lfs}_server: update to new Hyper, new Bytes, new Gotham 2020-03-11 10:22:28 -07:00
fastreplay/src hgproto: use Option<MPath> instead of Bytes for path in GettreepackArgs 2020-03-17 15:07:54 -07:00
filenodes mononoke: make filenode and mercurial_types OSS buildable 2020-03-27 11:40:13 -07:00
filestore mononoke: make filenode and mercurial_types OSS buildable 2020-03-27 11:40:13 -07:00
git mononoke: move StoreLoadable and add LodableError 2020-03-23 00:43:44 -07:00
gotham_ext/src mononoke/{edenapi,lfs}_server: update to new Hyper, new Bytes, new Gotham 2020-03-11 10:22:28 -07:00
hgcli rust-shed: add hostname crate to the shed 2020-03-20 08:56:12 -07:00
hgproto mononoke/hgproto: zero copy-validation (120x faster on 70MiB Gettreepack) 2020-03-19 04:31:23 -07:00
hook_tailer Asyncify hook_tailer 2020-03-26 08:39:11 -07:00
hooks Centralise hook running in the HookManager 2020-03-18 09:17:17 -07:00
lfs_import_lib/src mononoke: update internals to Bytes 0.5 2020-02-27 08:08:28 -08:00
lfs_protocol mononoke/{edenapi,lfs}_server: update to new Hyper, new Bytes, new Gotham 2020-03-11 10:22:28 -07:00
lfs_server/src mononoke: lfs_server: Use Identity::FromStr when parsing identities 2020-03-16 05:41:49 -07:00
manifest mononoke: make filenode and mercurial_types OSS buildable 2020-03-27 11:40:13 -07:00
mercurial mononoke: make filenode and mercurial_types OSS buildable 2020-03-27 11:40:13 -07:00
metaconfig mononoke: make metaconfig OSS buildable 2020-03-27 08:13:47 -07:00
microwave mononoke: add repo name in BlobRepo 2020-03-10 08:32:33 -07:00
mononoke_api/src mononoke/scs: use changeset info in changeset context 2020-03-19 12:16:40 -07:00
mononoke_types mononoke: introduce rechunk_if_needed fn to the filestore 2020-03-19 05:20:44 -07:00
newfilenodes mononoke: make blobstore/sqlblob buildable in OSS 2020-03-27 08:13:47 -07:00
phases rust-shed: add no-op memcache_stub implementation to the shed 2020-03-10 01:07:46 -07:00
pushrebase/src rename get_generation_number_by_bonsai to get_generation_number 2020-03-13 08:31:07 -07:00
reachabilityindex rust: Rename futures_preview:: to futures:: 2020-03-03 11:01:20 -08:00
repo_client resolver.rs: migrate resolve to async/await 2020-03-27 04:02:36 -07:00
revset rename get_generation_number_by_bonsai to get_generation_number 2020-03-13 08:31:07 -07:00
scs_server/src mononoke/scs-log: do not accept timestamps <= 0 2020-03-26 14:06:31 -07:00
segmented_changelog/src segmented_changelog: add Dag struct and location_to_name functionality 2020-03-27 13:48:52 -07:00
server mononoke: alphabetize perf counters 2020-03-25 08:37:43 -07:00
sshrelay mononoke: allow selecting a priority in hgcli, and passing it to Mononoke 2020-03-11 08:54:51 -07:00
tests mononoke/scs-log: do not accept timestamps <= 0 2020-03-26 14:06:31 -07:00
walker/src mononoke: walker: add start_step to WalkVisitor 2020-03-23 06:25:40 -07:00
Cargo.toml mononoke: make filenode and mercurial_types OSS buildable 2020-03-27 11:40:13 -07:00
README.md mononoke: add README.md and the missing pieces for supporting cargo (#13) 2020-02-13 00:12:36 -08:00

Mononoke

Mononoke is a next-generation server for the Mercurial source control system, meant to scale up to accepting thousands of commits every hour across millions of files. It is primarily written in the Rust programming language.

Caveat Emptor

Mononoke is still in early stages of development. We are making it available now because we plan to start making references to it from our other open source projects.

The version that we provide on GitHub does not build yet.

This is because the code is exported verbatim from an internal repository at Facebook, and not all of the scaffolding from our internal repository can be easily extracted. The key areas where we need to shore things up are:

  • Full support for a standard cargo build.
  • Open source replacements for Facebook-internal services (blob store, logging etc).

The current goal is to get Mononoke working on Linux. Other Unix-like OSes may be supported in the future