mirror of
https://github.com/facebook/sapling.git
synced 2024-10-10 16:57:49 +03:00
23dee89ed0
Summary: Currently, x-repo commit validator runs full working copy comparison every time. This is slow, as it requires fetching of full manifests for the commit versions in both a small and a large repo. For those of leafs, which are different, filenodes are also fetched, so that `ContentId`s can be compared. It's slow. Because it's slow, we skip the majority of commits and validate only 1 in ~40 `bookmarks_update_log` entries. Obviously, this is not ideal. To address this, this diff introduces a new way to run validation: based on comparing full manifest diffs. For each entry of the `bookmarks_update_log` of the large repo, we: - unfold it into a list of commits it introduces into the repository - fetch each commit - see how it rewrites to small repos - compute manifest differences between the commit and it's parent in each involved repo - compare those differences - check that topological order relationship remains sane (i.e. if `a` is a p1 of `b` in a small repo, than `a'` must be a p1 of `b'` in a large repo, where `a'` and `b'` are remappings of `a` and `b`) In addition, this diff adds some integration tests and gets rid of the skipping logic. Reviewed By: StanislavGlebik Differential Revision: D20007320 fbshipit-source-id: 6e4647e9945e1da40f54b7f5ed79651927b7b833 |
||
|---|---|---|
| .. | ||
| apiserver | ||
| benchmark | ||
| blobimport_lib/src | ||
| blobrepo | ||
| blobrepo_utils | ||
| blobstore | ||
| blobstore_sync_queue | ||
| bonsai_git_mapping | ||
| bonsai_globalrev_mapping | ||
| bonsai_hg_mapping | ||
| bookmarks | ||
| cache_warmup/src | ||
| changesets | ||
| cmdlib | ||
| cmds | ||
| commit_rewriting | ||
| common | ||
| config_structs/repos | ||
| derived_data | ||
| edenapi_server/src | ||
| fastreplay/src | ||
| filenodes | ||
| filestore/src | ||
| git | ||
| gotham_ext/src | ||
| hgcli | ||
| hgproto | ||
| hook_tailer | ||
| hooks | ||
| lfs_import_lib/src | ||
| lfs_protocol | ||
| lfs_server/src | ||
| manifest | ||
| mercurial | ||
| metaconfig | ||
| microwave | ||
| mononoke_api/src | ||
| mononoke_types | ||
| newfilenodes | ||
| phases | ||
| pushrebase/src | ||
| reachabilityindex | ||
| repo_client | ||
| revset | ||
| scs_server/src | ||
| segmented_changelog/src | ||
| server | ||
| sshrelay | ||
| tests | ||
| walker/src | ||
| Cargo.toml | ||
| README.md | ||
Mononoke
Mononoke is a next-generation server for the Mercurial source control system, meant to scale up to accepting thousands of commits every hour across millions of files. It is primarily written in the Rust programming language.
Caveat Emptor
Mononoke is still in early stages of development. We are making it available now because we plan to start making references to it from our other open source projects.
The version that we provide on GitHub does not build yet.
This is because the code is exported verbatim from an internal repository at Facebook, and not all of the scaffolding from our internal repository can be easily extracted. The key areas where we need to shore things up are:
- Full support for a standard
cargo build. - Open source replacements for Facebook-internal services (blob store, logging etc).
The current goal is to get Mononoke working on Linux. Other Unix-like OSes may be supported in the future