5dbdffdfe7
Summary: Previously to get copy/move source we had to join `paths` and `fixedcopyinfo` table. That worked fine when we had just one shard. However now we have many shards, and join no longer works. The reason is that move source path is in a different shard compared to move destination path, and join returns no data. Consider this situation. shardA contains all the data for pathA, shardB contains all the data for pathB. That means that sharded `paths` table will have pathA in shardA and pathB in shardB. Then if file pathA was copied form pathB, then `fixedcopyinfo` table in shardA contains a path_hash of pathB. However joining shardA's `fixedcopyinfo` with shardA's `paths` to convert path_hash to path fails because pathB is in shardB. The only possible fix is to split fetching path_hash from `fixedcopyinfo` and converting path_hash to path. I don't think we'll be able to keep the logic with join that we have at the moment. It would require us to have all paths on all shards which is unfeasible because it'll make writes much slower. Reviewed By: aslpavel Differential Revision: D13690141 fbshipit-source-id: 16b5cae6f23c162bb502b65c208f3ca9e443fb04 |
||
---|---|---|
apiserver | ||
async-compression | ||
asyncmemo | ||
blobrepo | ||
blobrepo_utils | ||
blobstore | ||
blobstore-sync-queue | ||
bonsai-hg-mapping | ||
bonsai-utils | ||
bookmarks | ||
bundle2-resolver | ||
bytes-ext | ||
cache-warmup/src | ||
changesets | ||
cmdlib/src | ||
cmds | ||
common | ||
eden_server | ||
failure_ext | ||
filenodes | ||
futures-ext | ||
hgcli | ||
hgproto | ||
hook_tailer | ||
hooks | ||
mercurial | ||
mercurial-bundles | ||
mercurial-types | ||
metaconfig | ||
mononoke-api/src | ||
mononoke-types | ||
netstring/src | ||
phases | ||
py_tar_utils | ||
reachabilityindex | ||
ready_state/src | ||
repo_client | ||
revset | ||
server | ||
sshrelay | ||
tests | ||
.gitignore | ||
.travis.yml | ||
Cargo.toml | ||
CONTRIBUTING.md | ||
LICENSE | ||
packman.yml | ||
README.md | ||
rustfmt.toml |
Mononoke
Mononoke is a next-generation server for the Mercurial source control system, meant to scale up to accepting thousands of commits every hour across millions of files. It is primarily written in the Rust programming language.
Caveat Emptor
Mononoke is still in early stages of development. We are making it available now because we plan to start making references to it from our other open source projects such as Eden.
The version that we provide on GitHub does not build yet.
This is because the code is exported verbatim from an internal repository at Facebook, and not all of the scaffolding from our internal repository can be easily extracted. The key areas where we need to shore things up are:
- Full support for a standard
cargo build
. - Open source replacements for Facebook-internal services (blob store, logging etc).
The current goal is to get Mononoke working on Linux. Other Unix-like OSes may be supported in the future.