A Scalable, User-Friendly Source Control System.
Go to file
Kostia Balytskyi 013318ee87 mononoke: shared future bookmarks cache
Summary:
After some discussion with Pavel Aslanov, Lukas Piatkowski and Stanislau Hlebik, it was evident that shared future is the best approach for the bookmarks cache.

The cache in this implementation maintains a shared future for each repo, fetching the full list of bookmarks. When a list of bookmarks with a  given prefix is required, a filter is applied to a full list future.

Two locks are used in this implementation: one for adding new repos to the hashtable and one for updating the cache. In both cases the optimistic strategy: "let's first first grab a read  lock and try checking if it is good enough" is applied.

Reviewed By: StanislavGlebik

Differential Revision: D13573105

fbshipit-source-id: 4e084bee13ff4941d1a42d1f75fe501575858a63
2019-01-11 10:20:34 -08:00
apiserver mononoke: move RepositoryId into mononoke-types 2018-12-19 10:24:27 -08:00
async-compression async-compression: re-add support for zstd decompression with warnings 2018-09-07 09:53:25 -07:00
asyncmemo rust/stats: don't require users to import lazy_static 2018-12-02 14:34:39 -08:00
blobrepo mononoke: shared future bookmarks cache 2019-01-11 10:20:34 -08:00
blobrepo_utils mononoke: pass CoreContext down to blobstore 2018-12-04 11:40:15 -08:00
blobstore mononoke: move RepositoryId into mononoke-types 2018-12-19 10:24:27 -08:00
blobstore-sync-queue mononoke: move RepositoryId into mononoke-types 2018-12-19 10:24:27 -08:00
bonsai-hg-mapping mononoke: move RepositoryId into mononoke-types 2018-12-19 10:24:27 -08:00
bonsai-utils mononoke: pass CoreContext down to blobstore 2018-12-04 11:40:15 -08:00
bookmarks mononoke: shared future bookmarks cache 2019-01-11 10:20:34 -08:00
bundle2-resolver write phases for public commit in pushrebase 2019-01-09 09:42:56 -08:00
bytes-ext add cargo build support for local development 2018-02-22 04:30:32 -08:00
cache-warmup/src mononoke: pass CoreContext down to blobstore 2018-12-04 11:40:15 -08:00
changesets mononoke: move RepositoryId into mononoke-types 2018-12-19 10:24:27 -08:00
cmdlib/src blobrepo: generalize methods creating Blobrepo over any remote blobstore 2019-01-10 02:57:36 -08:00
cmds blobrepo: generalize methods creating Blobrepo over any remote blobstore 2019-01-10 02:57:36 -08:00
common mononoke: move RepositoryId into mononoke-types 2018-12-19 10:24:27 -08:00
eden_server Add Cargo.toml files to crates. (#7) 2018-07-09 19:52:27 -07:00
failure_ext tp2/rust: update to rust-1.30.0 2018-11-06 16:17:18 -08:00
filenodes mononoke: move RepositoryId into mononoke-types 2018-12-19 10:24:27 -08:00
futures-ext rust/futures-ext: implement StreamEither/left_stream/right_stream 2018-12-19 16:49:24 -08:00
hgcli mononoke: do not fail if same certificate was added twice 2018-09-27 10:37:00 -07:00
hgproto getbundle request: bundlecaps param should be a set 2019-01-08 01:48:06 -08:00
hook_tailer mononoke: remove Arc<BlobRepo> from hook tailer 2019-01-09 03:52:21 -08:00
hooks Guard AclChecker::new and Identity::from_groupname as well from being included 2019-01-04 08:32:29 -08:00
mercurial mononoke: remove unused code 2018-12-05 05:58:07 -08:00
mercurial-bundles add time stats to phases calculation 2019-01-09 09:23:41 -08:00
mercurial-types add support for encording of phase-heads part of bundle2 2019-01-08 05:32:36 -08:00
metaconfig mononoke: remove unused options 2019-01-09 01:14:57 -08:00
mononoke-api/src mononoke: pass CoreContext down to blobstore 2018-12-04 11:40:15 -08:00
mononoke-types mononoke: fix MPath Debug formatting 2018-12-19 16:49:24 -08:00
netstring/src rust/netstring: move encode and decode into separate modules. 2018-09-12 20:37:41 -07:00
phases add support for encording of phase-heads part of bundle2 2019-01-08 05:32:36 -08:00
py_tar_utils move tar_utils.py from update_rust into an open sourceable location 2017-09-14 13:52:23 -07:00
reachabilityindex tp2/rust: update tools and crates to Rust 1.31.0 2018-12-07 08:39:51 -08:00
ready_state/src server: split server binary crate into 4 separate crates 2018-07-17 04:54:58 -07:00
repo_client add "phases" ("heads") cap for bundle2 2019-01-09 09:23:41 -08:00
revset mononoke: replacing SingleNodeHash revset with SingleChangesetId 2018-12-19 11:07:20 -08:00
server Avoid blocking our thread pool with a blocking network call 2019-01-10 08:36:48 -08:00
sshrelay rust/netstring: convert from error-chain to failure 2018-09-12 20:37:41 -07:00
tests add "phases" ("heads") cap for bundle2 2019-01-09 09:23:41 -08:00
.gitignore add .gitignore 2018-03-13 11:58:20 -07:00
.travis.yml Add travis-CI integration by adding .travis.yml file. 2018-07-26 10:09:32 -07:00
Cargo.toml Restore cachelib blob caching 2018-08-07 11:37:37 -07:00
CONTRIBUTING.md Initial commit 2017-07-27 18:00:19 -07:00
LICENSE Initial commit 2017-07-27 18:00:19 -07:00
packman.yml packman config file for admin tool 2018-06-04 22:09:49 -07:00
README.md mention in README that Mononoke supports Mercurial 2017-07-28 14:41:37 -07:00
rustfmt.toml Back out D13589633 "revert D13584553, D13175922, D13166085 to fix rust builds" 2019-01-09 13:31:19 -08:00

Mononoke

Mononoke is a next-generation server for the Mercurial source control system, meant to scale up to accepting thousands of commits every hour across millions of files. It is primarily written in the Rust programming language.

Caveat Emptor

Mononoke is still in early stages of development. We are making it available now because we plan to start making references to it from our other open source projects such as Eden.

The version that we provide on GitHub does not build yet.

This is because the code is exported verbatim from an internal repository at Facebook, and not all of the scaffolding from our internal repository can be easily extracted. The key areas where we need to shore things up are:

  • Full support for a standard cargo build.
  • Open source replacements for Facebook-internal services (blob store, logging etc).

The current goal is to get Mononoke working on Linux. Other Unix-like OSes may be supported in the future.