A Scalable, User-Friendly Source Control System.
Go to file
Thomas Orozco 051000a6b8 mononoke/filestore: verify hashes before committing a store
Summary:
This adds support for verifying the hashes that were provided by writers (if any) when committing a Store. This lets writers do conditional writes (i.e. if the writer knows the Sha 256 of their content, then they can ask the blobstore to verify said Sha 256 when uploading).

Note that any uploaded chunks will not be cleaned up if a conditional write fails.

Reviewed By: StanislavGlebik

Differential Revision: D16440669

fbshipit-source-id: 88bc99e646616997a4e9d7e59d59315c18f47da9
2019-07-31 05:19:37 -07:00
apiserver mononoke/filestore: introduce chunking support 2019-07-31 05:19:37 -07:00
async-compression Apply rustfmt to all rust files 2019-07-10 19:36:32 -07:00
asyncmemo Apply rustfmt to all rust files 2019-07-10 19:36:32 -07:00
benchmark mononoke: remove Logger from BlobRepo 2019-07-17 08:31:56 -07:00
blobimport_lib/src mononoke: support non-publishing / non-pull_default Bookmarks 2019-05-30 07:14:32 -07:00
blobrepo mononoke: move typed fetch to Blobstore Trait 2019-07-31 05:19:36 -07:00
blobrepo_utils mononoke: remove Logger from BlobRepo 2019-07-17 08:31:56 -07:00
blobstore mononoke/filestore: introduce chunking support 2019-07-31 05:19:37 -07:00
blobstore_sync_queue mononoke: 1.3x speed improvement for populate_healer job 2019-07-18 05:07:08 -07:00
bonsai_hg_mapping mononoke: Change stats prefix 2019-07-18 06:23:00 -07:00
bonsai_utils Transition fbcode Rust crates to 2018 edition 2019-06-24 13:15:17 -07:00
bookmarks rust: Head start on some upcoming warnings 2019-07-12 00:56:44 -07:00
bundle2_resolver Commits we are going to pushrebase should be treated as drafts 2019-07-30 06:40:21 -07:00
bytes-ext rust/thrift: Remove dependency of thrift runtime on folly 2019-07-12 18:09:34 -07:00
cache_warmup/src add more traces 2019-06-17 05:13:11 -07:00
changesets rust: Head start on some upcoming warnings 2019-07-12 00:56:44 -07:00
cmdlib/src mononoke: hoist up to_string() calls 2019-07-17 12:57:42 -07:00
cmds mononoke/filestore: introduce chunking support 2019-07-31 05:19:37 -07:00
common mononoke: avoid combinatoric explosion in derived_data framework 2019-07-24 11:55:34 -07:00
derived_data/src mononoke: avoid combinatoric explosion in derived_data framework 2019-07-24 11:55:34 -07:00
failure_ext Apply rustfmt to all rust files 2019-07-10 19:36:32 -07:00
filenodes sql: do not use shard_id in fb303 counter names 2019-07-19 06:30:40 -07:00
filestore/src mononoke/filestore: verify hashes before committing a store 2019-07-31 05:19:37 -07:00
futures-ext mononoke/filestore: verify hashes before committing a store 2019-07-31 05:19:37 -07:00
hgcli Transition fbcode Rust crates to 2018 edition 2019-06-24 13:15:17 -07:00
hgproto Log clienttelemetry data (correlator, hostname, short command) 2019-07-26 03:41:24 -07:00
hook_tailer mononoke: remove Logger from BlobRepo 2019-07-17 08:31:56 -07:00
hooks mononoke/filestore: introduce chunking support 2019-07-31 05:19:37 -07:00
manifest mononoke: move typed fetch to Blobstore Trait 2019-07-31 05:19:36 -07:00
mercurial mononoke: LFS: emit copy metadata 2019-07-17 08:13:28 -07:00
mercurial_bundles tp2/rust: add lettre and riker to rust-crates-io 2019-07-24 20:04:48 -07:00
mercurial_types tp2/rust: add lettre and riker to rust-crates-io 2019-07-24 20:04:48 -07:00
metaconfig mononoke: hoist up to_string() calls 2019-07-17 12:57:42 -07:00
mononoke_api/src remove inefficient find_path_in_manifest 2019-06-19 09:33:50 -07:00
mononoke_types mononoke/filestore: introduce chunking support 2019-07-31 05:19:37 -07:00
netstring rust: Remove extern crate from common/rust 2019-07-10 11:58:48 -07:00
phases mononoke: remove Logger from BlobRepo 2019-07-17 08:31:56 -07:00
py_tar_utils move tar_utils.py from update_rust into an open sourceable location 2017-09-14 13:52:23 -07:00
reachabilityindex mononoke: improve memory usage on mononoke startup and reduce number of small allocations 2019-07-19 04:30:26 -07:00
ready_state/src Apply rustfmt to all rust files 2019-07-10 19:36:32 -07:00
repo_client Log clienttelemetry data (correlator, hostname, short command) 2019-07-26 03:41:24 -07:00
revset mononoke: replace Box::new with boxify() 2019-07-19 01:49:52 -07:00
server mononoke: add a few more logs 2019-07-24 11:06:14 -07:00
sshrelay Transition fbcode Rust crates to 2018 edition 2019-06-24 13:15:17 -07:00
tests autoformat all of fbcode/scm with black 2019-07-30 08:19:24 -07:00
.gitignore add .gitignore 2018-03-13 11:58:20 -07:00
.rlsconfig mononoke: add a .rlsconfig 2019-07-04 02:00:09 -07:00
.travis.yml Add travis-CI integration by adding .travis.yml file. 2018-07-26 10:09:32 -07:00
Cargo.toml mononoke: rename crates to contain underscores instead of dashes 2019-03-06 07:18:28 -08:00
CONTRIBUTING.md Initial commit 2017-07-27 18:00:19 -07:00
LICENSE Initial commit 2017-07-27 18:00:19 -07:00
packman.yml mononoke: add mononoke_exec helper script 2019-06-14 03:59:58 -07:00
README.md mononoke: simple useless change 2019-05-21 12:25:10 -07:00
rustfmt.toml provide edition in .rustfmt.toml 2019-05-29 19:55:37 -07:00

Mononoke

Mononoke is a next-generation server for the Mercurial source control system, meant to scale up to accepting thousands of commits every hour across millions of files. It is primarily written in the Rust programming language.

Caveat Emptor

Mononoke is still in early stages of development. We are making it available now because we plan to start making references to it from our other open source projects such as Eden.

The version that we provide on GitHub does not build yet.

This is because the code is exported verbatim from an internal repository at Facebook, and not all of the scaffolding from our internal repository can be easily extracted. The key areas where we need to shore things up are:

  • Full support for a standard cargo build.
  • Open source replacements for Facebook-internal services (blob store, logging etc).

The current goal is to get Mononoke working on Linux. Other Unix-like OSes may be supported in the future