sapling/eden/mononoke
Mark Thomas c293fd3322 scs_server: add blobstore rate-limiting for requests
Summary:
Some requests can result in a large number of blob fetches.  Add rate limiting
so that these requests don't use up all available capacity.

Rate limits can be specified in tunables.

Reviewed By: ahornby

Differential Revision: D24592814

fbshipit-source-id: 9a73a92094d0ce01be5491b65b4808e3ebb05c11
2020-10-28 11:01:39 -07:00
..
benchmark mononoke: update Memblob::new callsites to ::default() 2020-10-07 12:11:10 -07:00
blobimport_lib mononoke: update Phases::add_reachable_as_public to futures03 2020-10-27 08:06:12 -07:00
blobrepo Thread ConfigStore into blobstore creation 2020-10-27 04:14:24 -07:00
blobrepo_utils convert ManifestOps to new style futures 2020-10-23 06:42:35 -07:00
blobstore Support marking garbage in SQLBlob 2020-10-28 10:23:55 -07:00
blobstore_sync_queue commit_rewriting: use is_empty() where possible 2020-10-04 10:03:42 -07:00
bonsai_git_mapping improve error messages for mapping length errors 2020-09-21 08:39:12 -07:00
bonsai_globalrev_mapping improve error messages for mapping length errors 2020-09-21 08:39:12 -07:00
bonsai_hg_mapping thrift: call hooks from Rust codegen 2020-10-22 17:01:47 -07:00
bookmarks bookmarks_movement: check repo lock state before moving public bookmarks 2020-10-26 07:56:31 -07:00
bulkops bulkops: add trait ChangesetBulkFetch 2020-10-08 09:43:46 -07:00
cache_warmup convert ManifestOps to new style futures 2020-10-23 06:42:35 -07:00
changesets thrift: call hooks from Rust codegen 2020-10-22 17:01:47 -07:00
cmdlib cross_repo_sync: get rid of CommitSyncerArgs 2020-10-27 17:00:08 -07:00
cmds Support marking garbage in SQLBlob 2020-10-28 10:23:55 -07:00
commit_rewriting cross_repo_sync: get rid of CommitSyncerArgs 2020-10-27 17:00:08 -07:00
common rust: update rust to 1.47.0 2020-10-15 17:28:02 -07:00
derived_data mononoke: add BonsaiDerived::derive03 2020-10-27 02:37:41 -07:00
edenapi_server history: introduce separate wire types for history API 2020-10-25 18:39:34 -07:00
fastreplay Thread ConfigStore into blobstore creation 2020-10-27 04:14:24 -07:00
filenodes thrift: call hooks from Rust codegen 2020-10-22 17:01:47 -07:00
filestore mononoke/filestore: add missing error cause 2020-10-16 07:04:12 -07:00
git Ensure we have only one ConfigStore for the application 2020-10-24 06:23:49 -07:00
gotham_ext gotham_ext: use pin_project in SignalStream 2020-10-14 11:08:13 -07:00
hgcli mononoke: check only common name in hgcli 2020-10-28 09:39:54 -07:00
hgproto commit_rewriting: use is_empty() where possible 2020-10-04 10:03:42 -07:00
hook_tailer Thread ConfigStore into blobstore creation 2020-10-27 04:14:24 -07:00
hooks print regex when rejecting a file 2020-10-19 03:27:50 -07:00
lfs_import_lib autocargo: regenerate 2020-05-19 16:08:40 -07:00
lfs_protocol mononoke: try to compress values if they above cachelib limit 2020-06-20 01:05:54 -07:00
lfs_server Thread ConfigStore into blobstore creation 2020-10-27 04:14:24 -07:00
load_limiter Regenerate all Cargo.tomls after upgrade to futures 0.3.5 2020-07-06 20:49:43 -07:00
manifest cross_repo_sync: start borrowing more instead of cloning 2020-10-27 04:19:51 -07:00
mercurial thrift: call hooks from Rust codegen 2020-10-22 17:01:47 -07:00
metaconfig Ensure we have only one ConfigStore for the application 2020-10-24 06:23:49 -07:00
microwave Daily arc lint --take RUSTFMT 2020-10-28 05:17:34 -07:00
mononoke_api cross_repo_sync: start borrowing more instead of cloning 2020-10-27 04:19:51 -07:00
mononoke_hg_sync_job Make config store always explicit 2020-10-24 06:23:49 -07:00
mononoke_types thrift: call hooks from Rust codegen 2020-10-22 17:01:47 -07:00
mutable_counters mononoke: read mutable_counters from replica in blobimport warmer 2020-10-07 05:24:30 -07:00
newfilenodes commit_rewriting: use is_empty() where possible 2020-10-04 10:03:42 -07:00
permission_checker scribe_commit_queue: log all identities of pushing user 2020-10-22 01:11:11 -07:00
phases mononoke: update Phases::add_reachable_as_public to futures03 2020-10-27 08:06:12 -07:00
pushrebase convert ManifestOps to new style futures 2020-10-23 06:42:35 -07:00
reachabilityindex thrift: call hooks from Rust codegen 2020-10-22 17:01:47 -07:00
regenerate_hg_filenodes mononoke/regenerate_hg_filenodes: make regenerate_hg_filenodes public (#39) 2020-07-30 06:50:54 -07:00
repo_client push-redirector: borrow more instead of cloning 2020-10-27 11:45:02 -07:00
repo_import cross_repo_sync: start borrowing more instead of cloning 2020-10-27 04:19:51 -07:00
revset Prepare for rustfmt 2.0 2020-09-08 07:33:16 -07:00
scs_server scs_server: add blobstore rate-limiting for requests 2020-10-28 11:01:39 -07:00
segmented_changelog segmented_changelog: replace sql log tables with scuba 2020-10-09 11:17:03 -07:00
server Thread ConfigStore into blobstore creation 2020-10-27 04:14:24 -07:00
sshrelay commit_rewriting: use is_empty() where possible 2020-10-04 10:03:42 -07:00
tests mononoke: add ChangesetInfo derived data to the walker 2020-10-28 10:53:15 -07:00
time_window_counter mononoke/lfs_server: popularity: add ODS counters, timeouts and tests 2020-07-15 03:39:23 -07:00
tunables scs_server: add blobstore rate-limiting for requests 2020-10-28 11:01:39 -07:00
unbundle_replay Thread ConfigStore into blobstore creation 2020-10-27 04:14:24 -07:00
walker mononoke: add ChangesetInfo derived data to the walker 2020-10-28 10:53:15 -07:00
Cargo.toml Support marking garbage in SQLBlob 2020-10-28 10:23:55 -07:00
README.md mononoke: add README.md and the missing pieces for supporting cargo (#13) 2020-02-13 00:12:36 -08:00

Mononoke

Mononoke is a next-generation server for the Mercurial source control system, meant to scale up to accepting thousands of commits every hour across millions of files. It is primarily written in the Rust programming language.

Caveat Emptor

Mononoke is still in early stages of development. We are making it available now because we plan to start making references to it from our other open source projects.

The version that we provide on GitHub does not build yet.

This is because the code is exported verbatim from an internal repository at Facebook, and not all of the scaffolding from our internal repository can be easily extracted. The key areas where we need to shore things up are:

  • Full support for a standard cargo build.
  • Open source replacements for Facebook-internal services (blob store, logging etc).

The current goal is to get Mononoke working on Linux. Other Unix-like OSes may be supported in the future