facebook/sapling
1
1
Fork 0
mirror of https://github.com/facebook/sapling.git synced 2024-10-10 16:57:49 +03:00
Code Issues Projects Releases Wiki Activity
1e2c466fd0
sapling/eden/mononoke/Cargo.toml

412 lines
16 KiB
TOML
Raw Normal View History

cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[package]
name = "eden_mononoke"
edition = "2018"
version = "0.1.0"
authors = ['Facebook']
license = "GPLv2+"
segmented_changelog: add segmented changelog tailer command Summary: The command reads the last SegmentedChangelog that was saved for a repository and updates head to match a given bookmark (master). Right now this is just a command that works on one repository. Follow up changes will look at deployment options and handling multiple repositories. Reviewed By: krallin Differential Revision: D24516438 fbshipit-source-id: 8f04f9426c2f2d7748c5363d2dbdf9f3acb79ddd
2020-10-30 03:35:41 +03:00
include = ["cmds/admin/**/*.rs", "cmds/aliasverify.rs", "cmds/backfill_derived_data/**/*.rs", "cmds/backfill_git_mapping.rs", "cmds/benchmark_filestore.rs", "cmds/benchmark_storage_config/**/*.rs", "cmds/blobimport.rs", "cmds/blobstore_healer/**/*.rs", "cmds/bonsai_verify/**/*.rs", "cmds/configlint.rs", "cmds/dumprev.rs", "cmds/idxdump.rs", "cmds/lfs_import.rs", "cmds/manual_scrub/**/*.rs", "cmds/rechunker.rs", "cmds/revlogrepo.rs", "cmds/segmented_changelog_seeder.rs", "cmds/segmented_changelog_tailer.rs", "cmds/sqlblob_gc/**/*.rs", "cmds/statistics_collector.rs", "cmds/streaming_clone_warmup/**/*.rs", "cmds/upload_globalrevs.rs"]
mononoke/admin: make it OSS buildable Reviewed By: krallin Differential Revision: D22458187 fbshipit-source-id: 05d321bc1aded67fb2eca851b4b1ad4a8bd49d52
2020-07-11 08:08:09 +03:00
[[bin]]
name = "admin"
path = "cmds/admin/main.rs"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[[bin]]
name = "aliasverify"
path = "cmds/aliasverify.rs"
[[bin]]
name = "backfill_derived_data"
path = "cmds/backfill_derived_data/main.rs"
[[bin]]
name = "backfill_git_mapping"
path = "cmds/backfill_git_mapping.rs"
mononoke/benchmark_filestore: make it OSS buildable Reviewed By: krallin Differential Revision: D22475133 fbshipit-source-id: c14bf4f0811e8c2f1cf31416bf88f378caf50be3
2020-07-11 08:08:09 +03:00
[[bin]]
name = "benchmark_filestore"
path = "cmds/benchmark_filestore.rs"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[[bin]]
name = "benchmark_storage_config"
path = "cmds/benchmark_storage_config/main.rs"
mononoke/blobimport: make it OSS buildable Reviewed By: krallin Differential Revision: D22455491 fbshipit-source-id: 919ba0e4fc759ef25546eacf30200ff19cd89466
2020-07-13 12:58:20 +03:00
[[bin]]
name = "blobimport"
path = "cmds/blobimport.rs"
mononoke/blobstore_healer: make it OSS buildable Reviewed By: farnz Differential Revision: D22460549 fbshipit-source-id: aa5327f5dae1008cee784d41e322034cd0bb5b61
2020-07-13 12:58:20 +03:00
[[bin]]
name = "blobstore_healer"
path = "cmds/blobstore_healer/main.rs"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[[bin]]
name = "bonsai_verify"
path = "cmds/bonsai_verify/main.rs"
[[bin]]
name = "configlint"
path = "cmds/configlint.rs"
[[bin]]
name = "dumprev"
path = "cmds/dumprev.rs"
[[bin]]
name = "idxdump"
path = "cmds/idxdump.rs"
[[bin]]
name = "lfs_import"
path = "cmds/lfs_import.rs"
Command to manually scrub keys supplied on stdin Summary: For populating the XDB blobstore, we'd like to copy data from Manifold - the easiest way to do that is to exploit MultiplexedBlobstore's scrub mode to copy data directly. Reviewed By: krallin Differential Revision: D22373838 fbshipit-source-id: 550a9c73e79059380337fa35ac94fe1134378196
2020-07-10 10:59:29 +03:00
[[bin]]
name = "manual_scrub"
path = "cmds/manual_scrub/main.rs"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[[bin]]
name = "rechunker"
path = "cmds/rechunker.rs"
[[bin]]
name = "revlogrepo"
path = "cmds/revlogrepo.rs"
cmds: add segmented_changelog seeder Summary: Mononoke command for running the SegmentedChangelogSeeder for an existing repository. The result is going to be a new IdMap version in the metadata store and a new IdDag stored in the the blobstore resulting in a brand new SegmentedChangelog bundle. Reviewed By: krallin Differential Revision: D24096963 fbshipit-source-id: 1eaf78392d66542d9674a99ad0a741f24bc2cb1b
2020-10-08 19:41:16 +03:00
[[bin]]
name = "segmented_changelog_seeder"
path = "cmds/segmented_changelog_seeder.rs"
Support marking garbage in SQLBlob Summary: We want to be able to detect garbage blobs by looking at generation numbers. Update generation numbers on put, and have a mark command exist to mark blobs as not garbage. Reviewed By: ahornby Differential Revision: D23989289 fbshipit-source-id: d96f38649151e3dbd5297cffc262776e74f6cc86
2020-10-28 20:22:18 +03:00
[[bin]]
segmented_changelog: add segmented changelog tailer command Summary: The command reads the last SegmentedChangelog that was saved for a repository and updates head to match a given bookmark (master). Right now this is just a command that works on one repository. Follow up changes will look at deployment options and handling multiple repositories. Reviewed By: krallin Differential Revision: D24516438 fbshipit-source-id: 8f04f9426c2f2d7748c5363d2dbdf9f3acb79ddd
2020-10-30 03:35:41 +03:00
name = "segmented_changelog_tailer"
path = "cmds/segmented_changelog_tailer.rs"
[[bin]]
Support marking garbage in SQLBlob Summary: We want to be able to detect garbage blobs by looking at generation numbers. Update generation numbers on put, and have a mark command exist to mark blobs as not garbage. Reviewed By: ahornby Differential Revision: D23989289 fbshipit-source-id: d96f38649151e3dbd5297cffc262776e74f6cc86
2020-10-28 20:22:18 +03:00
name = "sqlblob_gc"
path = "cmds/sqlblob_gc/main.rs"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[[bin]]
name = "statistics_collector"
path = "cmds/statistics_collector.rs"
utility to keep streaming clone data warm Summary: This is streaming clone warmup binary as per https://fb.quip.com/hfuBAdYnzr9M Reviewed By: StanislavGlebik Differential Revision: D23347029 fbshipit-source-id: f187a2f3529a7eae5998bab199228bfbe6057e6e
2020-09-01 17:12:10 +03:00
[[bin]]
name = "streaming_clone_warmup"
path = "cmds/streaming_clone_warmup/main.rs"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[[bin]]
name = "upload_globalrevs"
path = "cmds/upload_globalrevs.rs"
[dependencies]
Add version specificiation to internal dependencies Summary: Lots of generated code in this diff. Only code change was in `common/rust/cargo_from_buck/lib/cargo_generator.py`. Path/git-only dependencies (ie `mydep = { path = "../foo/bar" }`) are not publishable to crates.io. However, we are allowed to specify both a path/git _and_ a version. When building locally, the path/git is chosen. When publishing, the version on crates.io is chosen. See https://doc.rust-lang.org/cargo/reference/specifying-dependencies.html#multiple-locations . Note that I understand that not all autocargo projects are published on crates.io (yet). The point of this diff is to allow projects to slowly start getting uploaded. The end goal is autocargo generated `Cargo.toml`s that can be `cargo publish`ed without further modification. Reviewed By: lukaspiatkowski Differential Revision: D26028982 fbshipit-source-id: f7b4c9d4f4dd004727202bd98ab10e201a21e88c
2021-01-26 09:08:20 +03:00
backsyncer = { path = "commit_rewriting/backsyncer", version = "0.1.0" }
blame = { path = "derived_data/blame", version = "0.1.0" }
blobimport_lib = { path = "blobimport_lib", version = "0.1.0" }
blobrepo = { path = "blobrepo", version = "0.1.0" }
blobrepo_factory = { path = "blobrepo/factory", version = "0.1.0" }
blobrepo_hg = { path = "blobrepo/blobrepo_hg", version = "0.1.0" }
blobrepo_override = { path = "blobrepo/override", version = "0.1.0" }
blobrepo_utils = { path = "blobrepo_utils", version = "0.1.0" }
blobstore = { path = "blobstore", version = "0.1.0" }
blobstore_factory = { path = "blobstore/factory", version = "0.1.0" }
blobstore_sync_queue = { path = "blobstore_sync_queue", version = "0.1.0" }
bonsai_globalrev_mapping = { path = "bonsai_globalrev_mapping", version = "0.1.0" }
bookmark_renaming = { path = "commit_rewriting/bookmark_renaming", version = "0.1.0" }
bookmarks = { path = "bookmarks", version = "0.1.0" }
mononoke: allow pushes in globalrev repos to ancestors of globalrev bookmark Summary: Like it says in the title, this updates our implementation of Globalrevs to be a little more relaxed, and allows you to create and move bookmarks as long as they are ancestors of the "main" Globalrevs bookmark (but NOT to pushrebase to them later, because we only want to allow ONE globalrevs-publishing bookmark per repo). While in there, I also deduplicated how we instantiate pushrebase hooks a little bit. If anything, this could be better in the pushrebase crate, but that'd be a circular dependency between pushrebase & bookmarks movement. Eventually, the callsites should probably be using bookmarks movement anyway, so leaving pushrebase as the low-level crate and bookmarks movement as the high level one seems reasonable. Reviewed By: StanislavGlebik Differential Revision: D26020274 fbshipit-source-id: 5ff6c1a852800b491a16d16f632462ce9453c89a
2021-02-01 16:28:45 +03:00
bookmarks_movement = { path = "bookmarks/bookmarks_movement", version = "0.1.0" }
Add version specificiation to internal dependencies Summary: Lots of generated code in this diff. Only code change was in `common/rust/cargo_from_buck/lib/cargo_generator.py`. Path/git-only dependencies (ie `mydep = { path = "../foo/bar" }`) are not publishable to crates.io. However, we are allowed to specify both a path/git _and_ a version. When building locally, the path/git is chosen. When publishing, the version on crates.io is chosen. See https://doc.rust-lang.org/cargo/reference/specifying-dependencies.html#multiple-locations . Note that I understand that not all autocargo projects are published on crates.io (yet). The point of this diff is to allow projects to slowly start getting uploaded. The end goal is autocargo generated `Cargo.toml`s that can be `cargo publish`ed without further modification. Reviewed By: lukaspiatkowski Differential Revision: D26028982 fbshipit-source-id: f7b4c9d4f4dd004727202bd98ab10e201a21e88c
2021-01-26 09:08:20 +03:00
bounded_traversal = { path = "common/bounded_traversal", version = "0.1.0" }
bulkops = { path = "bulkops", version = "0.1.0" }
cacheblob = { path = "blobstore/cacheblob", version = "0.1.0" }
changeset_fetcher = { path = "blobrepo/changeset_fetcher", version = "0.1.0" }
changesets = { path = "changesets", version = "0.1.0" }
cmdlib = { path = "cmdlib", version = "0.1.0" }
context = { path = "server/context", version = "0.1.0" }
mononoke: move functions from rsync admin to copy_utils Summary: I plan to use these functions in the megarepotool, so let's move them to a library that can be used in both. Reviewed By: krallin Differential Revision: D26015773 fbshipit-source-id: 0d2d28d86471c417508494883b69fb64e1bea328
2021-01-27 13:44:40 +03:00
copy_utils = { path = "common/copy_utils", version = "0.1.0" }
Add version specificiation to internal dependencies Summary: Lots of generated code in this diff. Only code change was in `common/rust/cargo_from_buck/lib/cargo_generator.py`. Path/git-only dependencies (ie `mydep = { path = "../foo/bar" }`) are not publishable to crates.io. However, we are allowed to specify both a path/git _and_ a version. When building locally, the path/git is chosen. When publishing, the version on crates.io is chosen. See https://doc.rust-lang.org/cargo/reference/specifying-dependencies.html#multiple-locations . Note that I understand that not all autocargo projects are published on crates.io (yet). The point of this diff is to allow projects to slowly start getting uploaded. The end goal is autocargo generated `Cargo.toml`s that can be `cargo publish`ed without further modification. Reviewed By: lukaspiatkowski Differential Revision: D26028982 fbshipit-source-id: f7b4c9d4f4dd004727202bd98ab10e201a21e88c
2021-01-26 09:08:20 +03:00
cross_repo_sync = { path = "commit_rewriting/cross_repo_sync", version = "0.1.0" }
dbbookmarks = { path = "bookmarks/dbbookmarks", version = "0.1.0" }
deleted_files_manifest = { path = "derived_data/deleted_files_manifest", version = "0.1.0" }
derived_data = { path = "derived_data", version = "0.1.0" }
derived_data_filenodes = { path = "derived_data/filenodes", version = "0.1.0" }
derived_data_utils = { path = "derived_data/utils", version = "0.1.0" }
fastlog = { path = "derived_data/fastlog", version = "0.1.0" }
filenodes = { path = "filenodes", version = "0.1.0" }
filestore = { path = "filestore", version = "0.1.0" }
fsnodes = { path = "derived_data/fsnodes", version = "0.1.0" }
git_types = { path = "git/git_types", version = "0.1.0" }
lfs_import_lib = { path = "lfs_import_lib", version = "0.1.0" }
live_commit_sync_config = { path = "commit_rewriting/live_commit_sync_config", version = "0.1.0" }
manifest = { path = "manifest", version = "0.1.0" }
memblob = { path = "blobstore/memblob", version = "0.1.0" }
mercurial_bundle_replay_data = { path = "mercurial/bundle_replay_data", version = "0.1.0" }
mercurial_derived_data = { path = "derived_data/mercurial_derived_data", version = "0.1.0" }
mercurial_revlog = { path = "mercurial/revlog", version = "0.1.0" }
mercurial_types = { path = "mercurial/types", version = "0.1.0" }
metaconfig_types = { path = "metaconfig/types", version = "0.1.0" }
mononoke_hg_sync_job_helper_lib = { path = "mononoke_hg_sync_job", version = "0.1.0" }
mononoke_types = { path = "mononoke_types", version = "0.1.0" }
mutable_counters = { path = "mutable_counters", version = "0.1.0" }
prefixblob = { path = "blobstore/prefixblob", version = "0.1.0" }
pushrebase = { path = "pushrebase", version = "0.1.0" }
redactedblobstore = { path = "blobstore/redactedblobstore", version = "0.1.0" }
revset = { path = "revset", version = "0.1.0" }
scuba_ext = { path = "common/scuba_ext", version = "0.1.0" }
segmented_changelog = { path = "segmented_changelog", version = "0.1.0" }
skeleton_manifest = { path = "derived_data/skeleton_manifest", version = "0.1.0" }
skiplist = { path = "reachabilityindex/skiplist", version = "0.1.0" }
sql_construct = { path = "common/sql_construct", version = "0.1.0" }
sql_ext = { path = "common/rust/sql_ext", version = "0.1.0" }
sqlblob = { path = "blobstore/sqlblob", version = "0.1.0" }
streaming_clone = { path = "repo_client/streaming_clone", version = "0.1.0" }
synced_commit_mapping = { path = "commit_rewriting/synced_commit_mapping", version = "0.1.0" }
throttledblob = { path = "blobstore/throttledblob", version = "0.1.0" }
unodes = { path = "derived_data/unodes", version = "0.1.0" }
xdiff = { path = "../scm/lib/xdiff", version = "0.1.0" }
borrowed = { git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master", version = "0.1.0" }
cached_config = { git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master", version = "0.1.0" }
cachelib = { git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master", version = "0.1.0" }
cloned = { git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master", version = "0.1.0" }
failure_ext = { git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master", version = "0.1.0" }
fbinit = { git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master", version = "0.1.0" }
fbthrift = { git = "https://github.com/facebook/fbthrift.git", branch = "master", version = "0.0.1+unstable" }
futures_ext = { package = "futures_01_ext", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master", version = "0.1.0" }
blobstore_healer: use buffered_weight_limited to avoid OOMs Summary: `blobstore_healer` works by healing blobs in turn, with some level of concurrency. Healing each blob consumes at least `O(blob_size)` or memory, so healing multiple blobs consumes their combined size of memory. Because blob sizes are not distributed uniformly, we cannot just calculate the desired concurrency level once and for all. Prior to this diff, this is what we did and whenever a few multi-gb blobs ended up in the same concurrently-healed batch, the healer OOMed. To help with this problem, this diff starts using dynamic concurrency - it assigns weight to each healed blob and only concurrently heals up to a certain total weight of blobs. This way, we can limit the total amount of memory consumed by our healer. This solution is not perfect for a variety of reasons: - if a single blob is larger than the total allowed weight, we'll still let it through. It's better than never healing it, but it means that OOMs are still possible in theory. - we do not yet know the sizes of all the blobs in the queue. To mitigate that, I took a look at the known sizes distribution and saw that between 0 and 2KB is the most common size range. I defaulted to 1KB size of the unknown blob Note 1: I had to make `heal_blob` consume it's args instead of borrowing them because `buffered_weight_limited` needs `'static` lifetime for the futures. Note 2: When using `futures_ext`, I explicitly rename them to `futures_03_ext`, despite the fact that `blobstore_healer` does not depend on the older version. This is because `Cargo.toml` uses the same `[dependencies]` section for the combined dependencies of all the targets in the same `TARGETS` file. As there are other targets that claim the name of `futures_ext` for 0.1 version, I decided that it's easier to just use `_03_` name here than fix in other places. We can always change that of course. Reviewed By: krallin Differential Revision: D26106044 fbshipit-source-id: 4931d86d6e85d055ed0eefdd357b9ba6266a1c37
2021-01-29 21:10:34 +03:00
futures_03_ext = { package = "futures_ext", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master", version = "0.1.0" }
Add version specificiation to internal dependencies Summary: Lots of generated code in this diff. Only code change was in `common/rust/cargo_from_buck/lib/cargo_generator.py`. Path/git-only dependencies (ie `mydep = { path = "../foo/bar" }`) are not publishable to crates.io. However, we are allowed to specify both a path/git _and_ a version. When building locally, the path/git is chosen. When publishing, the version on crates.io is chosen. See https://doc.rust-lang.org/cargo/reference/specifying-dependencies.html#multiple-locations . Note that I understand that not all autocargo projects are published on crates.io (yet). The point of this diff is to allow projects to slowly start getting uploaded. The end goal is autocargo generated `Cargo.toml`s that can be `cargo publish`ed without further modification. Reviewed By: lukaspiatkowski Differential Revision: D26028982 fbshipit-source-id: f7b4c9d4f4dd004727202bd98ab10e201a21e88c
2021-01-26 09:08:20 +03:00
futures_stats = { git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master", version = "0.1.0" }
lock_ext = { git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master", version = "0.1.0" }
stats = { git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master", version = "0.1.0" }
time_ext = { git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master", version = "0.1.0" }
tracing = { git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master", version = "0.1.0" }
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
anyhow = "1.0"
ascii = "1.0"
async-trait = "0.1.29"
bytes = { version = "0.5", features = ["serde"] }
Measure per-generation sizes in XDB Blobstore Summary: Provide a command that measures per-generation sizes, to be run in Chronos. Reviewed By: ahornby Differential Revision: D25981511 fbshipit-source-id: 7d9877dd5d04ac6881b5024e0ba132c234499d5a
2021-01-27 23:33:05 +03:00
bytesize = "1.0"
mononoke/blobstore_healer: make it OSS buildable Reviewed By: farnz Differential Revision: D22460549 fbshipit-source-id: aa5327f5dae1008cee784d41e322034cd0bb5b61
2020-07-13 12:58:20 +03:00
chrono = { version = "0.4", features = ["serde"] }
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
clap = "2.33"
third-party/rust: pin criterion to 0.3.1 Summary: Building criterion in opt mode degradated enormously after moving to 0.3.3, pin it to 0.3.1 for now until we figure out what is the problem. Reviewed By: ljw1004 Differential Revision: D24046885 fbshipit-source-id: 6373eb06b5f47061cc02597bf82f574511fbec43
2020-10-01 19:26:04 +03:00
criterion = "=0.3.1"
Regenerate all Cargo.tomls after upgrade to futures 0.3.5 Summary: D22381744 updated the version of `futures` in third-party/rust to 0.3.5, but did not regenerate the autocargo-managed Cargo.toml files in the repo. Although this is a semver-compatible change (and therefore should not break anything), it means that affected projects would see changes to all of their Cargo.toml files the next time they ran `cargo autocargo`. Reviewed By: dtolnay Differential Revision: D22403809 fbshipit-source-id: eb1fdbaf69c99549309da0f67c9bebcb69c1131b
2020-07-07 06:47:39 +03:00
futures = { version = "0.3.5", features = ["async-await", "compat"] }
third-party/rust: update Tokio 0.2.x to 0.2.24 & futures 1.x to 1.30 Summary: When we tried to update to Tokio 0.2.14, we hit lots of hangs. Those were due to incompatibilities between Tokio 0.2.14 and Futures 1.29. We fixed some of the bugs (and others had been fixed and were pending a release), and Futures 1.30 have now been released, which unblocks our update. This diff updates Tokio accordingly (the previous diff in the stack fixes an incompatibility). The underlying motivation here is to ease the transition to Tokio 1.0. Ultimately we'll be pulling in those changes one or way or another, so let's get started on this incremental first step. Reviewed By: farnz Differential Revision: D25952428 fbshipit-source-id: b753195a1ffb404e0b0975eb7002d6d67ba100c2
2021-01-25 19:04:36 +03:00
futures-old = { package = "futures", version = "0.1.30" }
mononoke/integration: make integration tests work under @mode/dev-rust-oss Summary: Last step in covering Mononoke with mode/dev-rust-oss buck build mode. Reviewed By: markbt Differential Revision: D25461223 fbshipit-source-id: 3fa0fa05e8c96476e069990e8f5cc6d56acf38c0
2020-12-18 17:08:52 +03:00
futures-util = "0.3.7"
backfill_derived_data: improve logging Summary: Improve backfill_derived_data logging to make it clear when a chunk is started and when already-derived changesets have been skipped. Fix the counters to take into account skiped changesets, and make the time remaining human-readable. Reviewed By: StanislavGlebik Differential Revision: D25099919 fbshipit-source-id: b39d4b99ef0e79d253de2aa0c91f93276b561680
2020-11-30 17:21:58 +03:00
humantime = "1.3"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
itertools = "0.8"
mononoke/blobstore_healer: make it OSS buildable Reviewed By: farnz Differential Revision: D22460549 fbshipit-source-id: aa5327f5dae1008cee784d41e322034cd0bb5b61
2020-07-13 12:58:20 +03:00
lazy_static = "1.0"
mononoke: admin command to change mapping version Summary: We'll use this command to change the mapping version we use when doing push redirection. Reviewed By: ikostia Differential Revision: D24392308 fbshipit-source-id: 4dab01c0e58a8953a0c6c84c7c166977a6baf00f
2020-10-19 19:44:08 +03:00
maplit = "1.0"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
rand = { version = "0.7", features = ["small_rng"] }
Update regex to v1.4.2 Summary: Update so libbpf-cargo doens't need to downgrade regex version. Reviewed By: kevin-vigor Differential Revision: D25719327 fbshipit-source-id: 5781871a359f744e2701a34df1931f0c37958c27
2020-12-30 09:57:57 +03:00
regex = "1.4.2"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
serde = { version = "1.0", features = ["derive", "rc"] }
serde_derive = "1.0"
autocargo: regen Summary: Regen autocargo Reviewed By: quark-zju Differential Revision: D25409963 fbshipit-source-id: 7dbbe420aeb30248bf43d3a96a9aa6a47bb2b0be
2020-12-09 05:28:35 +03:00
serde_json = { version = "1.0", features = ["float_roundtrip"] }
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
sha2 = "0.8"
slog = { version = "2.5", features = ["max_level_debug"] }
mononoke/admin: make it OSS buildable Reviewed By: krallin Differential Revision: D22458187 fbshipit-source-id: 05d321bc1aded67fb2eca851b4b1ad4a8bd49d52
2020-07-11 08:08:09 +03:00
thiserror = "1.0"
third-party/rust: update Tokio 0.2.x to 0.2.24 & futures 1.x to 1.30 Summary: When we tried to update to Tokio 0.2.14, we hit lots of hangs. Those were due to incompatibilities between Tokio 0.2.14 and Futures 1.29. We fixed some of the bugs (and others had been fixed and were pending a release), and Futures 1.30 have now been released, which unblocks our update. This diff updates Tokio accordingly (the previous diff in the stack fixes an incompatibility). The underlying motivation here is to ease the transition to Tokio 1.0. Ultimately we'll be pulling in those changes one or way or another, so let's get started on this incremental first step. Reviewed By: farnz Differential Revision: D25952428 fbshipit-source-id: b753195a1ffb404e0b0975eb7002d6d67ba100c2
2021-01-25 19:04:36 +03:00
tokio = { version = "0.2.24", features = ["full", "test-util"] }
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
tokio-compat = "0.1"
mononoke/admin: make it OSS buildable Reviewed By: krallin Differential Revision: D22458187 fbshipit-source-id: 05d321bc1aded67fb2eca851b4b1ad4a8bd49d52
2020-07-11 08:08:09 +03:00
tokio-timer = "0.2"
explicitly specify features for tokio-util Summary: This is needed in a later diff that requires "codec" feature from `future-util`. Reviewed By: dtolnay Differential Revision: D23575630 fbshipit-source-id: e9cdf11b6ec05e5f2744da6b6efd8cb7bf08b212
2020-09-09 03:51:25 +03:00
tokio-util = { version = "0.2", features = ["codec", "udp"] }
convert BlobRepoHg to new type futures Summary: Convert all BlobRepoHg methods to new type futures Reviewed By: StanislavGlebik Differential Revision: D25471540 fbshipit-source-id: c8e99509d39d0e081d082097cbd9dbfca431637e
2020-12-17 18:43:34 +03:00
toml = "=0.5.7"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[dev-dependencies]
Add version specificiation to internal dependencies Summary: Lots of generated code in this diff. Only code change was in `common/rust/cargo_from_buck/lib/cargo_generator.py`. Path/git-only dependencies (ie `mydep = { path = "../foo/bar" }`) are not publishable to crates.io. However, we are allowed to specify both a path/git _and_ a version. When building locally, the path/git is chosen. When publishing, the version on crates.io is chosen. See https://doc.rust-lang.org/cargo/reference/specifying-dependencies.html#multiple-locations . Note that I understand that not all autocargo projects are published on crates.io (yet). The point of this diff is to allow projects to slowly start getting uploaded. The end goal is autocargo generated `Cargo.toml`s that can be `cargo publish`ed without further modification. Reviewed By: lukaspiatkowski Differential Revision: D26028982 fbshipit-source-id: f7b4c9d4f4dd004727202bd98ab10e201a21e88c
2021-01-26 09:08:20 +03:00
fixtures = { path = "tests/fixtures", version = "0.1.0" }
tests_utils = { path = "tests/utils", version = "0.1.0" }
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
mononoke: add README.md and the missing pieces for supporting cargo (#13) Summary: Take the README.md from https://github.com/facebookexperimental/mononoke/blob/7ead0e29e41aec0771531a4650b6170bc1ff6566/README.md and apply it on Eden repo. Re-add the Cargo.toml file that declares Cargo workspace. Re-add fbcode_builder/getdeps manifest for Mononoke Pull Request resolved: https://github.com/facebookexperimental/eden/pull/13 Test Plan: ./build/fbcode_builder/getdeps.py build mononoke ./build/fbcode_builder/getdeps.py test mononoke Reviewed By: ahornby Differential Revision: D19833059 Pulled By: lukaspiatkowski fbshipit-source-id: fb37e13306c0b9969a7c4e52b05e1a66a577022f
2020-02-13 11:11:03 +03:00
[workspace]
members = [
mononoke: add Cargo.toml files for code previously depending on identity_ext Reviewed By: farnz Differential Revision: D21864833 fbshipit-source-id: 782175af73f5937534566c99e6dc1e7fcf319f6c
2020-06-11 04:08:35 +03:00
".",
mononoke: add a library for ALPN support Summary: I'd like to update our connection acceptor to support ALPN in order to distinguish hgcli traffic from http traffic (the former will have ALPN and the latter will not). To do so, I need to parse ALPN, which is a length-prefixed bytestring format. Let's add support for it in a library. This is what this does. Reviewed By: johansglock Differential Revision: D25954536 fbshipit-source-id: 3756dde90906a5f0f36630b866bcb17d03bc94c6
2021-01-20 20:14:11 +03:00
"alpn",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"benchmark",
mononoke: reverse autocargo include list to excludes Summary: Cover as much as remining code with `Cargo.toml`s, for the rest create an exlusion list in the autocargo config. Reviewed By: krallin Differential Revision: D21383620 fbshipit-source-id: 64cc78a38ce0ec482966f32a2963ab4939e20eba
2020-05-06 18:40:41 +03:00
"blobimport_lib",
mononoke: blobimport record highest imported generation number Reviewed By: krallin Differential Revision: D23053788 fbshipit-source-id: 615a4f4064a56d6e45818f85f002267d4bf08c95
2020-08-12 18:48:16 +03:00
"blobimport_lib/consts",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"blobrepo",
BlobRepoHg extension trait. Summary: This diff introduces `BlobRepoHg` extension trait for `BlobRepo` object. Which contains mercurial specific methods that were previously part of `BlobRepo`. This diff also stars moving some of the methods from BlobRepo to BlobRepoHg. Reviewed By: ikostia Differential Revision: D21659867 fbshipit-source-id: 1af992915a776f6f6e49b03e4156151741b2fca2
2020-06-22 17:20:47 +03:00
"blobrepo/blobrepo_hg",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"blobrepo/blobsync",
"blobrepo/changeset_fetcher",
move function used by mercurial_derived_data into a separate crate Summary: Moving some of the functionality (which is required for mercurial changeset derivation) into a separate crate. This is required to convert mercurial changeset to derived data to avoid circular dependency it would create otherwise. Reviewed By: StanislavGlebik Differential Revision: D23566293 fbshipit-source-id: 9d30b4b3b7d8a922f72551aa5118c43104ef382c
2020-09-09 12:46:42 +03:00
"blobrepo/common",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"blobrepo/errors",
"blobrepo/factory",
move DangerousOverride into a separate crate `blobrepo_override` Summary: DangerousOverride is moved into a separate crate. Not only it is usually not needed but it was introducing dependencies on mercurial crate. Reviewed By: StanislavGlebik Differential Revision: D22115015 fbshipit-source-id: c9646896f906ea54d11aa83a8fbd8490a5b115ea
2020-06-22 17:20:47 +03:00
"blobrepo/override",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"blobrepo/repo_blobstore",
mononoke: cover more crates with OSS buildability that depend on cmdlib crate Reviewed By: krallin Differential Revision: D20735803 fbshipit-source-id: d4159d16384ff795717f6ccdd278b6b4af45d1ab
2020-04-08 13:01:39 +03:00
"blobrepo_utils",
mononoke: make blobstore OSS-buildable Summary: Adds the Cargo.toml files for blobstore, this is a step towards covering mononoke-types, so only the blobstore traits are covered by this diff. Reviewed By: aslpavel Differential Revision: D19948739 fbshipit-source-id: c945a9ca16ccceb0e50a50d941dec65ea74fe78f
2020-02-19 16:13:31 +03:00
"blobstore",
mononoke: Add logging blobstore Summary: The blobstore multiplexer contains logic to log blobstore operations to scuba, as well as updating `PerfCounters`. There are some cases where we don't use the multiplexed blobstore, which means that we're missing this important logging. Factor out the logging to a separate crate and implement `LogBlob`, which wraps another blobstore and performs logging to both scuba and PerfCounters. Reviewed By: StanislavGlebik Differential Revision: D21573455 fbshipit-source-id: 490ffd347f1ad19effc93b93f880836467b87651
2020-05-15 20:26:47 +03:00
"blobstore/blobstore_stats",
mononoke: make blobstore/sqlblob buildable in OSS Summary: This shifts the responsibility of mocking all facebook-specific code to mononoke's sql_ext crate. If OSS code calls into any of that code it will most likely result in a panic. Reviewed By: ahornby Differential Revision: D20247580 fbshipit-source-id: 43f158d91aa32adaa5df6e3786243fb89c9ce961
2020-03-27 18:09:08 +03:00
"blobstore/cacheblob",
blobstore: cover more blobstores to make them OSS buildable Reviewed By: farnz Differential Revision: D20221288 fbshipit-source-id: 708be6d429e673dcb4201b88541dff2bf9fca153
2020-03-06 12:28:21 +03:00
"blobstore/chaosblob",
"blobstore/delayblob",
mononoke: make newfilenodes and blobstore/factory OSS buildable Summary: In the process the blobstore/factory/lib.rs was split into submodules - this way it was easier to untangle the dependencies and refactor it, so I've left the split in this diff. Reviewed By: markbt Differential Revision: D20302068 fbshipit-source-id: caa3a2b5487c30198c62f7e4f4e9cb7c488dc8de
2020-03-31 13:56:11 +03:00
"blobstore/factory",
blobstore: cover more blobstores to make them OSS buildable Reviewed By: farnz Differential Revision: D20221288 fbshipit-source-id: 708be6d429e673dcb4201b88541dff2bf9fca153
2020-03-06 12:28:21 +03:00
"blobstore/fileblob",
mononoke: make blobstore/sqlblob buildable in OSS Summary: This shifts the responsibility of mocking all facebook-specific code to mononoke's sql_ext crate. If OSS code calls into any of that code it will most likely result in a panic. Reviewed By: ahornby Differential Revision: D20247580 fbshipit-source-id: 43f158d91aa32adaa5df6e3786243fb89c9ce961
2020-03-27 18:09:08 +03:00
"blobstore/if",
mononoke: Add logging blobstore Summary: The blobstore multiplexer contains logic to log blobstore operations to scuba, as well as updating `PerfCounters`. There are some cases where we don't use the multiplexed blobstore, which means that we're missing this important logging. Factor out the logging to a separate crate and implement `LogBlob`, which wraps another blobstore and performs logging to both scuba and PerfCounters. Reviewed By: StanislavGlebik Differential Revision: D21573455 fbshipit-source-id: 490ffd347f1ad19effc93b93f880836467b87651
2020-05-15 20:26:47 +03:00
"blobstore/logblob",
blobstore: cover more blobstores to make them OSS buildable Reviewed By: farnz Differential Revision: D20221288 fbshipit-source-id: 708be6d429e673dcb4201b88541dff2bf9fca153
2020-03-06 12:28:21 +03:00
"blobstore/memblob",
mononoke/blobstore: make multiplexed blobstore OSS buildable Reviewed By: mitrandir77 Differential Revision: D20279770 fbshipit-source-id: b8b8e5dbffe8e5da133da5ede916e277dbfea35f
2020-03-27 21:37:45 +03:00
"blobstore/multiplexedblob",
mononoke: add basic packblob blobstore Summary: Add basic packblob store which wraps blobs in the thrift StorageEnvelope type on put() and unwraps them on get() Reviewed By: farnz Differential Revision: D21924405 fbshipit-source-id: 81eccf5da6b5b50bdb9aae13622301a20dca0eac
2020-06-16 14:09:54 +03:00
"blobstore/packblob",
mononoke: packblob: thrift definitions and README Summary: Thift definitions for a new blobstore layer known as packblob, which is an enabling part of compression at the mononoke blobstore layer. Its storage formats will support raw data, individual blob compression and blob delta compression. The included README.md has more detail on the expected use of these types. Reviewed By: farnz Differential Revision: D21761723 fbshipit-source-id: a277800f4b4aed5972c4a5bb277e984ff12660f8
2020-06-16 14:09:54 +03:00
"blobstore/packblob/if",
blobstore: cover more blobstores to make them OSS buildable Reviewed By: farnz Differential Revision: D20221288 fbshipit-source-id: 708be6d429e673dcb4201b88541dff2bf9fca153
2020-03-06 12:28:21 +03:00
"blobstore/prefixblob",
"blobstore/readonlyblob",
"blobstore/redactedblobstore",
mononoke: add a sampling blobstore Summary: Add a sampling blobstore for use by the walker. Combined with the SamplingKey in next in stack it allows samplinglow level blobstore operations from hight level actions on things like BlobRepo. Reviewed By: mitrandir77 Differential Revision: D20534843 fbshipit-source-id: 8c7378572a4f78534f66b09adfccf08b3aaa103d
2020-03-23 15:06:51 +03:00
"blobstore/samplingblob",
mononoke: make blobstore/sqlblob buildable in OSS Summary: This shifts the responsibility of mocking all facebook-specific code to mononoke's sql_ext crate. If OSS code calls into any of that code it will most likely result in a panic. Reviewed By: ahornby Differential Revision: D20247580 fbshipit-source-id: 43f158d91aa32adaa5df6e3786243fb89c9ce961
2020-03-27 18:09:08 +03:00
"blobstore/sqlblob",
blobstore: cover more blobstores to make them OSS buildable Reviewed By: farnz Differential Revision: D20221288 fbshipit-source-id: 708be6d429e673dcb4201b88541dff2bf9fca153
2020-03-06 12:28:21 +03:00
"blobstore/throttledblob",
mononoke/virtually_sharded_blobstore: a caching blobstore that deduplicates Summary: This introduces a caching blobstore that deduplicates reads and writes. The underlying motivation is to improve performance for processes that might find themsleves inadvertently reading the same data concurrently from a bunch of independent callsites (most of Mononoke), or writing the same bit of data over and over again. The latter is particularly useful for things like commit cloud backfilling in WWW, where some logger commits include the same blob being written hundreds or thousands of times, and cause us to overload the underlying Zippy shard in Manifold. This is however a problem we've also encountered in the past in e.g. the deleted files manifest and had to solve there. This blobstore is a little different in the sense that it solves that problem for all writers. This comes at the cost of writes being dropped if they're known to be redundant, which prevents updates through this blobstore. This is desirable for most of Mononoke, but not all (notably, for skiplist updates it's not great). For now, I'm going to add this behind an opt-in flag, and later on I'm planning to make it opt-out and turn it off there (I'm thinking to use the CoreContext for this). Reviewed By: farnz Differential Revision: D22285270 fbshipit-source-id: 4e3502ab2da52a3a0e0e471cd9bc4c10b84a3cc5
2020-07-03 15:51:08 +03:00
"blobstore/virtually_sharded_blobstore",
mononoke/blobstore: make multiplexed blobstore OSS buildable Reviewed By: mitrandir77 Differential Revision: D20279770 fbshipit-source-id: b8b8e5dbffe8e5da133da5ede916e277dbfea35f
2020-03-27 21:37:45 +03:00
"blobstore_sync_queue",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"bonsai_git_mapping",
mononoke: cover more crates with OSS buildability that depend on cmdlib crate Reviewed By: krallin Differential Revision: D20735803 fbshipit-source-id: d4159d16384ff795717f6ccdd278b6b4af45d1ab
2020-04-08 13:01:39 +03:00
"bonsai_git_mapping/git_mapping_pushrebase_hook",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"bonsai_globalrev_mapping",
mononoke: cover more crates with OSS buildability that depend on cmdlib crate Reviewed By: krallin Differential Revision: D20735803 fbshipit-source-id: d4159d16384ff795717f6ccdd278b6b4af45d1ab
2020-04-08 13:01:39 +03:00
"bonsai_globalrev_mapping/globalrev_pushrebase_hook",
mononoke/bonsai_globalrev_mapping: add caching Summary: Like it says in the title, this adds a caching layer around Globalrevs using our existing `GetOrFillMultipleFromCacheLayers` abstraction. Note: I've opted to not track dedicated metrics for this (compare to the hg mapping to see them), since I don't believe we really ever look at them. I'd like to do a little bit of refactoring of `GetOrFillMultipleFromCacheLayers` to a) track them without having to ad-hoc code it, b) convert it 0.3 futures, and c) require less ceremony to call it. However, I'll do so in another diff. Reviewed By: StanislavGlebik Differential Revision: D25334478 fbshipit-source-id: 1385298b8fdf1cd081b6e509c6c3e03b3abbfa5b
2020-12-07 19:21:28 +03:00
"bonsai_globalrev_mapping/if",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"bonsai_hg_mapping",
"bonsai_hg_mapping/if",
"bookmarks",
bookmarks_movement: refactor scratch bookmark movement Summary: Refactor control of movement of scratch bookmarks to a new `bookmark_movement` crate that will contain all bookmark movement controls. Reviewed By: krallin Differential Revision: D22844830 fbshipit-source-id: 56d25ad45a9328eaa079c13466b4b802f033d1dd
2020-08-14 12:26:47 +03:00
"bookmarks/bookmarks_movement",
mononoke: make metaconfig OSS buildable Summary: This diff makes it possible to relay on the thrift structures from configerator in OSS. Reviewed By: ahornby Differential Revision: D20279457 fbshipit-source-id: 39df1c7a6f78b10a0a5bdeeebe476249ab674cc8
2020-03-27 18:09:08 +03:00
"bookmarks/bookmarks_types",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"bookmarks/dbbookmarks",
mononoke: cover more crates with OSS buildability that depend on cmdlib crate Reviewed By: krallin Differential Revision: D20735803 fbshipit-source-id: d4159d16384ff795717f6ccdd278b6b4af45d1ab
2020-04-08 13:01:39 +03:00
"bookmarks/warm_bookmarks_cache",
mononoke: move fetch_all_public_changesets to the bulkops crate Summary: I want to reuse the functionality provided by `fetch_all_public_changesets` in building Segmented Changelog. To share the code I am adding a new crate intended to store utilities in dealing with bulk fetches. Reviewed By: krallin Differential Revision: D21471477 fbshipit-source-id: 609907c95b438504d3a0dee64ab5a8b8b3ab3f24
2020-05-14 02:51:05 +03:00
"bulkops",
mononoke: add bulkops benchmark Summary: Add a benchmark tool for bulkops that uses the criterion benchmarking framework. This is so we can measure effect of optimizations later in stack. Differential Revision: D25804026 fbshipit-source-id: 71b8addf1145c0ecb69d6392b4602172f2b52080
2021-01-11 21:53:52 +03:00
"bulkops/bench",
mononoke/server: make the main mononoke binary OSS buildable Summary: Covering repo_listener and microwave plus some final touch and we have a buildable Mononoke binary. Reviewed By: krallin Differential Revision: D21379008 fbshipit-source-id: cca3fbb53b90ce6d2c3f3ced7717404d6b04dd51
2020-05-06 16:08:02 +03:00
"cache_warmup",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"changesets",
"changesets/if",
mononoke: make cmdlib OSS buildable Summary: Some methods that were unused or barely used outside of the cmdlib crate were made non-public (parse_caching, CachelibSettings, init_cachelib_from_settings). Reviewed By: krallin Differential Revision: D20671251 fbshipit-source-id: 232e786fa5af5af543239aca939cb15ca2d6bc10
2020-04-08 13:01:39 +03:00
"cmdlib",
mononoke: cover more crates with OSS buildability that depend on cmdlib crate Reviewed By: krallin Differential Revision: D20735803 fbshipit-source-id: d4159d16384ff795717f6ccdd278b6b4af45d1ab
2020-04-08 13:01:39 +03:00
"cmdlib/x_repo",
backsyncer: move under commit_rewriting Summary: Same as a previous diff. Let's keep the top-level dir tidy. Reviewed By: krallin Differential Revision: D22691638 fbshipit-source-id: 7f9a21f307efd9bbe37f515f475409c89b99cd31
2020-07-23 16:20:54 +03:00
"commit_rewriting/backsyncer",
mononoke: cover more crates with OSS buildability that depend on cmdlib crate Reviewed By: krallin Differential Revision: D20735803 fbshipit-source-id: d4159d16384ff795717f6ccdd278b6b4af45d1ab
2020-04-08 13:01:39 +03:00
"commit_rewriting/bookmark_renaming",
mononoke/mononoke_x_repo_sync_job: make mononoke_x_repo_sync_job and related public (#40) Summary: Pull Request resolved: https://github.com/facebookexperimental/eden/pull/40 Those tools are being used in some integration tests, make them public so that the tests might pass Reviewed By: ikostia Differential Revision: D22844813 fbshipit-source-id: 7b7f379c31a5b630c6ed48215e2791319e1c48d9
2020-07-31 18:57:13 +03:00
"commit_rewriting/bookmarks_validator",
"commit_rewriting/commit_validator",
mononoke: cover more crates with OSS buildability that depend on cmdlib crate Reviewed By: krallin Differential Revision: D20735803 fbshipit-source-id: d4159d16384ff795717f6ccdd278b6b4af45d1ab
2020-04-08 13:01:39 +03:00
"commit_rewriting/cross_repo_sync",
"commit_rewriting/cross_repo_sync/test_utils",
commmit_rewriting: introduce live_commit_sync_config Summary: `LiveCommitSyncConfig` is intended to be a fundamental struct, on which live push-redirection and commit sync config for push-redurector, x-repo sync job, backsyncer, commit and bookmark validators are based. The struct wraps a few `ConfigStore` handles, which allows it to query latest values every time one of the public methods is called. Callers receive parsed structs/values (`true`/`false` for push redirection config, `CommitSyncConfig` for the rest), which they later need to use to build things like `Mover`, `BookmarkRenamer`, `CommitSyncer`, `CommitRepos` and so on. For now the idea is to rebuild these derived structs every time, but we can later add a memoization layer, if the overhead is going to be large. Reviewed By: StanislavGlebik Differential Revision: D22095975 fbshipit-source-id: 58e1f1d8effe921b0dc264fffa785593ef188665
2020-06-25 13:25:25 +03:00
"commit_rewriting/live_commit_sync_config",
mononoke/megarepotool: make megarepotool public (#38) Summary: Pull Request resolved: https://github.com/facebookexperimental/eden/pull/38 The tool is used in some integration tests, make it public so that the tests might pass Reviewed By: ikostia Differential Revision: D22815283 fbshipit-source-id: 76da92afb8f26f61ea4f3fb949044620a57cf5ed
2020-07-30 16:43:23 +03:00
"commit_rewriting/megarepo",
mononoke/mononoke_x_repo_sync_job: make mononoke_x_repo_sync_job and related public (#40) Summary: Pull Request resolved: https://github.com/facebookexperimental/eden/pull/40 Those tools are being used in some integration tests, make them public so that the tests might pass Reviewed By: ikostia Differential Revision: D22844813 fbshipit-source-id: 7b7f379c31a5b630c6ed48215e2791319e1c48d9
2020-07-31 18:57:13 +03:00
"commit_rewriting/mononoke_x_repo_sync_job",
mononoke: cover more crates with OSS buildability that depend on cmdlib crate Reviewed By: krallin Differential Revision: D20735803 fbshipit-source-id: d4159d16384ff795717f6ccdd278b6b4af45d1ab
2020-04-08 13:01:39 +03:00
"commit_rewriting/movers",
"commit_rewriting/synced_commit_mapping",
mononoke: reverse autocargo include list to excludes Summary: Cover as much as remining code with `Cargo.toml`s, for the rest create an exlusion list in the autocargo config. Reviewed By: krallin Differential Revision: D21383620 fbshipit-source-id: 64cc78a38ce0ec482966f32a2963ab4939e20eba
2020-05-06 18:40:41 +03:00
"common/allocation_tracing",
blobstore: cover more blobstores to make them OSS buildable Reviewed By: farnz Differential Revision: D20221288 fbshipit-source-id: 708be6d429e673dcb4201b88541dff2bf9fca153
2020-03-06 12:28:21 +03:00
"common/async_limiter",
"common/async_limiter/examples/tokio_v2",
mononoke/fastlog: asyncify part of ops Summary: Asyncified main functions of the fastlog/ops, so it'd be easier to modify them and proceed with the new features. Reviewed By: StanislavGlebik Differential Revision: D20801028 fbshipit-source-id: 2a03eedca776c6e1048a72c7bd613a6ef38c5c17
2020-04-07 17:05:41 +03:00
"common/bounded_traversal",
mononoke: move functions from rsync admin to copy_utils Summary: I plan to use these functions in the megarepotool, so let's move them to a library that can be used in both. Reviewed By: krallin Differential Revision: D26015773 fbshipit-source-id: 0d2d28d86471c417508494883b69fb64e1bea328
2021-01-27 13:44:40 +03:00
"common/copy_utils",
mononoke: reverse autocargo include list to excludes Summary: Cover as much as remining code with `Cargo.toml`s, for the rest create an exlusion list in the autocargo config. Reviewed By: krallin Differential Revision: D21383620 fbshipit-source-id: 64cc78a38ce0ec482966f32a2963ab4939e20eba
2020-05-06 18:40:41 +03:00
"common/dedupmap",
mononoke: add futures_watchdog, a crate to help find stalls Summary: Like it says in the title. This adds a crate that provides a combinator that lets us easily find stalls caused by futures that stay in `poll()` for too long. The goal is to make this minimal overhead for whoever is using it: all you need is to import it + give it a logger. It automatically looks up the line where it's called and gives it back to you in logs. This uses the `track_caller` functionality to make this work. Reviewed By: farnz Differential Revision: D26250068 fbshipit-source-id: a1458e5adebac7eab6c2de458f679c7215147937
2021-02-04 21:37:01 +03:00
"common/futures_watchdog",
common: add iterhelpers Summary: This just adds a single fn. I did not come up with a better place/name to put it, suggestions are welcome. Seems generic enough to belong at the top-level common location. I've already needed this twice, so decided to extract. Second callsite will be further in the stack. Reviewed By: StanislavGlebik Differential Revision: D24080193 fbshipit-source-id: c3e0646f263562f3eed93f1fdbab9a076729f33c
2020-10-05 09:49:34 +03:00
"common/iterhelpers",
mononoke: make newfilenodes and blobstore/factory OSS buildable Summary: In the process the blobstore/factory/lib.rs was split into submodules - this way it was easier to untangle the dependencies and refactor it, so I've left the split in this diff. Reviewed By: markbt Differential Revision: D20302068 fbshipit-source-id: caa3a2b5487c30198c62f7e4f4e9cb7c488dc8de
2020-03-31 13:56:11 +03:00
"common/rust/caching_ext",
mononoke/server: make the main mononoke binary OSS buildable Summary: Covering repo_listener and microwave plus some final touch and we have a buildable Mononoke binary. Reviewed By: krallin Differential Revision: D21379008 fbshipit-source-id: cca3fbb53b90ce6d2c3f3ced7717404d6b04dd51
2020-05-06 16:08:02 +03:00
"common/rust/slog_ext",
mononoke: make sql_ext OSS buildable Summary: separate out the Facebook-specific pieces of the sql_ext crate Reviewed By: ahornby Differential Revision: D20218219 fbshipit-source-id: e933c7402b31fcd5c4af78d5e70adafd67e91ecd
2020-03-06 12:28:21 +03:00
"common/rust/sql_ext",
mononoke: add Scribe Summary: At the moment we can't test logging to scribe easily - we don't have a way to mock it. Scribe are supposed to help with that. They will let us to configure all scribe logs to go to a directory on a filesystem similar to the way we configure scuba. The Scribe itself will be stored in CoreContext Reviewed By: farnz Differential Revision: D22237730 fbshipit-source-id: 144340bcfb1babc3577026191428df48e30a0bb6
2020-06-29 22:05:40 +03:00
"common/scribe_ext",
mononoke: move facebook/scuba_ext to common/scuba_ext Summary: common/sql_ext will now be buildable in OSS Reviewed By: krallin Differential Revision: D19876764 fbshipit-source-id: 0f51abd1169f6b8108e7e4cab85b5f193c28e2cd
2020-02-14 12:24:14 +03:00
"common/scuba_ext",
sql_construct: add crate for constructing sql data managers Summary: Refactor `sql_ext::SqlConstructors` and its related traits into a separate crate. The new `SqlConstruct` trait is joined by `SqlShardedConstruct` which allows construction of sharded databases. The new crate will support a new configuration model where the distinction between the database configuration for different repository metadata types will be made clear. Reviewed By: StanislavGlebik Differential Revision: D20734882 fbshipit-source-id: b44cf9d1efd014c29df88e2ad933025e440119dc
2020-04-02 15:24:53 +03:00
"common/sql_construct",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"common/topo_sort",
make it possible to store arbitrary type in blobrepo with dependency on it Summary: This diff adds additional filed `BlobRepo::attributes` which can store attributes of arbitrary type. This will help store opaque types inside blobrepo without creating dependency on a crate which contains type definition for this attribute. This diff also moves `BonsaiHgMapping` inside attributes set. - This work will allow to move mercurial changeset generation logic to derive data infrastructure Reviewed By: ikostia Differential Revision: D21640438 fbshipit-source-id: 3abd912e7227738a73ea9b17aabdda72a33059aa
2020-06-22 17:20:47 +03:00
"common/type_map",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"common/uniqueheap",
"derived_data",
"derived_data/blame",
"derived_data/changeset_info",
"derived_data/changeset_info/if",
"derived_data/deleted_files_manifest",
"derived_data/fastlog",
"derived_data/filenodes",
"derived_data/fsnodes",
"derived_data/mercurial_derived_data",
skeleton_manifest: implement skeleton manifest derivation Summary: Implement derivation of skeleton manifests. Differential Revision: D24787534 fbshipit-source-id: e55d053a717fe052fc4da69bd9034784b356b7cc
2020-11-12 00:21:42 +03:00
"derived_data/skeleton_manifest",
derived_data_test_utils: move test_utils to derived_data and update to new futures Summary: `manifest/test_utils` contains test utilities that are only used by derived data, and only one of which relates to manifests. Its name (`test_utils`) is also confusing with `tests/utils`. Move it to `derived_data_test_utils`, and update it to new futures. Reviewed By: mitrandir77 Differential Revision: D24787536 fbshipit-source-id: 7a4a735132ccf81e3f75683c7f44c9ada11bc9d7
2020-11-09 17:45:40 +03:00
"derived_data/test_utils",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"derived_data/unodes",
"derived_data/utils",
mononoke: replace direct usages of ServiceData by dynamic singleton counters Summary: The replacement will make lfs_server, mononoke_api, edenapi_server and walker OSS buildable. Reviewed By: krallin Differential Revision: D21884324 fbshipit-source-id: e6cdf8356b13056a9944ab9da18dc15977b6a2ec
2020-06-05 16:21:37 +03:00
"edenapi_server",
mononoke/edenapi_server: split edenapi into 2 crates Summary: Like it says in the title, this splits edenapi_server into 2 crates. Most of the logic here is pretty straightforward: - edenapi_service creates a Gotham handler - edenapi_server instantiates the handler and sets up a socket, tls, etc. Reviewed By: ahornby Differential Revision: D26108439 fbshipit-source-id: 6a79e9767ba891265bca11f78eb1a6d3a61ee21f
2021-02-04 21:37:01 +03:00
"edenapi_service",
mononoke: reverse autocargo include list to excludes Summary: Cover as much as remining code with `Cargo.toml`s, for the rest create an exlusion list in the autocargo config. Reviewed By: krallin Differential Revision: D21383620 fbshipit-source-id: 64cc78a38ce0ec482966f32a2963ab4939e20eba
2020-05-06 18:40:41 +03:00
"fastreplay",
mononoke: make filenode and mercurial_types OSS buildable Reviewed By: farnz Differential Revision: D20281345 fbshipit-source-id: bc4910d3040d74c7ceb4cb825bea6960952f6310
2020-03-27 21:37:45 +03:00
"filenodes",
"filenodes/if",
"filestore",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"git/git_types",
"git/git_types/if",
mononoke: reverse autocargo include list to excludes Summary: Cover as much as remining code with `Cargo.toml`s, for the rest create an exlusion list in the autocargo config. Reviewed By: krallin Differential Revision: D21383620 fbshipit-source-id: 64cc78a38ce0ec482966f32a2963ab4939e20eba
2020-05-06 18:40:41 +03:00
"git/gitimport",
mononoke/git: moved gitimport objects to import_tools Summary: Moved GitimportPreferences and GitimportTarget objects from gitimport to import_tools. Reasoning: will need to move gitimport function which needs these objects. Since it's a rust_binary, we can't add dependency on it in import_tools. Therefore, I moved the objects to import_tools. Reviewed By: StanislavGlebik Differential Revision: D22135765 fbshipit-source-id: f31f96e689dccaac171a9d0573019b1fff757885
2020-06-19 17:11:47 +03:00
"git/import_tools",
mononoke: add Cargo.toml files for code previously depending on identity_ext Reviewed By: farnz Differential Revision: D21864833 fbshipit-source-id: 782175af73f5937534566c99e6dc1e7fcf319f6c
2020-06-11 04:08:35 +03:00
"gotham_ext",
"hgcli",
mononoke/repo_client: make repo_client buildable in OSS Summary: There are few related changes included in this diff: - backsyncer is made public - stubs for SessionContext::is_quicksand and scuba_ext::ScribeClientImplementation - mononoke/hgproto is made buildable Reviewed By: krallin Differential Revision: D21330608 fbshipit-source-id: bf0a3c6f930cbbab28508e680a8ed7a0f10031e5
2020-05-06 16:08:02 +03:00
"hgproto",
mononoke: reverse autocargo include list to excludes Summary: Cover as much as remining code with `Cargo.toml`s, for the rest create an exlusion list in the autocargo config. Reviewed By: krallin Differential Revision: D21383620 fbshipit-source-id: 64cc78a38ce0ec482966f32a2963ab4939e20eba
2020-05-06 18:40:41 +03:00
"hook_tailer",
mononoke/permission_checker: introduce MembershipChecker and its first usage in hooks Summary: The new MembershipChecker and PermissionChecker traits will generalize access to various permission/acl systems (like LDAP) and leave the implementation details hidden behind an object trait. Reviewed By: StanislavGlebik Differential Revision: D21067811 fbshipit-source-id: 3bccd931f8acdb6c1e0cff4cb71917c9711b590b
2020-04-23 13:41:09 +03:00
"hooks",
"hooks/content-stores",
hook_manager_factory: extract construction of the hook manager Summary: Extract construction of the hook manager to its own crate, so that we can re-use it. Eventually the hook manager will become a repo attribute and will be constructed by the repo attribute factory, but for now it needs its own factory method. Differential Revision: D23129407 fbshipit-source-id: 302fde4d1ae38c6f61032a32c880018ebf84dee2
2020-08-17 19:07:36 +03:00
"hooks/hook_manager_factory",
mononoke: reverse autocargo include list to excludes Summary: Cover as much as remining code with `Cargo.toml`s, for the rest create an exlusion list in the autocargo config. Reviewed By: krallin Differential Revision: D21383620 fbshipit-source-id: 64cc78a38ce0ec482966f32a2963ab4939e20eba
2020-05-06 18:40:41 +03:00
"lfs_import_lib",
autocargo: Strip line comments Summary: These comments end up being a source of churn as we roll out D20125635, and anyway are not particularly meaningful after the transformations performed by autocargo. For example: ``` bytes = { version = "0.4", features = ["serde"] } # todo: remove ``` ^ This doesn't mean the generated Cargo.toml intends to drop its bytes dependency altogether, but just that will be migrated to a different version that is present in the third-party/rust/Cargo.toml but not visible in the generated Cargo.toml. Reviewed By: jsgf Differential Revision: D20128612 fbshipit-source-id: a9e7b29ddc4b26bc47a626dd73bdaa4771ee7b18
2020-02-27 03:28:20 +03:00
"lfs_protocol",
mononoke: replace direct usages of ServiceData by dynamic singleton counters Summary: The replacement will make lfs_server, mononoke_api, edenapi_server and walker OSS buildable. Reviewed By: krallin Differential Revision: D21884324 fbshipit-source-id: e6cdf8356b13056a9944ab9da18dc15977b6a2ec
2020-06-05 16:21:37 +03:00
"lfs_server",
mononoke/load_limiter: use trait objects to represent load_limiter Summary: Making a trait out of LoadLimiter will help with providing different implementations of load limiting for OSS and FB. Reviewed By: farnz Differential Revision: D21302819 fbshipit-source-id: 1b982a367aa7126ca5d7772e4a2406dabbe9e13b
2020-05-04 14:31:52 +03:00
"load_limiter",
mononoke: make filenode and mercurial_types OSS buildable Reviewed By: farnz Differential Revision: D20281345 fbshipit-source-id: bc4910d3040d74c7ceb4cb825bea6960952f6310
2020-03-27 21:37:45 +03:00
"manifest",
bookmarks: extract BundleReplayData from BookmarkUpdateReason Summary: Separate out the `BundleReplayData` from the `BookmarkUpdateReason` enum. There's no real need for this to be part of the reason, and removing it means we can abstract away the remaining dependency on Mercurial changeset IDs from the main bookmarks traits. Reviewed By: mitrandir77, ikostia Differential Revision: D22417659 fbshipit-source-id: c8e5af7ba57d10a90c86437b59c0d48e587e730e
2020-07-10 14:44:58 +03:00
"mercurial/bundle_replay_data",
eden/scm: split revisionstore into types and rest of logic Summary: The revisionstore is a large crate with many dependencies, split out the types part which is most likely to be shared between different pieces of eden/mononoke infrastructure. With this split it was easy to get eden/mononoke/mercurial/bundles Reviewed By: farnz Differential Revision: D20869220 fbshipit-source-id: e9ee4144e7f6250af44802e43221a5b6521d965d
2020-04-14 17:46:18 +03:00
"mercurial/bundles",
mutationstore: a store for commit mutation information Summary: Add the Mononoke Mercurial mutation store. This stores mutation information for draft commits so that it can be shared between clients. The mutation entries themselves are stored in a database, and the mutation store provides abstractions for adding and querying them. This commit adds the `all_predecessors` method to the mutation store, which allows Mononoke to fetch all predecessors for a given set of commits. This will be used to serve mutation information to clients who are pulling draft commits. Reviewed By: krallin Differential Revision: D20287381 fbshipit-source-id: b4455514cb8a22bef2b9bf0229db87c2a0404448
2020-04-23 18:55:55 +03:00
"mercurial/mutation",
mononoke/mercurial: make revlog crate OSS buildable Reviewed By: krallin Differential Revision: D20869309 fbshipit-source-id: bc234b6cfcb575a5dabdf154969db7577ebdb5c5
2020-04-08 19:46:16 +03:00
"mercurial/revlog",
mononoke: make filenode and mercurial_types OSS buildable Reviewed By: farnz Differential Revision: D20281345 fbshipit-source-id: bc4910d3040d74c7ceb4cb825bea6960952f6310
2020-03-27 21:37:45 +03:00
"mercurial/types",
"mercurial/types/if",
"mercurial/types/mocks",
mononoke: remove direct usages of common/rust/configerator Summary: It is preferable to use the higher-level API of cached_config instead of ConfigeratorAPI whenever possible since the higher-level API supports OSS builds. For `ConfigStore` let `poll_interval` be None so that for one-off reading of configs the ConfigStore doesn't needlessly spawn an updating thread. Also this update is with compliance to the discussion in D19026190. Reviewed By: ahornby Differential Revision: D20670224 fbshipit-source-id: 24fc124d440fd458a9fa88a906fc3a1cfdbd827e
2020-03-31 13:56:11 +03:00
"metaconfig/parser",
mononoke: make metaconfig OSS buildable Summary: This diff makes it possible to relay on the thrift structures from configerator in OSS. Reviewed By: ahornby Differential Revision: D20279457 fbshipit-source-id: 39df1c7a6f78b10a0a5bdeeebe476249ab674cc8
2020-03-27 18:09:08 +03:00
"metaconfig/types",
mononoke/server: make the main mononoke binary OSS buildable Summary: Covering repo_listener and microwave plus some final touch and we have a buildable Mononoke binary. Reviewed By: krallin Differential Revision: D21379008 fbshipit-source-id: cca3fbb53b90ce6d2c3f3ced7717404d6b04dd51
2020-05-06 16:08:02 +03:00
"microwave",
"microwave/builder",
"microwave/if",
mononoke: replace direct usages of ServiceData by dynamic singleton counters Summary: The replacement will make lfs_server, mononoke_api, edenapi_server and walker OSS buildable. Reviewed By: krallin Differential Revision: D21884324 fbshipit-source-id: e6cdf8356b13056a9944ab9da18dc15977b6a2ec
2020-06-05 16:21:37 +03:00
"mononoke_api",
mononoke/mononoke_api: split hg parts into mononoke_api_hg Summary: I'd like to be able to use mononoke_api from repo_client, but the hg parts depend on repo_client, so that's a circular dependency. This splits out the hg parts of Mononoke API so that places that don't want them don't have to import them. This is similar to what we did with blobrepo. Reviewed By: StanislavGlebik Differential Revision: D26099495 fbshipit-source-id: 73a9c7b5dc95feceb35b5eabccf697e9aa0a27de
2021-02-01 18:49:57 +03:00
"mononoke_api_hg",
mononoke/hg_sync_job: make mononoke_hg_sync_job public (#37) Summary: Pull Request resolved: https://github.com/facebookexperimental/eden/pull/37 mononoke_hg_sync_job is used in integration tests, make it public Reviewed By: krallin Differential Revision: D22795881 fbshipit-source-id: 7a32c8e8adf723a49922dbb9e7723ab01c011e60
2020-07-30 12:43:24 +03:00
"mononoke_hg_sync_job",
mononoke: make mononoke_types OSS-buildable Summary: (Note: this ignores all push blocking failures!) Reviewed By: farnz Differential Revision: D19948740 fbshipit-source-id: 9d0cfc4ccbcb3c08bb969f23229ed3096470fa86
2020-02-24 16:19:52 +03:00
"mononoke_types",
"mononoke_types/if",
"mononoke_types/mocks",
mononoke: cover more crates with OSS buildability that depend on cmdlib crate Reviewed By: krallin Differential Revision: D20735803 fbshipit-source-id: d4159d16384ff795717f6ccdd278b6b4af45d1ab
2020-04-08 13:01:39 +03:00
"mutable_counters",
mononoke: make newfilenodes and blobstore/factory OSS buildable Summary: In the process the blobstore/factory/lib.rs was split into submodules - this way it was easier to untangle the dependencies and refactor it, so I've left the split in this diff. Reviewed By: markbt Differential Revision: D20302068 fbshipit-source-id: caa3a2b5487c30198c62f7e4f4e9cb7c488dc8de
2020-03-31 13:56:11 +03:00
"newfilenodes",
observability: introduce ObservabilityContext Summary: `ObservabilityContext` is a structure that helps logging facilities within Mononoke to make logging decisions. Specifically, the upcoming `DynamicLoggingDrain` and already existing `MononokeScubaSampleBuilder` will have this structure as a component and decide whether a particular logging statement (slog or scuba) should go ahead. Internally, `ObservabilityContext` is a wrapper around data received from a [configerator endpoint](https://www.internalfb.com/intern/configerator/edit/?path=scm%2Fmononoke%2Fobservability%2Fobservability_config.cconf). This diff makes a few unobvious decisions about how this is organized. My goals were: 1. to have production (i.e. reading from configerator), static (i.e. emulating current prod behavior) and test variants of `ObservabilityContext` 1. to avoid having consumers know which of these variants are used 1. to avoid making all consumers of `ObservabilityContext` necessarily generic 1. to avoid using dynamic dispatch of `ObservabilityContext`'s methods Points 3 and 4 mean that `ObservabilityContext` cannot be a trait. `enum` is a common solution in such cases. However, if `ObservabilityContext` is an `enum`, consumers will know which variant they are using (because `enum` variants are public). So the solution is to use a private enum wrapped in a struct. Reviewed By: mitrandir77 Differential Revision: D25287759 fbshipit-source-id: da034c71570137e8a8fb7749b1e4ad43be482f66
2020-12-05 01:25:24 +03:00
"observability",
mononoke/permission_checker: introduce MembershipChecker and its first usage in hooks Summary: The new MembershipChecker and PermissionChecker traits will generalize access to various permission/acl systems (like LDAP) and leave the implementation details hidden behind an object trait. Reviewed By: StanislavGlebik Differential Revision: D21067811 fbshipit-source-id: 3bccd931f8acdb6c1e0cff4cb71917c9711b590b
2020-04-23 13:41:09 +03:00
"permission_checker",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"phases",
mononoke: cover more crates with OSS buildability that depend on cmdlib crate Reviewed By: krallin Differential Revision: D20735803 fbshipit-source-id: d4159d16384ff795717f6ccdd278b6b4af45d1ab
2020-04-08 13:01:39 +03:00
"pushrebase",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"reachabilityindex",
"reachabilityindex/common",
"reachabilityindex/if",
"reachabilityindex/skiplist",
"reachabilityindex/test-helpers",
mononoke/regenerate_hg_filenodes: make regenerate_hg_filenodes public (#39) Summary: Pull Request resolved: https://github.com/facebookexperimental/eden/pull/39 Reviewed By: krallin Differential Revision: D22816308 fbshipit-source-id: e64b2b5f5b319814265fdb0129f2bce6b1a72a98
2020-07-30 16:43:23 +03:00
"regenerate_hg_filenodes",
mononoke/repo_client: make repo_client buildable in OSS Summary: There are few related changes included in this diff: - backsyncer is made public - stubs for SessionContext::is_quicksand and scuba_ext::ScribeClientImplementation - mononoke/hgproto is made buildable Reviewed By: krallin Differential Revision: D21330608 fbshipit-source-id: bf0a3c6f930cbbab28508e680a8ed7a0f10031e5
2020-05-06 16:08:02 +03:00
"repo_client",
"repo_client/getbundle_response",
"repo_client/mononoke_repo",
"repo_client/obsolete",
"repo_client/remotefilelog",
"repo_client/repo_read_write_status",
unbundle: save infinitepush unbundles into reversefillerqueue Summary: We want to be able to record all the bundles Mononoke processes to be later replayed by Mercurail. Reviewed By: krallin Differential Revision: D21427622 fbshipit-source-id: b88e10e03d07dae35369286fe31022f36a1ee5cf
2020-05-07 15:09:54 +03:00
"repo_client/reverse_filler_queue",
mononoke/repo_client: make repo_client buildable in OSS Summary: There are few related changes included in this diff: - backsyncer is made public - stubs for SessionContext::is_quicksand and scuba_ext::ScribeClientImplementation - mononoke/hgproto is made buildable Reviewed By: krallin Differential Revision: D21330608 fbshipit-source-id: bf0a3c6f930cbbab28508e680a8ed7a0f10031e5
2020-05-06 16:08:02 +03:00
"repo_client/scribe_commit_queue",
"repo_client/streaming_clone",
"repo_client/unbundle",
"repo_client/wirepack",
mononoke/repo_import: created initial main and target files Summary: Added basic main and target files for the repo import tool Reviewed By: StanislavGlebik Differential Revision: D22067642 fbshipit-source-id: 5ed97e3f2446c86314918f57103c2ecb911e30b0
2020-06-17 13:20:13 +03:00
"repo_import",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"revset",
"revset/revset-test-helper",
mononoke: make segmented_changelog OSS buildable Reviewed By: krallin Differential Revision: D21980974 fbshipit-source-id: 60e8f0e78b2bd654e5109b39c85f08ee5b3e9490
2020-06-12 16:52:36 +03:00
"segmented_changelog",
mononoke/server: make the main mononoke binary OSS buildable Summary: Covering repo_listener and microwave plus some final touch and we have a buildable Mononoke binary. Reviewed By: krallin Differential Revision: D21379008 fbshipit-source-id: cca3fbb53b90ce6d2c3f3ced7717404d6b04dd51
2020-05-06 16:08:02 +03:00
"server",
mononoke: make blobstore OSS-buildable Summary: Adds the Cargo.toml files for blobstore, this is a step towards covering mononoke-types, so only the blobstore traits are covered by this diff. Reviewed By: aslpavel Differential Revision: D19948739 fbshipit-source-id: c945a9ca16ccceb0e50a50d941dec65ea74fe78f
2020-02-19 16:13:31 +03:00
"server/context",
mononoke/server: make the main mononoke binary OSS buildable Summary: Covering repo_listener and microwave plus some final touch and we have a buildable Mononoke binary. Reviewed By: krallin Differential Revision: D21379008 fbshipit-source-id: cca3fbb53b90ce6d2c3f3ced7717404d6b04dd51
2020-05-06 16:08:02 +03:00
"server/monitoring",
"server/repo_listener",
mononoke: add README.md and the missing pieces for supporting cargo (#13) Summary: Take the README.md from https://github.com/facebookexperimental/mononoke/blob/7ead0e29e41aec0771531a4650b6170bc1ff6566/README.md and apply it on Eden repo. Re-add the Cargo.toml file that declares Cargo workspace. Re-add fbcode_builder/getdeps manifest for Mononoke Pull Request resolved: https://github.com/facebookexperimental/eden/pull/13 Test Plan: ./build/fbcode_builder/getdeps.py build mononoke ./build/fbcode_builder/getdeps.py test mononoke Reviewed By: ahornby Differential Revision: D19833059 Pulled By: lukaspiatkowski fbshipit-source-id: fb37e13306c0b9969a7c4e52b05e1a66a577022f
2020-02-13 11:11:03 +03:00
"server/session_id",
"sshrelay",
mononoke: make blobrepo and its dependencies OSS buildable Reviewed By: markbt Differential Revision: D20495840 fbshipit-source-id: 3bbefae1923dc84e3daea158a24c0d2a802cc9a9
2020-03-31 13:56:11 +03:00
"tests/fixtures",
"tests/utils",
mononoke: reverse autocargo include list to excludes Summary: Cover as much as remining code with `Cargo.toml`s, for the rest create an exlusion list in the autocargo config. Reviewed By: krallin Differential Revision: D21383620 fbshipit-source-id: 64cc78a38ce0ec482966f32a2963ab4939e20eba
2020-05-06 18:40:41 +03:00
"tests/write_stub_log_entry",
mononoke/time_window_counter: use trait objects to represent time_window_counter Summary: Making a trait out of TimeWindowCounter will help with providing different implementations of load limiting for OSS and FB. Reviewed By: krallin Differential Revision: D21329265 fbshipit-source-id: 7f317f8e9118493f3dcbadb0519eaff565cbd882
2020-05-05 18:00:18 +03:00
"time_window_counter",
mononoke: Add tunables - a simple form of config hot reloading Summary: Currently, Mononoke's configs are loaded at startup and only refreshed during restart. There are some exceptions to this, including throttling limits. Other Mononoke services (such as the LFS server) have their own implementations of hot reloadable configs, however there isn't a universally agreed upon method. Static configs makes it hard to roll out features gradually and safely. If a bad config option is enabled, it can't be rectified until the entire tier is restarted. However, Mononoke's code is structured with static configs in mind and doesn't support hot reloading. Changing this would require a lot of work (imagine trying to swap out blobstore configs during run time) and wouldn't necessarily provide much benefit. Instead, add a subset of hot reloadable configs called tunables. Tunables are accessible from anywhere in the code and are cheap to read as they only require reading an atomic value. This means that they can be used even in hot code paths. Currently tunables support reloading boolean values and i64s. In the future, I'd like to expand tunables to include more functionality, such as a rollout percentage. The `--tunables-config` flag points to a configerator spec that exports a Tunables thrift struct. This allows differents tiers and Mononoke services to have their own tunables. If this isn't provided, `MononokeTunables::default()` will be used. This diff adds a proc_macro that will generate the relevant `get` and `update` methods for the fields added to a struct which derives `Tunables`. This struct is then stored in a `once_cell` and can be accessed using `tunables::tunables()`. To add a new tunable, add a field to the `MononokeTunables` struct that is of type `AtomicBool` or `AtomicI64`. Update the relevant tunables configerator config to include your new field, with the exact same name. Removing a tunable from `MononokeTunables` is fine, as is removing a tunable from configerator. If the `--tunables-config` path isn't passed, then a default tunables config located at `scm/mononoke/tunables/default` will be loaded. There is also the `--disable-tunables` flag that won't load anything from configerator, it will instead use the `Tunable` struct's `default()` method to initialise it. This is useful in integration tests. Reviewed By: StanislavGlebik Differential Revision: D21177252 fbshipit-source-id: 02a93c1ceee99066019b23d81ea308e4c565d371
2020-05-01 02:06:10 +03:00
"tunables",
"tunables/tunables-derive",
mononoke: reverse autocargo include list to excludes Summary: Cover as much as remining code with `Cargo.toml`s, for the rest create an exlusion list in the autocargo config. Reviewed By: krallin Differential Revision: D21383620 fbshipit-source-id: 64cc78a38ce0ec482966f32a2963ab4939e20eba
2020-05-06 18:40:41 +03:00
"unbundle_replay",
mononoke: replace direct usages of ServiceData by dynamic singleton counters Summary: The replacement will make lfs_server, mononoke_api, edenapi_server and walker OSS buildable. Reviewed By: krallin Differential Revision: D21884324 fbshipit-source-id: e6cdf8356b13056a9944ab9da18dc15977b6a2ec
2020-06-05 16:21:37 +03:00
"walker",
mononoke: add README.md and the missing pieces for supporting cargo (#13) Summary: Take the README.md from https://github.com/facebookexperimental/mononoke/blob/7ead0e29e41aec0771531a4650b6170bc1ff6566/README.md and apply it on Eden repo. Re-add the Cargo.toml file that declares Cargo workspace. Re-add fbcode_builder/getdeps manifest for Mononoke Pull Request resolved: https://github.com/facebookexperimental/eden/pull/13 Test Plan: ./build/fbcode_builder/getdeps.py build mononoke ./build/fbcode_builder/getdeps.py test mononoke Reviewed By: ahornby Differential Revision: D19833059 Pulled By: lukaspiatkowski fbshipit-source-id: fb37e13306c0b9969a7c4e52b05e1a66a577022f
2020-02-13 11:11:03 +03:00
]
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[patch.crates-io]
mononoke_types: remove dependency on old_futures Summary: Just removing unused dependencies Reviewed By: ahornby Differential Revision: D25492832 fbshipit-source-id: 5c9ace2c9a333a4d74239a5d7d8dfb9fbe1c772e
2020-12-11 17:52:26 +03:00
addr2line = { git ="https://github.com/gimli-rs/addr2line.git", rev = "0b6b6018b5b252a18e628fba03885f7d21844b3c" }
mononoke: do not report bookmark validation error if we get an infra error Summary: We got a few ubns because one bookmark validator in a single region wasn't able to connect to mysql and was reporting errors. This diff fixes by separating logical and infra errors Reviewed By: ikostia Differential Revision: D25092364 fbshipit-source-id: 93f4be1a7e0467051b7b8d927eef9b4f5cd6a983
2020-11-19 23:56:30 +03:00
bytecount = { git = "https://github.com/llogiq/bytecount", rev = "469eaf8395c99397cd64d059737a9054aa014088" }
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
chashmap = { git = "https://gitlab.redox-os.org/ahornby/chashmap", rev = "901ace2ca3cdbc2095adb1af111d211e254e2aae" }
const-random = { git = "https://github.com/fbsource/const-random", rev = "374c5b46427fe2ffbf6acbd9c1687e0f1a809f95" }
third-party: rust: update Gotham to 0.5 Summary: This updates Gotham. Under the hood I rebased our fork, you can see the diff here: P161171514. The stuff that is relevant is that Gotham got rid of its dependency on `failure` and now uses `anyhow` instead, and I also added a little bit to our existing socket data patch by making a few things public so that we can get access to a few more internals. Reviewed By: StanislavGlebik Differential Revision: D25850262 fbshipit-source-id: 25ebf5d63be39e3e93208705d91abc5c61c90453
2021-01-11 14:30:42 +03:00
gotham = { git = "https://github.com/krallin/gotham.git", rev = "da0b85605f5bf84988309446ceb87a4b87870334"}
gotham_derive = { git = "https://github.com/krallin/gotham.git", rev = "da0b85605f5bf84988309446ceb87a4b87870334"}
Work around lru-disk-cache UB in Rust 1.48 Summary: `lru-disk-cache` depends on an old version of `linked-hash-map` which contains UB in 1.48 (see https://github.com/mozilla/sccache/issues/813). They updated the deps in their repo months ago, but haven't pushed a new version. This diff makes us get `lru-disk-cache` directly from their GitHub instead. Reviewed By: dtolnay Differential Revision: D25134582 fbshipit-source-id: 05fd63a76b7095ebeea458645b92a83bbd8c4614
2020-11-21 03:58:47 +03:00
lru-disk-cache = { git = "https://github.com/mozilla/sccache", rev = "033ebaae69beeb0ac04e8c35d6ff1103487bd9a3" }
autocargo: regen Summary: Regen autocargo Reviewed By: quark-zju Differential Revision: D25409963 fbshipit-source-id: 7dbbe420aeb30248bf43d3a96a9aa6a47bb2b0be
2020-12-09 05:28:35 +03:00
openssl = { git = "https://github.com/KapJI/rust-openssl", rev = "e0d808e27fec1818b1eecf362f69764ed860aa34" }
openssl-sys = { git = "https://github.com/KapJI/rust-openssl", rev = "e0d808e27fec1818b1eecf362f69764ed860aa34" }
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
prost = { git = "https://github.com/gabrielrussoc/prost", branch = "protoc-runtime" }
prost-build = { git = "https://github.com/gabrielrussoc/prost", branch = "protoc-runtime" }
prost-derive = { git = "https://github.com/gabrielrussoc/prost", branch = "protoc-runtime" }
prost-types = { git = "https://github.com/gabrielrussoc/prost", branch = "protoc-runtime" }
r2d2_sqlite = { git = "https://github.com/jsgf/r2d2-sqlite.git", rev = "6d77a828ca0a3c507a3f58561532a1b6c66c7918" }
rustfilt = { git = "https://github.com/jsgf/rustfilt.git", rev = "8141fa7f1caee562ee8daffb2ddeca3d1f0d36e5" }
third-party/rust: refresh vendored sources Summary: For whatever reason, the metadata and vendored sources do not match the actual upstream sources. I deleted all of third-party/rust/vendor/** and revendored. Notable changes: - libra-crypto and libra-canonical-serialization picked up changes from D25098952 (Nov 2020) D25986058 updated the source location of z3, but didn't update the sources. Unfortunately the updated location seems completely unbuildable, so for now this doesn't update any of z3 until jagill can fix it. Reviewed By: wangbj Differential Revision: D26377549 fbshipit-source-id: d30dbaa7502c82c4b7cd64f8c80ab978a5646271
2021-02-11 17:42:49 +03:00
sshcerts = { git = "https://github.com/diggyk/sshcerts.git", rev = "2d3bc7a7088195b8faf693cc8fbddfb09a8ba9a0" }
rust: update to smallvec 1.6.1 with necessary patch Summary: Vendor update to smallvec 1.6.1, which is a prerequisite for governor crate. Reviewed By: jsgf Differential Revision: D26172450 fbshipit-source-id: 9e87c1ada75b75ac54afd85435cd5422a1c385fa
2021-02-02 12:34:14 +03:00
smallvec = { git = "https://github.com/ahornby/rust-smallvec.git", rev = "708e6f09ced4ed211a7c63f53bce7dfe2bbda478"}
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
tokio-core = { git = "https://github.com/bolinfest/tokio-core", rev = "5f37aa3c627d56ee49154bc851d6930f5ab4398f" }
convert BlobRepoHg to new type futures Summary: Convert all BlobRepoHg methods to new type futures Reviewed By: StanislavGlebik Differential Revision: D25471540 fbshipit-source-id: c8e99509d39d0e081d082097cbd9dbfca431637e
2020-12-17 18:43:34 +03:00
toml = { git = "https://github.com/jsgf/toml-rs", branch = "dotted-table-0.5.7" }
Regen autocargo files Summary: See previous diff Differential Revision: D25858200 fbshipit-source-id: 3745b5c7dac6ee514b05ce130b62b35302916bee
2021-01-12 03:13:13 +03:00
enumset = { git = "https://github.com/danobi/enumset", rev = "4c01c583c27a725948fededbfb3461c572a669a4" }
Fix weird looking highlighted values in below (#8074) Summary: Pull Request resolved: https://github.com/facebookincubator/resctl/pull/8074 1. Upgrade `Cursive` to v0.16.3 2. patch `cursive_buffered_backend` with a temp fork before v0.4.2 is released. This is needed to avoid Rust being confused by `Backend` trait from different versions of `cursive_core` Reviewed By: dschatzberg Differential Revision: D25987535 fbshipit-source-id: 6826653f9b6d4d6bdba485abf42eb517a853acc1
2021-01-26 00:10:17 +03:00
cursive_buffered_backend = { git = "https://github.com/chengxiong-ruan/cursive_buffered_backend", branch = "upgrade_cursive_core_from_v0.4.1"}
Add fields to Cargo.toml's to make crates publishable Summary: This diff adds some basic information. Note I have no idea what most of these crates do so the descriptions are a bit light. I'd appreciate it if people could tell me what the descriptions should be. Or better yet, just put up a diff for it after this one goes in. Reviewed By: lukaspiatkowski Differential Revision: D26031870 fbshipit-source-id: 496f44882b6ed80a4f3834cf0fa3215ab318c930
2021-01-26 21:56:24 +03:00
hyper-02 = { git = "https://github.com/krallin/hyper.git", rev = "e5cc6150ebe82eae6daa3ec61c91296b19200a81", package = "hyper", version = "0.13.9" }
Reference in New Issue Copy Permalink