facebook/sapling
1
1
Fork 0
mirror of https://github.com/facebook/sapling.git synced 2024-10-10 16:57:49 +03:00
Code Issues Projects Releases Wiki Activity
eba01d39e5
sapling/eden/mononoke/Cargo.toml

439 lines
17 KiB
TOML
Raw Normal View History

cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[package]
name = "eden_mononoke"
version = "0.1.0"
autocargo v1: changes to match autocargo v2 generation results. Summary: The changes (and fixes) needed were: - Ignore rules that are not rust_library or thrift_library (previously only ignore rust_bindgen_library, so that binary and test dependencies were incorrectly added to Cargo.toml) - Thrift package name to match escaping logic of `tools/build_defs/fbcode_macros/build_defs/lib/thrift/rust.bzl` - Rearrange some attributes, like features, authors, edition etc. - Authors to use " instead of ' - Features to be sorted - Sort all dependencies as one instead of grouping third party and fbcode dependencies together - Manually format certain entries from third-party/rust/Cargo.toml, since V2 formats third party dependency entries and V1 just takes them as is. Reviewed By: zertosh Differential Revision: D26544150 fbshipit-source-id: 19d98985bd6c3ac901ad40cff38ee1ced547e8eb
2021-02-19 22:02:06 +03:00
authors = ["Facebook"]
edition = "2018"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
license = "GPLv2+"
mononoke/admin: make it OSS buildable Reviewed By: krallin Differential Revision: D22458187 fbshipit-source-id: 05d321bc1aded67fb2eca851b4b1ad4a8bd49d52
2020-07-11 08:08:09 +03:00
[[bin]]
name = "admin"
path = "cmds/admin/main.rs"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[[bin]]
name = "aliasverify"
path = "cmds/aliasverify.rs"
[[bin]]
name = "backfill_derived_data"
path = "cmds/backfill_derived_data/main.rs"
[[bin]]
make backfill_git_mapping more generic and supporing svn Summary: backfill_git_mapping was great for backfilling git mappings, let's use it for svn Reviewed By: StanislavGlebik Differential Revision: D26453407 fbshipit-source-id: 3ee61722ac729af5a2fc4187fda3341069bb53f6
2021-02-17 23:40:17 +03:00
name = "backfill_mapping"
path = "cmds/backfill_mapping.rs"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
mononoke/benchmark_filestore: make it OSS buildable Reviewed By: krallin Differential Revision: D22475133 fbshipit-source-id: c14bf4f0811e8c2f1cf31416bf88f378caf50be3
2020-07-11 08:08:09 +03:00
[[bin]]
name = "benchmark_filestore"
path = "cmds/benchmark_filestore.rs"
autocargo v2: rollout and replace v1 in all use-cases Summary: This diff rollouts V2 of autocargo in an atomic way so there are quite a few things done here. Arc lint support: V1 used to be part of the default fbsource `arc lint` engine, but since V2 calls buck it must live in a separate lint engine. So this diff: - Adds running `autocargo` as part of `arc lint-rust` Mergedriver update: - Mergedriver used in resolving conflicts on commits is now pointing to V2 - It handles files in `public_autocargo/` directories in addition to the ones containig generation preamble Including regeneration results of running `common/rust/cargo_from_buck/bin/autocargo`. All the differences are accounted for: - Some sections and attributes are removed as they can be autodiscovered by Cargo (like `lib.path = "src/lib.rs"` or empty [lib] section) - "readme" attribute is properly defined as relative to Cargo.toml location rather than as hardcoded string - "unittest = false" on a Buck rule propagates as "test = false; doctest = false" to Cargo - "rusqlite" is not special-cased anymore, so the "budled" feature will have to be enabled using custom configuration if required by the project (for rust-shed in order to not break windows builds a default feature section was added) - Files generated from thrift_library rules that do not support "rust" language are removed - Custom .bzl rules that create rust artifacts (like `rust_python_extension`) are no longer ignored Others: - Changed `bin/cargo-autocargo` to be a wrapper for calling V2 via `cargo autocargo` - Updated following files to use V2: - `common/rust/tools/reindeer/version-bump` - `remote_execution/rust/setup.sh` - Removed few files from V1 that would otherwise interfere with V2 automatic regeneration/linting/testing Reviewed By: zertosh Differential Revision: D26728789 fbshipit-source-id: d1454e7ce658a2d3194704f8d77b12d688ec3e64
2021-03-02 17:41:22 +03:00
test = false
mononoke/benchmark_filestore: make it OSS buildable Reviewed By: krallin Differential Revision: D22475133 fbshipit-source-id: c14bf4f0811e8c2f1cf31416bf88f378caf50be3
2020-07-11 08:08:09 +03:00
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[[bin]]
name = "benchmark_storage_config"
path = "cmds/benchmark_storage_config/main.rs"
mononoke/blobimport: make it OSS buildable Reviewed By: krallin Differential Revision: D22455491 fbshipit-source-id: 919ba0e4fc759ef25546eacf30200ff19cd89466
2020-07-13 12:58:20 +03:00
[[bin]]
name = "blobimport"
path = "cmds/blobimport.rs"
mononoke/blobstore_healer: make it OSS buildable Reviewed By: farnz Differential Revision: D22460549 fbshipit-source-id: aa5327f5dae1008cee784d41e322034cd0bb5b61
2020-07-13 12:58:20 +03:00
[[bin]]
name = "blobstore_healer"
path = "cmds/blobstore_healer/main.rs"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[[bin]]
name = "bonsai_verify"
path = "cmds/bonsai_verify/main.rs"
autocargo v2: rollout and replace v1 in all use-cases Summary: This diff rollouts V2 of autocargo in an atomic way so there are quite a few things done here. Arc lint support: V1 used to be part of the default fbsource `arc lint` engine, but since V2 calls buck it must live in a separate lint engine. So this diff: - Adds running `autocargo` as part of `arc lint-rust` Mergedriver update: - Mergedriver used in resolving conflicts on commits is now pointing to V2 - It handles files in `public_autocargo/` directories in addition to the ones containig generation preamble Including regeneration results of running `common/rust/cargo_from_buck/bin/autocargo`. All the differences are accounted for: - Some sections and attributes are removed as they can be autodiscovered by Cargo (like `lib.path = "src/lib.rs"` or empty [lib] section) - "readme" attribute is properly defined as relative to Cargo.toml location rather than as hardcoded string - "unittest = false" on a Buck rule propagates as "test = false; doctest = false" to Cargo - "rusqlite" is not special-cased anymore, so the "budled" feature will have to be enabled using custom configuration if required by the project (for rust-shed in order to not break windows builds a default feature section was added) - Files generated from thrift_library rules that do not support "rust" language are removed - Custom .bzl rules that create rust artifacts (like `rust_python_extension`) are no longer ignored Others: - Changed `bin/cargo-autocargo` to be a wrapper for calling V2 via `cargo autocargo` - Updated following files to use V2: - `common/rust/tools/reindeer/version-bump` - `remote_execution/rust/setup.sh` - Removed few files from V1 that would otherwise interfere with V2 automatic regeneration/linting/testing Reviewed By: zertosh Differential Revision: D26728789 fbshipit-source-id: d1454e7ce658a2d3194704f8d77b12d688ec3e64
2021-03-02 17:41:22 +03:00
test = false
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[[bin]]
name = "configlint"
path = "cmds/configlint.rs"
[[bin]]
name = "dumprev"
path = "cmds/dumprev.rs"
autocargo v2: rollout and replace v1 in all use-cases Summary: This diff rollouts V2 of autocargo in an atomic way so there are quite a few things done here. Arc lint support: V1 used to be part of the default fbsource `arc lint` engine, but since V2 calls buck it must live in a separate lint engine. So this diff: - Adds running `autocargo` as part of `arc lint-rust` Mergedriver update: - Mergedriver used in resolving conflicts on commits is now pointing to V2 - It handles files in `public_autocargo/` directories in addition to the ones containig generation preamble Including regeneration results of running `common/rust/cargo_from_buck/bin/autocargo`. All the differences are accounted for: - Some sections and attributes are removed as they can be autodiscovered by Cargo (like `lib.path = "src/lib.rs"` or empty [lib] section) - "readme" attribute is properly defined as relative to Cargo.toml location rather than as hardcoded string - "unittest = false" on a Buck rule propagates as "test = false; doctest = false" to Cargo - "rusqlite" is not special-cased anymore, so the "budled" feature will have to be enabled using custom configuration if required by the project (for rust-shed in order to not break windows builds a default feature section was added) - Files generated from thrift_library rules that do not support "rust" language are removed - Custom .bzl rules that create rust artifacts (like `rust_python_extension`) are no longer ignored Others: - Changed `bin/cargo-autocargo` to be a wrapper for calling V2 via `cargo autocargo` - Updated following files to use V2: - `common/rust/tools/reindeer/version-bump` - `remote_execution/rust/setup.sh` - Removed few files from V1 that would otherwise interfere with V2 automatic regeneration/linting/testing Reviewed By: zertosh Differential Revision: D26728789 fbshipit-source-id: d1454e7ce658a2d3194704f8d77b12d688ec3e64
2021-03-02 17:41:22 +03:00
test = false
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[[bin]]
name = "idxdump"
path = "cmds/idxdump.rs"
autocargo v2: rollout and replace v1 in all use-cases Summary: This diff rollouts V2 of autocargo in an atomic way so there are quite a few things done here. Arc lint support: V1 used to be part of the default fbsource `arc lint` engine, but since V2 calls buck it must live in a separate lint engine. So this diff: - Adds running `autocargo` as part of `arc lint-rust` Mergedriver update: - Mergedriver used in resolving conflicts on commits is now pointing to V2 - It handles files in `public_autocargo/` directories in addition to the ones containig generation preamble Including regeneration results of running `common/rust/cargo_from_buck/bin/autocargo`. All the differences are accounted for: - Some sections and attributes are removed as they can be autodiscovered by Cargo (like `lib.path = "src/lib.rs"` or empty [lib] section) - "readme" attribute is properly defined as relative to Cargo.toml location rather than as hardcoded string - "unittest = false" on a Buck rule propagates as "test = false; doctest = false" to Cargo - "rusqlite" is not special-cased anymore, so the "budled" feature will have to be enabled using custom configuration if required by the project (for rust-shed in order to not break windows builds a default feature section was added) - Files generated from thrift_library rules that do not support "rust" language are removed - Custom .bzl rules that create rust artifacts (like `rust_python_extension`) are no longer ignored Others: - Changed `bin/cargo-autocargo` to be a wrapper for calling V2 via `cargo autocargo` - Updated following files to use V2: - `common/rust/tools/reindeer/version-bump` - `remote_execution/rust/setup.sh` - Removed few files from V1 that would otherwise interfere with V2 automatic regeneration/linting/testing Reviewed By: zertosh Differential Revision: D26728789 fbshipit-source-id: d1454e7ce658a2d3194704f8d77b12d688ec3e64
2021-03-02 17:41:22 +03:00
test = false
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[[bin]]
name = "lfs_import"
path = "cmds/lfs_import.rs"
autocargo v2: rollout and replace v1 in all use-cases Summary: This diff rollouts V2 of autocargo in an atomic way so there are quite a few things done here. Arc lint support: V1 used to be part of the default fbsource `arc lint` engine, but since V2 calls buck it must live in a separate lint engine. So this diff: - Adds running `autocargo` as part of `arc lint-rust` Mergedriver update: - Mergedriver used in resolving conflicts on commits is now pointing to V2 - It handles files in `public_autocargo/` directories in addition to the ones containig generation preamble Including regeneration results of running `common/rust/cargo_from_buck/bin/autocargo`. All the differences are accounted for: - Some sections and attributes are removed as they can be autodiscovered by Cargo (like `lib.path = "src/lib.rs"` or empty [lib] section) - "readme" attribute is properly defined as relative to Cargo.toml location rather than as hardcoded string - "unittest = false" on a Buck rule propagates as "test = false; doctest = false" to Cargo - "rusqlite" is not special-cased anymore, so the "budled" feature will have to be enabled using custom configuration if required by the project (for rust-shed in order to not break windows builds a default feature section was added) - Files generated from thrift_library rules that do not support "rust" language are removed - Custom .bzl rules that create rust artifacts (like `rust_python_extension`) are no longer ignored Others: - Changed `bin/cargo-autocargo` to be a wrapper for calling V2 via `cargo autocargo` - Updated following files to use V2: - `common/rust/tools/reindeer/version-bump` - `remote_execution/rust/setup.sh` - Removed few files from V1 that would otherwise interfere with V2 automatic regeneration/linting/testing Reviewed By: zertosh Differential Revision: D26728789 fbshipit-source-id: d1454e7ce658a2d3194704f8d77b12d688ec3e64
2021-03-02 17:41:22 +03:00
test = false
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
Command to manually scrub keys supplied on stdin Summary: For populating the XDB blobstore, we'd like to copy data from Manifold - the easiest way to do that is to exploit MultiplexedBlobstore's scrub mode to copy data directly. Reviewed By: krallin Differential Revision: D22373838 fbshipit-source-id: 550a9c73e79059380337fa35ac94fe1134378196
2020-07-10 10:59:29 +03:00
[[bin]]
name = "manual_scrub"
path = "cmds/manual_scrub/main.rs"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[[bin]]
name = "rechunker"
path = "cmds/rechunker.rs"
[[bin]]
name = "revlogrepo"
path = "cmds/revlogrepo.rs"
cmds: add segmented_changelog seeder Summary: Mononoke command for running the SegmentedChangelogSeeder for an existing repository. The result is going to be a new IdMap version in the metadata store and a new IdDag stored in the the blobstore resulting in a brand new SegmentedChangelog bundle. Reviewed By: krallin Differential Revision: D24096963 fbshipit-source-id: 1eaf78392d66542d9674a99ad0a741f24bc2cb1b
2020-10-08 19:41:16 +03:00
[[bin]]
name = "segmented_changelog_seeder"
path = "cmds/segmented_changelog_seeder.rs"
Support marking garbage in SQLBlob Summary: We want to be able to detect garbage blobs by looking at generation numbers. Update generation numbers on put, and have a mark command exist to mark blobs as not garbage. Reviewed By: ahornby Differential Revision: D23989289 fbshipit-source-id: d96f38649151e3dbd5297cffc262776e74f6cc86
2020-10-28 20:22:18 +03:00
[[bin]]
segmented_changelog: add segmented changelog tailer command Summary: The command reads the last SegmentedChangelog that was saved for a repository and updates head to match a given bookmark (master). Right now this is just a command that works on one repository. Follow up changes will look at deployment options and handling multiple repositories. Reviewed By: krallin Differential Revision: D24516438 fbshipit-source-id: 8f04f9426c2f2d7748c5363d2dbdf9f3acb79ddd
2020-10-30 03:35:41 +03:00
name = "segmented_changelog_tailer"
path = "cmds/segmented_changelog_tailer.rs"
[[bin]]
Support marking garbage in SQLBlob Summary: We want to be able to detect garbage blobs by looking at generation numbers. Update generation numbers on put, and have a mark command exist to mark blobs as not garbage. Reviewed By: ahornby Differential Revision: D23989289 fbshipit-source-id: d96f38649151e3dbd5297cffc262776e74f6cc86
2020-10-28 20:22:18 +03:00
name = "sqlblob_gc"
path = "cmds/sqlblob_gc/main.rs"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[[bin]]
name = "statistics_collector"
path = "cmds/statistics_collector.rs"
utility to keep streaming clone data warm Summary: This is streaming clone warmup binary as per https://fb.quip.com/hfuBAdYnzr9M Reviewed By: StanislavGlebik Differential Revision: D23347029 fbshipit-source-id: f187a2f3529a7eae5998bab199228bfbe6057e6e
2020-09-01 17:12:10 +03:00
[[bin]]
name = "streaming_clone_warmup"
path = "cmds/streaming_clone_warmup/main.rs"
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[[bin]]
name = "upload_globalrevs"
path = "cmds/upload_globalrevs.rs"
[dependencies]
autocargo v1: changes to match autocargo v2 generation results. Summary: The changes (and fixes) needed were: - Ignore rules that are not rust_library or thrift_library (previously only ignore rust_bindgen_library, so that binary and test dependencies were incorrectly added to Cargo.toml) - Thrift package name to match escaping logic of `tools/build_defs/fbcode_macros/build_defs/lib/thrift/rust.bzl` - Rearrange some attributes, like features, authors, edition etc. - Authors to use " instead of ' - Features to be sorted - Sort all dependencies as one instead of grouping third party and fbcode dependencies together - Manually format certain entries from third-party/rust/Cargo.toml, since V2 formats third party dependency entries and V1 just takes them as is. Reviewed By: zertosh Differential Revision: D26544150 fbshipit-source-id: 19d98985bd6c3ac901ad40cff38ee1ced547e8eb
2021-02-19 22:02:06 +03:00
anyhow = "1.0"
ascii = "1.0"
mononoke: compress manual_scrub output files if requested Summary: Use async-compression to optionally zstd compress key and error files. Reviewed By: farnz Differential Revision: D27467761 fbshipit-source-id: e1ccb7dc32e4c41eaba82a3716cf4d13f64f71ea
2021-04-01 17:01:00 +03:00
async-compression = { version = "0.3", features = ["all"] }
vfs: introduce AsyncVfs Summary: AsyncVfs provides async vfs interface. It will be used in the native checkout instead of current use case that spawns blocking tokio tasks for VFS action Reviewed By: quark-zju Differential Revision: D26801250 fbshipit-source-id: bb26c4fc8acac82f4b55bb3f2f3964a6d0b64014
2021-03-06 08:45:20 +03:00
async-trait = "0.1.45"
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
backsyncer = { version = "0.1.0", path = "commit_rewriting/backsyncer" }
blame = { version = "0.1.0", path = "derived_data/blame" }
blobimport_lib = { version = "0.1.0", path = "blobimport_lib" }
blobrepo = { version = "0.1.0", path = "blobrepo" }
blobrepo_hg = { version = "0.1.0", path = "blobrepo/blobrepo_hg" }
blobrepo_override = { version = "0.1.0", path = "blobrepo/override" }
blobrepo_utils = { version = "0.1.0", path = "blobrepo_utils" }
blobstore = { version = "0.1.0", path = "blobstore" }
blobstore_factory = { version = "0.1.0", path = "blobstore/factory" }
blobstore_sync_queue = { version = "0.1.0", path = "blobstore_sync_queue" }
bonsai_globalrev_mapping = { version = "0.1.0", path = "bonsai_globalrev_mapping" }
bookmark_renaming = { version = "0.1.0", path = "commit_rewriting/bookmark_renaming" }
bookmarks = { version = "0.1.0", path = "bookmarks" }
bookmarks_movement = { version = "0.1.0", path = "bookmarks/bookmarks_movement" }
borrowed = { version = "0.1.0", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master" }
bounded_traversal = { version = "0.1.0", path = "common/bounded_traversal" }
bulkops = { version = "0.1.0", path = "bulkops" }
autocargo v1: changes to match autocargo v2 generation results. Summary: The changes (and fixes) needed were: - Ignore rules that are not rust_library or thrift_library (previously only ignore rust_bindgen_library, so that binary and test dependencies were incorrectly added to Cargo.toml) - Thrift package name to match escaping logic of `tools/build_defs/fbcode_macros/build_defs/lib/thrift/rust.bzl` - Rearrange some attributes, like features, authors, edition etc. - Authors to use " instead of ' - Features to be sorted - Sort all dependencies as one instead of grouping third party and fbcode dependencies together - Manually format certain entries from third-party/rust/Cargo.toml, since V2 formats third party dependency entries and V1 just takes them as is. Reviewed By: zertosh Differential Revision: D26544150 fbshipit-source-id: 19d98985bd6c3ac901ad40cff38ee1ced547e8eb
2021-02-19 22:02:06 +03:00
bytes = { version = "0.5", features = ["serde"] }
bytesize = "1.0"
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
cacheblob = { version = "0.1.0", path = "blobstore/cacheblob" }
cached_config = { version = "0.1.0", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master" }
cachelib = { version = "0.1.0", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master" }
changeset_fetcher = { version = "0.1.0", path = "blobrepo/changeset_fetcher" }
changesets = { version = "0.1.0", path = "changesets" }
autocargo v1: changes to match autocargo v2 generation results. Summary: The changes (and fixes) needed were: - Ignore rules that are not rust_library or thrift_library (previously only ignore rust_bindgen_library, so that binary and test dependencies were incorrectly added to Cargo.toml) - Thrift package name to match escaping logic of `tools/build_defs/fbcode_macros/build_defs/lib/thrift/rust.bzl` - Rearrange some attributes, like features, authors, edition etc. - Authors to use " instead of ' - Features to be sorted - Sort all dependencies as one instead of grouping third party and fbcode dependencies together - Manually format certain entries from third-party/rust/Cargo.toml, since V2 formats third party dependency entries and V1 just takes them as is. Reviewed By: zertosh Differential Revision: D26544150 fbshipit-source-id: 19d98985bd6c3ac901ad40cff38ee1ced547e8eb
2021-02-19 22:02:06 +03:00
chrono = { version = "0.4", features = ["serde"] }
clap = "2.33"
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
cloned = { version = "0.1.0", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master" }
cmdlib = { version = "0.1.0", path = "cmdlib" }
context = { version = "0.1.0", path = "server/context" }
copy_utils = { version = "0.1.0", path = "common/copy_utils" }
autocargo v1: changes to match autocargo v2 generation results. Summary: The changes (and fixes) needed were: - Ignore rules that are not rust_library or thrift_library (previously only ignore rust_bindgen_library, so that binary and test dependencies were incorrectly added to Cargo.toml) - Thrift package name to match escaping logic of `tools/build_defs/fbcode_macros/build_defs/lib/thrift/rust.bzl` - Rearrange some attributes, like features, authors, edition etc. - Authors to use " instead of ' - Features to be sorted - Sort all dependencies as one instead of grouping third party and fbcode dependencies together - Manually format certain entries from third-party/rust/Cargo.toml, since V2 formats third party dependency entries and V1 just takes them as is. Reviewed By: zertosh Differential Revision: D26544150 fbshipit-source-id: 19d98985bd6c3ac901ad40cff38ee1ced547e8eb
2021-02-19 22:02:06 +03:00
criterion = "=0.3.1"
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
cross_repo_sync = { version = "0.1.0", path = "commit_rewriting/cross_repo_sync" }
dbbookmarks = { version = "0.1.0", path = "bookmarks/dbbookmarks" }
deleted_files_manifest = { version = "0.1.0", path = "derived_data/deleted_files_manifest" }
mononoke: add progress to manual_scrub Summary: Some manual scrub runs can take a long time. Provide progress feedback logging. Includes a --quiet option for when progress reporting not required. Reviewed By: farnz Differential Revision: D27588449 fbshipit-source-id: 00840cdf2022358bc10398f08b3bbf3eeec2b299
2021-04-06 18:42:33 +03:00
derive_more = "0.99.3"
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
derived_data = { version = "0.1.0", path = "derived_data" }
derived_data_filenodes = { version = "0.1.0", path = "derived_data/filenodes" }
derived_data_utils = { version = "0.1.0", path = "derived_data/utils" }
failure_ext = { version = "0.1.0", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master" }
fastlog = { version = "0.1.0", path = "derived_data/fastlog" }
fbinit = { version = "0.1.0", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master" }
fbthrift = { version = "0.0.1+unstable", git = "https://github.com/facebook/fbthrift.git", branch = "master" }
filenodes = { version = "0.1.0", path = "filenodes" }
filestore = { version = "0.1.0", path = "filestore" }
fsnodes = { version = "0.1.0", path = "derived_data/fsnodes" }
third-party/rust: update futures Summary: Those newer versions of Futures have compatibility improvements with Tokio, notably: - https://github.com/rust-lang/futures-rs/pull/2333 - https://github.com/rust-lang/futures-rs/pull/2358 Reviewed By: farnz Differential Revision: D26778794 fbshipit-source-id: 5a9dc002083e5edfa5c614d8d2242e586a93fcf6
2021-03-04 17:40:30 +03:00
futures = { version = "0.3.13", features = ["async-await", "compat"] }
futures-old = { package = "futures", version = "0.1.31" }
autocargo v1: changes to match autocargo v2 generation results. Summary: The changes (and fixes) needed were: - Ignore rules that are not rust_library or thrift_library (previously only ignore rust_bindgen_library, so that binary and test dependencies were incorrectly added to Cargo.toml) - Thrift package name to match escaping logic of `tools/build_defs/fbcode_macros/build_defs/lib/thrift/rust.bzl` - Rearrange some attributes, like features, authors, edition etc. - Authors to use " instead of ' - Features to be sorted - Sort all dependencies as one instead of grouping third party and fbcode dependencies together - Manually format certain entries from third-party/rust/Cargo.toml, since V2 formats third party dependency entries and V1 just takes them as is. Reviewed By: zertosh Differential Revision: D26544150 fbshipit-source-id: 19d98985bd6c3ac901ad40cff38ee1ced547e8eb
2021-02-19 22:02:06 +03:00
futures-util = "0.3.7"
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
futures_03_ext = { package = "futures_ext", version = "0.1.0", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master" }
futures_ext = { package = "futures_01_ext", version = "0.1.0", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master" }
futures_stats = { version = "0.1.0", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master" }
git_types = { version = "0.1.0", path = "git/git_types" }
autocargo v1: changes to match autocargo v2 generation results. Summary: The changes (and fixes) needed were: - Ignore rules that are not rust_library or thrift_library (previously only ignore rust_bindgen_library, so that binary and test dependencies were incorrectly added to Cargo.toml) - Thrift package name to match escaping logic of `tools/build_defs/fbcode_macros/build_defs/lib/thrift/rust.bzl` - Rearrange some attributes, like features, authors, edition etc. - Authors to use " instead of ' - Features to be sorted - Sort all dependencies as one instead of grouping third party and fbcode dependencies together - Manually format certain entries from third-party/rust/Cargo.toml, since V2 formats third party dependency entries and V1 just takes them as is. Reviewed By: zertosh Differential Revision: D26544150 fbshipit-source-id: 19d98985bd6c3ac901ad40cff38ee1ced547e8eb
2021-02-19 22:02:06 +03:00
humantime = "1.3"
itertools = "0.8"
lazy_static = "1.0"
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
lfs_import_lib = { version = "0.1.0", path = "lfs_import_lib" }
live_commit_sync_config = { version = "0.1.0", path = "commit_rewriting/live_commit_sync_config" }
lock_ext = { version = "0.1.0", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master" }
manifest = { version = "0.1.0", path = "manifest" }
autocargo v1: changes to match autocargo v2 generation results. Summary: The changes (and fixes) needed were: - Ignore rules that are not rust_library or thrift_library (previously only ignore rust_bindgen_library, so that binary and test dependencies were incorrectly added to Cargo.toml) - Thrift package name to match escaping logic of `tools/build_defs/fbcode_macros/build_defs/lib/thrift/rust.bzl` - Rearrange some attributes, like features, authors, edition etc. - Authors to use " instead of ' - Features to be sorted - Sort all dependencies as one instead of grouping third party and fbcode dependencies together - Manually format certain entries from third-party/rust/Cargo.toml, since V2 formats third party dependency entries and V1 just takes them as is. Reviewed By: zertosh Differential Revision: D26544150 fbshipit-source-id: 19d98985bd6c3ac901ad40cff38ee1ced547e8eb
2021-02-19 22:02:06 +03:00
maplit = "1.0"
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
memblob = { version = "0.1.0", path = "blobstore/memblob" }
mercurial_bundle_replay_data = { version = "0.1.0", path = "mercurial/bundle_replay_data" }
mercurial_derived_data = { version = "0.1.0", path = "derived_data/mercurial_derived_data" }
mercurial_revlog = { version = "0.1.0", path = "mercurial/revlog" }
mercurial_types = { version = "0.1.0", path = "mercurial/types" }
metaconfig_types = { version = "0.1.0", path = "metaconfig/types" }
mononoke_hg_sync_job_helper_lib = { version = "0.1.0", path = "mononoke_hg_sync_job" }
mononoke_types = { version = "0.1.0", path = "mononoke_types" }
mutable_counters = { version = "0.1.0", path = "mutable_counters" }
prefixblob = { version = "0.1.0", path = "blobstore/prefixblob" }
pushrebase = { version = "0.1.0", path = "pushrebase" }
autocargo v1: changes to match autocargo v2 generation results. Summary: The changes (and fixes) needed were: - Ignore rules that are not rust_library or thrift_library (previously only ignore rust_bindgen_library, so that binary and test dependencies were incorrectly added to Cargo.toml) - Thrift package name to match escaping logic of `tools/build_defs/fbcode_macros/build_defs/lib/thrift/rust.bzl` - Rearrange some attributes, like features, authors, edition etc. - Authors to use " instead of ' - Features to be sorted - Sort all dependencies as one instead of grouping third party and fbcode dependencies together - Manually format certain entries from third-party/rust/Cargo.toml, since V2 formats third party dependency entries and V1 just takes them as is. Reviewed By: zertosh Differential Revision: D26544150 fbshipit-source-id: 19d98985bd6c3ac901ad40cff38ee1ced547e8eb
2021-02-19 22:02:06 +03:00
rand = { version = "0.7", features = ["small_rng"] }
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
redactedblobstore = { version = "0.1.0", path = "blobstore/redactedblobstore" }
autocargo v1: changes to match autocargo v2 generation results. Summary: The changes (and fixes) needed were: - Ignore rules that are not rust_library or thrift_library (previously only ignore rust_bindgen_library, so that binary and test dependencies were incorrectly added to Cargo.toml) - Thrift package name to match escaping logic of `tools/build_defs/fbcode_macros/build_defs/lib/thrift/rust.bzl` - Rearrange some attributes, like features, authors, edition etc. - Authors to use " instead of ' - Features to be sorted - Sort all dependencies as one instead of grouping third party and fbcode dependencies together - Manually format certain entries from third-party/rust/Cargo.toml, since V2 formats third party dependency entries and V1 just takes them as is. Reviewed By: zertosh Differential Revision: D26544150 fbshipit-source-id: 19d98985bd6c3ac901ad40cff38ee1ced547e8eb
2021-02-19 22:02:06 +03:00
regex = "1.4.2"
benchmark_storage_config: remove dependency on blobrepo_factory Summary: Use the equivalent function from `repo_factory`. Reviewed By: krallin Differential Revision: D27363470 fbshipit-source-id: dce3cf843174caa2f9ef7083409e7935749be4cd
2021-04-07 23:59:27 +03:00
repo_factory = { version = "0.1.0", path = "repo_factory" }
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
revset = { version = "0.1.0", path = "revset" }
scuba_ext = { version = "0.1.0", path = "common/scuba_ext" }
segmented_changelog = { version = "0.1.0", path = "segmented_changelog" }
segmented_changelog: update OnDemandUpdateDag to have smaller critical sections Summary: The on demand update code we have is the most basic logic that we could have. The main problem is that it has long and redundant write locks. This change reduces the write lock strictly to the section that has to update the in memory IdDag. Updating the Dag has 3 phases: * loading the data that is required for the update; * updating the IdMap; * updating the IdDag; The Dag can function well for serving requests as long as the commits involved have been built so we want to have easy read access to both the IdMap and the IdDag. The IdMap is a very simple structure and because it's described as an Arc<dyn IdMap> we push the update locking logic to the storage. The IdDag is a complicated structure that we ask to update itself. Those functions take mutable references. Updating the storage of the iddag to hide the complexities of locking is more difficult. We deal with the IdDag directly by wrapping it in a RwLock. The RwLock allows for easy read access which we expect to be the predominant access pattern. Updates to the dag are not completely stable so racing updates can have conflicting results. In case of conflics one of the update processes would have to restart. It's easier to reason about the process if we just allow one "thread" to start an update process. The update process is locked by a sync mutex. The "threads" that fail the race to update are asked to wait until the ongoing update is complete. The waiters will poll on a shared future that tracks the ongoing dag update. After the update is complete the waiters will go back to checking if the data they have is available in the dag. It is possible that the dag is updated in between determining that the an update is needed and acquiring the ongoing_update lock. This is fine because the update building process checks the state of dag before the dag and updates only what is necessary if necessary. Reviewed By: krallin Differential Revision: D26508430 fbshipit-source-id: cd3bceed7e0ffb00aee64433816b5a23c0508d3c
2021-02-23 05:14:45 +03:00
serde = { version = "=1.0.118", features = ["derive", "rc"] }
autocargo v1: changes to match autocargo v2 generation results. Summary: The changes (and fixes) needed were: - Ignore rules that are not rust_library or thrift_library (previously only ignore rust_bindgen_library, so that binary and test dependencies were incorrectly added to Cargo.toml) - Thrift package name to match escaping logic of `tools/build_defs/fbcode_macros/build_defs/lib/thrift/rust.bzl` - Rearrange some attributes, like features, authors, edition etc. - Authors to use " instead of ' - Features to be sorted - Sort all dependencies as one instead of grouping third party and fbcode dependencies together - Manually format certain entries from third-party/rust/Cargo.toml, since V2 formats third party dependency entries and V1 just takes them as is. Reviewed By: zertosh Differential Revision: D26544150 fbshipit-source-id: 19d98985bd6c3ac901ad40cff38ee1ced547e8eb
2021-02-19 22:02:06 +03:00
serde_derive = "1.0"
serde_json = { version = "1.0", features = ["float_roundtrip"] }
sha2 = "0.8"
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
skeleton_manifest = { version = "0.1.0", path = "derived_data/skeleton_manifest" }
skiplist = { version = "0.1.0", path = "reachabilityindex/skiplist" }
autocargo v1: changes to match autocargo v2 generation results. Summary: The changes (and fixes) needed were: - Ignore rules that are not rust_library or thrift_library (previously only ignore rust_bindgen_library, so that binary and test dependencies were incorrectly added to Cargo.toml) - Thrift package name to match escaping logic of `tools/build_defs/fbcode_macros/build_defs/lib/thrift/rust.bzl` - Rearrange some attributes, like features, authors, edition etc. - Authors to use " instead of ' - Features to be sorted - Sort all dependencies as one instead of grouping third party and fbcode dependencies together - Manually format certain entries from third-party/rust/Cargo.toml, since V2 formats third party dependency entries and V1 just takes them as is. Reviewed By: zertosh Differential Revision: D26544150 fbshipit-source-id: 19d98985bd6c3ac901ad40cff38ee1ced547e8eb
2021-02-19 22:02:06 +03:00
slog = { version = "2.5", features = ["max_level_debug"] }
mononoke_types: use SortedVectorMap for BonsaiChangeset Summary: BonsaiChangesets are rarely mutated, and their maps are stored in sorted order, so we can use `SortedVectorMap` to load them more efficiently. In the cases where mutable maps of filechanges are needed, we can use `BTreeMap` during the mutation and then convert them to `SortedVectorMap` to store them. Reviewed By: mitrandir77 Differential Revision: D25615279 fbshipit-source-id: 796219c1130df5cb025952bb61002e8d2ae898f4
2021-03-11 15:25:00 +03:00
sorted_vector_map = { version = "0.1.0", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master" }
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
sql_construct = { version = "0.1.0", path = "common/sql_construct" }
sql_ext = { version = "0.1.0", path = "common/rust/sql_ext" }
sqlblob = { version = "0.1.0", path = "blobstore/sqlblob" }
stats = { version = "0.1.0", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master" }
streaming_clone = { version = "0.1.0", path = "repo_client/streaming_clone" }
synced_commit_mapping = { version = "0.1.0", path = "commit_rewriting/synced_commit_mapping" }
mononoke: add checkpoint for input to manual_scrub Summary: Reduce amount of manual steps needed to restart a manual scrub by checkpointing where it has got to to a file. Differential Revision: D27588450 fbshipit-source-id: cb0eda7d6ff57f3bb18a6669d38f5114ca9196b0
2021-04-07 19:29:57 +03:00
tempfile = "3.1"
autocargo v1: changes to match autocargo v2 generation results. Summary: The changes (and fixes) needed were: - Ignore rules that are not rust_library or thrift_library (previously only ignore rust_bindgen_library, so that binary and test dependencies were incorrectly added to Cargo.toml) - Thrift package name to match escaping logic of `tools/build_defs/fbcode_macros/build_defs/lib/thrift/rust.bzl` - Rearrange some attributes, like features, authors, edition etc. - Authors to use " instead of ' - Features to be sorted - Sort all dependencies as one instead of grouping third party and fbcode dependencies together - Manually format certain entries from third-party/rust/Cargo.toml, since V2 formats third party dependency entries and V1 just takes them as is. Reviewed By: zertosh Differential Revision: D26544150 fbshipit-source-id: 19d98985bd6c3ac901ad40cff38ee1ced547e8eb
2021-02-19 22:02:06 +03:00
thiserror = "1.0"
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
throttledblob = { version = "0.1.0", path = "blobstore/throttledblob" }
time_ext = { version = "0.1.0", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master" }
third-party/rust: update Tokio to 0.2.25 + add a patch to disable coop scheduling Summary: See the patch & motivation here: https://github.com/tokio-rs/tokio/commit/818f943db36e32b7c928351c32fe69ac913409f9 Reviewed By: StanislavGlebik Differential Revision: D26399890 fbshipit-source-id: e184a3f6c1dd03cb4cdb7ea18073c3392d7ce355
2021-02-12 15:54:03 +03:00
tokio = { version = "0.2.25", features = ["full", "test-util"] }
third-party/rust: update tokio-util to 0.3 and rename it Summary: Like our other "tokio ecosystem" crates, I'm renaming this one tokio-util-02 (as in tokio-02) since this is the last version it is compatible with. Note that this had a breaking change as well, so I updated the callsites. Reviewed By: HarveyHunt Differential Revision: D26636350 fbshipit-source-id: 30f7da1036c861a97717c8d26648daaae33ecfbd
2021-02-25 18:40:23 +03:00
tokio-util = { version = "0.3", features = ["codec", "udp"] }
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
tokio_shim = { version = "0.1.0", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master" }
convert BlobRepoHg to new type futures Summary: Convert all BlobRepoHg methods to new type futures Reviewed By: StanislavGlebik Differential Revision: D25471540 fbshipit-source-id: c8e99509d39d0e081d082097cbd9dbfca431637e
2020-12-17 18:43:34 +03:00
toml = "=0.5.7"
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
unodes = { version = "0.1.0", path = "derived_data/unodes" }
xdiff = { version = "0.1.0", path = "../scm/lib/xdiff" }
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[dev-dependencies]
common/rust: use fbinit-tokio Summary: This diffs add a layer of indirection between fbinit and tokio, thus allowing us to use fbinit with tokio 0.2 or tokio 1.x. The way this works is that you specify the Tokio you want by adding it as an extra dependency alongside `fbinit` in your `TARGETS` (before this, you had to always include `tokio-02`). If you use `fbinit-tokio`, then `#[fbinit::main]` and `#[fbinit::test]` get you a Tokio 1.x runtime, whereas if you use `fbinit-tokio-02`, you get a Tokio 0.2 runtime. This diff is big, because it needs to change all the TARGETS that reference this in the same diff that introduces the mechanism. I also didn't produce it by hand. Instead, I scripted the transformation using this script: P242773846 I then ran it using: ``` { hg grep -l "fbinit::test"; hg grep -l "fbinit::main" } | \ sort | \ uniq | \ xargs ~/codemod/codemod.py \ && yes | arc lint \ && common/rust/cargo_from_buck/bin/autocargo ``` Finally, I grabbed the files returned by `hg grep`, then fed them to: ``` arc lint-rust --paths-from ~/files2 --apply-patches --take RUSTFIXDEPS ``` (I had to modify the file list a bit: notably I removed stuff from scripts/ because some of that causes Buck to crash when running lint-rust, and I also had to add fbcode/ as a prefix everywhere). Reviewed By: mitrandir77 Differential Revision: D26754757 fbshipit-source-id: 326b1c4efc9a57ea89db9b1d390677bcd2ab985e
2021-03-03 15:06:49 +03:00
fbinit-tokio-02 = { version = "0.1.0", git = "https://github.com/facebookexperimental/rust-shed.git", branch = "master" }
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
fixtures = { version = "0.1.0", path = "tests/fixtures" }
test_repo_factory: use test factory for remaining tests Summary: Use the test factory for the remaining existing tests. Reviewed By: StanislavGlebik Differential Revision: D27169443 fbshipit-source-id: 00d62d7794b66f5d3b053e8079f09f2532d757e7
2021-03-25 17:32:21 +03:00
test_repo_factory = { version = "0.1.0", path = "repo_factory/test_repo_factory" }
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
tests_utils = { version = "0.1.0", path = "tests/utils" }
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
[patch.crates-io]
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
addr2line = { git = "https://github.com/gimli-rs/addr2line.git", rev = "0b6b6018b5b252a18e628fba03885f7d21844b3c" }
mononoke: do not report bookmark validation error if we get an infra error Summary: We got a few ubns because one bookmark validator in a single region wasn't able to connect to mysql and was reporting errors. This diff fixes by separating logical and infra errors Reviewed By: ikostia Differential Revision: D25092364 fbshipit-source-id: 93f4be1a7e0467051b7b8d927eef9b4f5cd6a983
2020-11-19 23:56:30 +03:00
bytecount = { git = "https://github.com/llogiq/bytecount", rev = "469eaf8395c99397cd64d059737a9054aa014088" }
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
chashmap = { git = "https://gitlab.redox-os.org/ahornby/chashmap", rev = "901ace2ca3cdbc2095adb1af111d211e254e2aae" }
const-random = { git = "https://github.com/fbsource/const-random", rev = "374c5b46427fe2ffbf6acbd9c1687e0f1a809f95" }
third-party/rust: patch curl and curl-sys Summary: Update the `curl` and `curl-sys` crates to use a patched version that supports `CURLOPT_SSLCERT_BLOB` and similar config options that allow the use of in-memory TLS credentials. These options were added last year in libcurl version `7.71.0`, but the Rust bindings have not yet been updated to support them. I intend to upstream this patch, but until then, this will allow us to use these options in fbcode. Reviewed By: quark-zju Differential Revision: D27633208 fbshipit-source-id: 911e0b8809bc0144ad8b32749e71208bd08458fd
2021-04-08 21:48:52 +03:00
curl = { git = "https://github.com/kulshrax/curl-rust", rev = "2a15bbd8dbbd54734313fa703a64db7ce6ddaff0" }
curl-sys = { git = "https://github.com/kulshrax/curl-rust", rev = "2a15bbd8dbbd54734313fa703a64db7ce6ddaff0" }
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
enumset = { git = "https://github.com/danobi/enumset", rev = "4c01c583c27a725948fededbfb3461c572a669a4" }
third-party: import a Tokio 1.x compatible version of Gotham Summary: This won't be very long lived, as I'll remove the 0.2 version once Mononoke is updated (we are the only users), and stop using a fork as soon as Gotham releases. However, for now, I need both versions in order to avoid to do it all in 1 diff. A couple things worth noting here: - See the previous diff for why I am using 2 Git repos for this. - I can't easily use 2 forks for this because there are some extra crates they vendor, notably `borrow_bag`. I removed it from both forks and pulled it from crates.io instead. Reviewed By: mitrandir77 Differential Revision: D26781291 fbshipit-source-id: 0b9824c07b880dbd5b94cd6d62d2cb2a68e348e9
2021-03-04 17:40:30 +03:00
gotham = { git = "https://github.com/krallin/gotham.git", rev = "6c1612c7189893f31c6c3fa2dda11c0b6d83e1ac" }
gotham-02 = { package = "gotham", git = "https://github.com/krallin/gotham-02.git", rev = "1eb3b976c31e7e4334b188f3abfa5cc2e5cae033" }
gotham_derive = { git = "https://github.com/krallin/gotham.git", rev = "6c1612c7189893f31c6c3fa2dda11c0b6d83e1ac" }
gotham_derive-02 = { package = "gotham_derive", git = "https://github.com/krallin/gotham-02.git", rev = "1eb3b976c31e7e4334b188f3abfa5cc2e5cae033" }
third-party/rust: patch Hyper 0.14 sending Content-Length on 101 Continue responses Summary: There is a bug in Hyper with 101 Continue responses: it sends a Content-Length. This makes Proxygen unhappy with websocket upgrades. We used to have this patched in hyper-02, but since Mononoke is about to update to Tokio 1.x, we also need in the matching Hyper. One thing that's a bit awkward is you might notice I changed the fork where the patch comes from. This is because `cargo vendor` cannot deal with 2 overriding sources coming from the same upstream. I posted about my adventures in this here: https://fb.workplace.com/groups/rust.language/permalink/5278514098863829/ Reviewed By: HarveyHunt Differential Revision: D26780899 fbshipit-source-id: e775b7151427898d63d8767acaa53f5f68229db6
2021-03-04 17:40:30 +03:00
hyper = { package = "hyper", git = "https://github.com/krallin/hyper.git", rev = "8850630d2fbb637cfdeaea802526e2d968ec0b71" }
hyper-02 = { package = "hyper", version = "0.13.10", git = "https://github.com/krallin/hyper-02.git", rev = "9c9453c5ae3e92de4ba30edd81bb45371b8fa8d6" }
Work around lru-disk-cache UB in Rust 1.48 Summary: `lru-disk-cache` depends on an old version of `linked-hash-map` which contains UB in 1.48 (see https://github.com/mozilla/sccache/issues/813). They updated the deps in their repo months ago, but haven't pushed a new version. This diff makes us get `lru-disk-cache` directly from their GitHub instead. Reviewed By: dtolnay Differential Revision: D25134582 fbshipit-source-id: 05fd63a76b7095ebeea458645b92a83bbd8c4614
2020-11-21 03:58:47 +03:00
lru-disk-cache = { git = "https://github.com/mozilla/sccache", rev = "033ebaae69beeb0ac04e8c35d6ff1103487bd9a3" }
common/rust: introduce fbinit-tokio Summary: This introduces a couple "trampoline" crates to use alongside fbinit in order to let callers choose which version of Tokio they want by selecting one or the other and adding it to their `TARGETS` alongside `fbinit` (right now, they need to include `tokio` there). The entrypoints here will be called by the expansion of the `#[fbinit::main]` and `#[fbinit::test]` macros for `async fn`-s. Right now, this isn't wired up: that happens in the next diff. In this diff, I'm just adding the two entrypoints. Reviewed By: mitrandir77 Differential Revision: D26754751 fbshipit-source-id: 1966dadf8bbe427ce4a1e90559a81790d8e56e7a
2021-03-03 15:06:49 +03:00
openssl = { git = "https://github.com/sfackler/rust-openssl", rev = "68fc8ba890d77986b06ca5ce29d1089285fbbcf9" }
openssl-sys = { git = "https://github.com/sfackler/rust-openssl", rev = "68fc8ba890d77986b06ca5ce29d1089285fbbcf9" }
Daily `common/rust/cargo_from_buck/bin/autocargo` Reviewed By: farnz Differential Revision: D27458795 fbshipit-source-id: 6d4f0e8ebcebe2f71e1152a61bf6511230c31af5
2021-03-31 12:32:58 +03:00
petgraph = { git = "https://github.com/jkeljo/petgraph", rev = "e3e9dd8632d23973fdc0b42c1117d5e5fc5fa384" }
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
prost = { git = "https://github.com/gabrielrussoc/prost", branch = "protoc-runtime" }
prost-build = { git = "https://github.com/gabrielrussoc/prost", branch = "protoc-runtime" }
prost-derive = { git = "https://github.com/gabrielrussoc/prost", branch = "protoc-runtime" }
prost-types = { git = "https://github.com/gabrielrussoc/prost", branch = "protoc-runtime" }
r2d2_sqlite = { git = "https://github.com/jsgf/r2d2-sqlite.git", rev = "6d77a828ca0a3c507a3f58561532a1b6c66c7918" }
rustfilt = { git = "https://github.com/jsgf/rustfilt.git", rev = "8141fa7f1caee562ee8daffb2ddeca3d1f0d36e5" }
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
smallvec = { git = "https://github.com/ahornby/rust-smallvec.git", rev = "708e6f09ced4ed211a7c63f53bce7dfe2bbda478" }
tokio-02 = { package = "tokio", version = "0.2.25", git = "https://github.com/krallin/tokio.git", rev = "818f943db36e32b7c928351c32fe69ac913409f9" }
tokio-compat = { package = "tokio-compat", version = "0.1.6", git = "https://github.com/krallin/tokio-compat.git", rev = "c2330c2a0141353e467cc5861988daa2eae7cb54" }
cargo_from_buck: add the patch section to Cargo workspace and allow workspace appending to existing manifest Summary: Two changes here: 1. The `[patch.crates-io]` section of `third-party/rust/Cargo.toml` is being now copied over to workspaces generated by autocargo for OSS and in the runtime generated Cargo.toml file for cargo-fbcode builds. Without that some projects could be buildable in Buck internally, but not externally on GitHub due to missing patches. 2. If a `[workspace]` Cargo.toml file is being generated and there is already a generated Cargo.toml file in the same directory then instead of overriding that file the `[workspace]` (and `[patch]`) sections are appended to that Cargo.toml file. Reviewed By: farnz Differential Revision: D22023144 fbshipit-source-id: dec54491c36c2ee0ab29eefb722b3eceaef6ffe1
2020-06-17 16:26:05 +03:00
tokio-core = { git = "https://github.com/bolinfest/tokio-core", rev = "5f37aa3c627d56ee49154bc851d6930f5ab4398f" }
convert BlobRepoHg to new type futures Summary: Convert all BlobRepoHg methods to new type futures Reviewed By: StanislavGlebik Differential Revision: D25471540 fbshipit-source-id: c8e99509d39d0e081d082097cbd9dbfca431637e
2020-12-17 18:43:34 +03:00
toml = { git = "https://github.com/jsgf/toml-rs", branch = "dotted-table-0.5.7" }
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
[workspace]
members = [
".",
"alpn",
benchmarks: add benchmark_large_directory Summary: Add a microbenchmark for deriving data with large directories. This benchmark creates a commit with 100k files in a single directory, and then derives data for that commit and 10 descendant commits, each of which add, modify and remove some files. Reviewed By: ahornby Differential Revision: D26947361 fbshipit-source-id: 4215f1ac806c53a112217ceb10e50cfad56f4f28
2021-03-11 15:25:00 +03:00
"benchmarks/derived_data",
benchmark: rename to benchmarks/simulated_repo Summary: Rename this benchmark to a specific name so that we can add new benchmarks. Differential Revision: D26947362 fbshipit-source-id: a1d060ee79781aa0ead51f284517471431418659
2021-03-11 15:25:00 +03:00
"benchmarks/simulated_repo",
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
"blobimport_lib",
"blobimport_lib/consts",
"blobrepo",
"blobrepo/blobrepo_hg",
"blobrepo/blobsync",
"blobrepo/changeset_fetcher",
"blobrepo/common",
"blobrepo/errors",
"blobrepo/override",
"blobrepo/repo_blobstore",
"blobrepo_utils",
"blobstore",
"blobstore/blobstore_stats",
"blobstore/cacheblob",
"blobstore/chaosblob",
"blobstore/delayblob",
"blobstore/factory",
"blobstore/fileblob",
"blobstore/if",
"blobstore/logblob",
"blobstore/memblob",
"blobstore/multiplexedblob",
"blobstore/packblob",
"blobstore/packblob/if",
"blobstore/prefixblob",
"blobstore/readonlyblob",
"blobstore/redactedblobstore",
"blobstore/samplingblob",
"blobstore/sqlblob",
"blobstore/throttledblob",
"blobstore/virtually_sharded_blobstore",
"blobstore_sync_queue",
"bonsai_git_mapping",
"bonsai_git_mapping/git_mapping_pushrebase_hook",
"bonsai_globalrev_mapping",
"bonsai_globalrev_mapping/globalrev_pushrebase_hook",
"bonsai_globalrev_mapping/if",
"bonsai_hg_mapping",
"bonsai_hg_mapping/if",
"bonsai_svnrev_mapping",
"bonsai_svnrev_mapping/if",
"bookmarks",
"bookmarks/bookmarks_movement",
"bookmarks/bookmarks_types",
"bookmarks/dbbookmarks",
"bookmarks/warm_bookmarks_cache",
"bulkops",
"bulkops/bench",
"cache_warmup",
"changesets",
"changesets/if",
"cmdlib",
"cmdlib/x_repo",
"commit_rewriting/backsyncer",
"commit_rewriting/bookmark_renaming",
"commit_rewriting/bookmarks_validator",
"commit_rewriting/commit_validator",
"commit_rewriting/cross_repo_sync",
"commit_rewriting/cross_repo_sync/test_utils",
"commit_rewriting/live_commit_sync_config",
"commit_rewriting/megarepo",
"commit_rewriting/mononoke_x_repo_sync_job",
"commit_rewriting/movers",
"commit_rewriting/synced_commit_mapping",
"common/allocation_tracing",
"common/async_limiter",
"common/async_limiter/examples/tokio_v2",
"common/bounded_traversal",
"common/copy_utils",
"common/dedupmap",
"common/futures_watchdog",
"common/iterhelpers",
mononoke/rendezvous: introduce query batching Summary: This introduces a basic building block for query batching. I called this rendezvous, since it's about multiple queries meeting up in the same place :) There are a few (somewhat conflicting) goals this tries to satisfy, so let's go over them: 1), we'd like to reduce the total number of queries made by batch jobs. For example, group hg bonsai lookups made by the walker. Those jobs are characterized by the fact that they have a lot of queries to make, all the time. Here's an example: https://fburl.com/ods/zuiep7yh. 2), we'd like to reduce the overall number of connections held to MySQL by our tasks. The main way we achieve this is by reducing the maximum number of concurrent queries. Indeed, a high total number of queries doesn't necessarily result in a lot of connections as long as they're not concurrent, because we can reuse connections. On the other hand, if you dispatch 100 concurrent queries, that _does_ use 100 connections. This is something that applies to batch jobs due to their query volume, but also to "interactive" jobs like Mononoke Server or SCS, just not all the time. Here's an example: https://fburl.com/ods/o6gp07qp (you can see the query count is overall low, but sometimes spikes substantially). 2.1) It's also worth noting that concurrent queries are often the result of many clients wanting the same data, so deduplication is also useful here. 3), we also don't want to impact the latency of interactive jobs when they need to a little query here or there (i.e. it's largely fine if our jobs all hold a few connections to MySQL and use them somewhat consistently). 4), we'd like this to make it easier to do batching right. For example, if you have 100 Bonsais to map to hg, you should be able to just map and call `future::try_join_all` and have that do the right thing. 5), we don't want "bad" queries to affect other queries negatively. One example would be the occasional queries we make to Bonsai <-> Hg mapping in `known` for thousands (if not more) of rows. 6), we want this to be easy to incorporate into the codebase. So, how do we try to address all of this? Here's how: - We ... do batching, and we deduplicate requests in a batch. This is the easier bit and should address #1, #2 and #2.1, #4. - However, batching is conditional. We notably don't batch very large requests with the rest (addresses #5). We also don't batch small queries all the time: we only batch if we are observing a throughput of queries that suggests we can find some benefit in batching (this targets #3). - Finally, we have some utilities for common cases like having to group by repo id (this is `MultiRendezVous`), and this is all configurable via tunables (and the default is to not do anything). Reviewed By: StanislavGlebik Differential Revision: D27010317 fbshipit-source-id: 4a2397255f9785c6722c02e4d419438fd0aafa07
2021-03-19 18:49:00 +03:00
"common/rendezvous",
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
"common/rust/caching_ext",
"common/rust/slog_ext",
"common/rust/sql_ext",
"common/scribe_ext",
"common/scuba_ext",
"common/sql_construct",
mononoke/timeseries: introduce a basic crate for tracking time series Summary: I'd like to be able to track time series for access within Mononoke. The underlying use case here is that I want to be able to track the max count of connections in our SQL connection pools over time (and possibly other things in the future). Now, the obvious question is: why am I rolling my own? Well, as it turns out, there isn't really an implementation of this that I can reuse: - You might expect to be able to track the max of a value via fb303, but you can't: https://www.internalfb.com/intern/diffusion/FBS/browse/master/fbcode/fb303/ExportType.h?commit=0405521ec858e012c0692063209f3e13a2671043&lines=26-29 - You might go look in Folly, but you'll find that the time series there only supports tracking Sum & Average, but I want my timeseries to track Max (and in fact I'd like it to be sufficiently flexible to track anything I want): https://www.internalfb.com/intern/diffusion/FBS/browse/master/fbcode/folly/stats/BucketedTimeSeries.h It's not the first time I've ran into a need for something like this. I needed it in RendezVous to track connections over the last 2 N millisecond intervals, and we needed it in metagit for host draining as well (note that the implementation here is somewhat inspired by the implementation there). Reviewed By: mzr Differential Revision: D27678388 fbshipit-source-id: ba6d244b8bb848d4e1a12f9c6f54e3aa729f6c9c
2021-04-12 15:21:39 +03:00
"common/timeseries",
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
"common/topo_sort",
"common/type_map",
"common/uniqueheap",
"derived_data",
"derived_data/blame",
"derived_data/changeset_info",
"derived_data/changeset_info/if",
"derived_data/deleted_files_manifest",
"derived_data/fastlog",
"derived_data/filenodes",
"derived_data/fsnodes",
"derived_data/mercurial_derived_data",
"derived_data/skeleton_manifest",
"derived_data/test_utils",
"derived_data/unodes",
"derived_data/utils",
"edenapi_server",
"edenapi_service",
"fastreplay",
"filenodes",
"filenodes/if",
"filestore",
"git/git-pool",
"git/git_types",
"git/git_types/if",
"git/gitimport",
"git/import_tools",
"gotham_ext",
"hgcli",
"hgproto",
"hook_tailer",
"hooks",
"hooks/content-stores",
"hooks/hook_manager_factory",
"lfs_import_lib",
"lfs_protocol",
"lfs_server",
"load_limiter",
"manifest",
"mercurial/bundle_replay_data",
"mercurial/bundles",
"mercurial/mutation",
"mercurial/revlog",
"mercurial/types",
"mercurial/types/if",
"mercurial/types/mocks",
"metaconfig/parser",
"metaconfig/types",
"microwave",
"microwave/builder",
"microwave/if",
"mononoke_api",
"mononoke_api_hg",
"mononoke_hg_sync_job",
"mononoke_types",
"mononoke_types/if",
"mononoke_types/mocks",
"mutable_counters",
"newfilenodes",
"observability",
"permission_checker",
"phases",
"pushrebase",
quiet certain connection errors when shutting down Summary: Similar to D27155123 (https://github.com/facebookexperimental/eden/commit/1a56da1c6f6ea71b5e1c6d8f1768b44990a2bdb0). Reviewed By: krallin Differential Revision: D27805926 fbshipit-source-id: cf58a2e9b2ef92ca536f3b61b63fb42cfb1ec940
2021-04-16 12:25:01 +03:00
"quiet_stream",
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
"reachabilityindex",
"reachabilityindex/common",
"reachabilityindex/if",
"reachabilityindex/skiplist",
"reachabilityindex/test-helpers",
"regenerate_hg_filenodes",
repo_derived_data: add new repo attribute to encapsulate derived data Summary: Add `repo_derived_data`. This is a new struct that encapsulates derived data configuration and lease operations, and will be used in the facet-based construction of repositories. Reviewed By: ahornby Differential Revision: D27169431 fbshipit-source-id: dee7c032deb93db8934736c111ba7238a6aaf935
2021-03-22 17:23:06 +03:00
"repo_attributes/repo_derived_data",
repo_identity: add new repo attribute to encapsulate identity Summary: Add `repo_identity`. This is a new struct that encapsulates repository identity and will be used in the facet-based construction of repositories. Reviewed By: ahornby Differential Revision: D27169445 fbshipit-source-id: 02a435bba54a633190c6d2e4316e86726aecfdf0
2021-03-22 17:23:06 +03:00
"repo_attributes/repo_identity",
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
"repo_client",
"repo_client/getbundle_response",
"repo_client/mononoke_repo",
"repo_client/obsolete",
"repo_client/remotefilelog",
"repo_client/repo_read_write_status",
"repo_client/reverse_filler_queue",
"repo_client/scribe_commit_queue",
"repo_client/streaming_clone",
"repo_client/unbundle",
"repo_client/wirepack",
repo_factory: add main repo factory Summary: Add a factory for building development and production repositories. This factory can be re-used to build many repositories, and they will share metadata database factories and blobstores if their configs match. Similarly, the factory will only load redacted blobs once per metadata database config, rather than once per repo. Reviewed By: krallin Differential Revision: D27323369 fbshipit-source-id: 951f7343af97f5e507b76fb822ad2e66f4d8f3bd
2021-04-07 23:59:27 +03:00
"repo_factory",
test_repo_factory: add factory for test repos Summary: Create a factory that can be used to build repositories in tests. The test repo factory will be kept in a separate crate to the production repo factory, so that it can depend on a smaller set of dependencies: just those needed for in-memory test repos. This should eventually help make compilation speeds faster for tests. A notable difference between the test repos produced by this factory and the ones produced by `blobrepo_factory` is that the new repos share the in-memory metadata database. This is closer to what we use in production, and in a couple of places it is relied upon and existing tests must use `dangerous_override` to make it happen. Reviewed By: ahornby Differential Revision: D27169441 fbshipit-source-id: 82541a2ae71746f5e3b1a2a8a19c46bf29dd261c
2021-03-25 17:32:21 +03:00
"repo_factory/test_repo_factory",
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
"repo_import",
"revset",
"revset/revset-test-helper",
"segmented_changelog",
"segmented_changelog/bench/concurrent_idmap",
segmented_changelog: split trait to separate crate Summary: Resolve a circular dependency whereby `BlobRepo` needs to depend on `Arc<dyn SegmentedChangelog>`, but the segmented changelog implementation depends on `BlobRepo`, by moving the trait definition to its own crate. Reviewed By: sfilipco Differential Revision: D27169423 fbshipit-source-id: 5bf7c632607dc8baba40d7a9d65e96e265d58496
2021-03-22 17:23:06 +03:00
"segmented_changelog/types",
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
"server",
"server/context",
"server/monitoring",
bump region2region QPS Summary: We need to bump SCS counters expressing Mononoke's QPS. They will look something like: `requests:mononoke:oregon:carolina` for requests coming from proxygen in prn and mononoke in frc. CSLB expects regions' full names. We're getting src region from proxygen as a header. Reviewed By: krallin Differential Revision: D27082868 fbshipit-source-id: 12accb8a9df5cf6a80c2c281d2f61ac1e68176d1
2021-03-22 20:10:53 +03:00
"server/qps",
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
"server/repo_listener",
"server/session_id",
"sshrelay",
mononoke: start moving streaming changelog logic to rust Summary: Our current straming changelog updater logic is written in python, and it has a few downsides: 1) It writes directly to manifold, which means it bypasses all the multiplexed blobstore logic... 2) ...more importantly, we can't write to non-manifold blobstores at all. 3) There are no tests for the streaming changelogs This diff moves the logic of initial creation of streaming changelog entry to rust, which should fix the issues mentioned above. I want to highligh that this implementation only works for the initial creation case i.e. when there are no entries in the database. Next diffs will add incremental updates functionality. Reviewed By: krallin Differential Revision: D27008485 fbshipit-source-id: d9583bb1b98e5c4abea11c0a43c42bc673f8ed48
2021-03-13 01:45:03 +03:00
"streaming_clone",
autocargo v1: reformating of oss-dependencies, workspace and patch sections and thrift files to match v2 Summary: For dependencies V2 puts "version" as the first attribute of dependency or just after "package" if present. Workspace section is after patch section in V2 and since V2 autoformats patch section then the third-party/rust/Cargo.toml manual entries had to be formatted manually since V1 takes it as it is. The thrift files are to have "generated by autocargo" and not only "generated" on their first line. This diff also removes some previously generated thrift files that have been incorrectly left when the corresponding Cargo.toml was removed. Reviewed By: ikostia Differential Revision: D26618363 fbshipit-source-id: c45d296074f5b0319bba975f3cb0240119729c92
2021-02-26 02:09:13 +03:00
"tests/fixtures",
"tests/utils",
"tests/write_stub_log_entry",
"time_window_counter",
"tunables",
"tunables/tunables-derive",
"unbundle_replay",
"walker",
]
Reference in New Issue Copy Permalink