facebook/sapling
1
1
Fork 0
mirror of https://github.com/facebook/sapling.git synced 2024-10-10 16:57:49 +03:00
Code Issues Projects Releases Wiki Activity
be35ea0a6c
sapling/eden/scm/lib/dag/Cargo.toml

63 lines
1.4 KiB
TOML
Raw Normal View History

dag: add a library Summary: The scmdag library is going to have things related to the commit graph. Reviewed By: sfilipco Differential Revision: D15004984 fbshipit-source-id: f274cceeabae4a57985763216572f7cd055f8e07
2019-04-26 02:59:48 +03:00
[package]
name = "dag"
version = "0.1.0"
edition = "2018"
dag: add CloneData Summary: This is the object that will be used to bootstrap a Dag after a clone. Reviewed By: quark-zju Differential Revision: D24808328 fbshipit-source-id: 2c7e97c027c84a11e8716f2e288500474990169b
2020-11-11 03:45:19 +03:00
[features]
dag: add indexedlog feature to gate out indexedlog Summary: In the future we'd like to allow building the dag crate without the indexedlog portion. This diff adds support for that. Reviewed By: DurhamG Differential Revision: D25769054 fbshipit-source-id: eb5a200841f878836a9f68e65e7d50be7e6b9a79
2021-01-27 04:08:20 +03:00
default = ["for-tests", "indexedlog-backend"]
dag: add CloneData Summary: This is the object that will be used to bootstrap a Dag after a clone. Reviewed By: quark-zju Differential Revision: D24808328 fbshipit-source-id: 2c7e97c027c84a11e8716f2e288500474990169b
2020-11-11 03:45:19 +03:00
for-tests = ["quickcheck"]
dag: add indexedlog feature to gate out indexedlog Summary: In the future we'd like to allow building the dag crate without the indexedlog portion. This diff adds support for that. Reviewed By: DurhamG Differential Revision: D25769054 fbshipit-source-id: eb5a200841f878836a9f68e65e7d50be7e6b9a79
2021-01-27 04:08:20 +03:00
indexedlog-backend = ["indexedlog", "fs2", "tempfile"]
dag: add CloneData Summary: This is the object that will be used to bootstrap a Dag after a clone. Reviewed By: quark-zju Differential Revision: D24808328 fbshipit-source-id: 2c7e97c027c84a11e8716f2e288500474990169b
2020-11-11 03:45:19 +03:00
dag: add a library Summary: The scmdag library is going to have things related to the commit graph. Reviewed By: sfilipco Differential Revision: D15004984 fbshipit-source-id: f274cceeabae4a57985763216572f7cd055f8e07
2019-04-26 02:59:48 +03:00
[dependencies]
dag: move dag subset used by edenapi-types to a separate crate Summary: In the future we want to build dag without indexedlog dep for Mononoke use-case. One of the problem is the ToWire trait implemented on dag::Id by edenapi-types. Within buck, the dag crate will have 2 targets: dag and dag-lite (no indexedlog). They are incompatible meaning that edenapi-types depending on dag-lite will not provide Id::to_wire for crates using dag, or vice-versa. To solve that, we move the Id and other types to a separate crate that only has one buck target so edenapi-types, and segmented_changelog from Mononoke can depend on it without issues. This also makes edenapi-types more lightweight. Reviewed By: sfilipco Differential Revision: D25857917 fbshipit-source-id: d3e15a2b6638cc6e15171a1e9bc37362e03df583
2021-01-27 04:08:20 +03:00
dag-wire-types = { path = "dag-wire-types" }
dag: make ASCII -> MemNameDag a public API Summary: It seems handy to construct a Dag just from ASCII. Therefore move it to a public interface. Reviewed By: sfilipco Differential Revision: D21486525 fbshipit-source-id: de7f4b8dfcbcc486798928d4334c655431373276
2020-05-11 19:45:32 +03:00
drawdag = { path = "../drawdag" }
dag: add indexedlog feature to gate out indexedlog Summary: In the future we'd like to allow building the dag crate without the indexedlog portion. This diff adds support for that. Reviewed By: DurhamG Differential Revision: D25769054 fbshipit-source-id: eb5a200841f878836a9f68e65e7d50be7e6b9a79
2021-01-27 04:08:20 +03:00
indexedlog = { path = "../indexedlog", optional = true }
dag: switch from bytes to minibytes Summary: The APIs are compatible so the switch is straightforward. Reviewed By: DurhamG Differential Revision: D19818713 fbshipit-source-id: 504e9149567c90eb661804e0dad20580a401aa76
2020-02-28 20:19:41 +03:00
minibytes = { path = "../minibytes" }
dag: add async interface for NameSet Summary: Change the main API of NameSet to async. Use the `nonblocking` crate to bridge the sync and async world for compatibility. Future changes will migrate Iterator to async Stream. Reviewed By: sfilipco Differential Revision: D24806696 fbshipit-source-id: f72571407a5747a4eabe096dada288656c9d426e
2020-12-10 23:32:23 +03:00
nonblocking = { path = "../nonblocking" }
dag: add a library Summary: The scmdag library is going to have things related to the commit graph. Reviewed By: sfilipco Differential Revision: D15004984 fbshipit-source-id: f274cceeabae4a57985763216572f7cd055f8e07
2019-04-26 02:59:48 +03:00
vlqencoding = { path = "../vlqencoding" }
Switch from failure::Fail trait to std::error::Error for errors Summary: This diff replaces eden's dependencies on failure::Error with anyhow::Error. Failure's error type requires all errors to have an implementation of failure's own failure::Fail trait in order for cause chains and backtraces to work. The necessary methods for this functionality have made their way into the standard library error trait, so modern error libraries build directly on std::error::Error rather than something like failure::Fail. Once we are no longer tied to failure 0.1's Fail trait, different parts of the codebase will be free to use any std::error::Error-based libraries they like while still working nicely together. Reviewed By: xavierd Differential Revision: D18576093 fbshipit-source-id: e2d862b659450f2969520d9b74877913fabb2e5d
2019-11-22 19:51:58 +03:00
anyhow = "1.0.20"
dag: add async interface for NameSet Summary: Change the main API of NameSet to async. Use the `nonblocking` crate to bridge the sync and async world for compatibility. Future changes will migrate Iterator to async Stream. Reviewed By: sfilipco Differential Revision: D24806696 fbshipit-source-id: f72571407a5747a4eabe096dada288656c9d426e
2020-12-10 23:32:23 +03:00
async-trait = "0.1"
dag: add a flag storing whether a segment has roots Summary: This would allow us to implement the fast path in `children`. This is a breaking change in file format. But we haven't been really using the segmented dag format in production yet. So it's fine to not have a migration path. This potentailly makes the future format migration easier since there are 7 bits left to use. Reviewed By: markbt Differential Revision: D16976382 fbshipit-source-id: 0110c03d4ff2ce0a882b3fb8ce8ee12d2087f41f
2019-09-14 05:26:34 +03:00
bitflags = "1"
dag: add a library Summary: The scmdag library is going to have things related to the commit graph. Reviewed By: sfilipco Differential Revision: D15004984 fbshipit-source-id: f274cceeabae4a57985763216572f7cd055f8e07
2019-04-26 02:59:48 +03:00
byteorder = "1.2.7"
dag: add indexedlog feature to gate out indexedlog Summary: In the future we'd like to allow building the dag crate without the indexedlog portion. This diff adds support for that. Reviewed By: DurhamG Differential Revision: D25769054 fbshipit-source-id: eb5a200841f878836a9f68e65e7d50be7e6b9a79
2021-01-27 04:08:20 +03:00
fs2 = { version = "0.4.3", optional = true }
dag: use Stream interface for NameSet iteration Summary: This makes NameSet more friendly for async use-cases, interface-wise. Reviewed By: sfilipco Differential Revision: D24806695 fbshipit-source-id: 6e640ba2666872a9128d6460e8b53d6a0e595e56
2020-12-10 23:32:23 +03:00
futures = "0.3"
dag: add logic to build high level segments Summary: High-level segments are built on top of lower level segments. We simply scan through them, and greedily pick the longest ones. Reviewed By: sfilipco Differential Revision: D15055348 fbshipit-source-id: 3b72dc766abd46669b787187b7d1d5f7171c026a
2019-05-03 23:30:29 +03:00
indexmap = "1.0.1"
renderdag: move to dag Summary: This allows dag to use renderdag in tests to verify graph result. Previously it was hard because dag <-> renderdag would form circular dependency. It also make it possible to implement more efficient and integrated fast paths for graph rendering. Reviewed By: sfilipco Differential Revision: D22970570 fbshipit-source-id: 526497339bd7aa8898d1af4aa9cf6d2a6797aae0
2020-08-20 01:33:57 +03:00
itertools = "0.8"
dag: add NameDag::snapshot_dag Summary: Make it possible to snapshot a Dag. This is useful for cases where another struct wants access to the Dag without lifetimes. Namely, the LazySet can might want to keep a snapshot of Dag. Reviewed By: sfilipco Differential Revision: D22970568 fbshipit-source-id: 508c38d3ffac2ffcd2e682578c3c5e5787ea3bcf
2020-08-21 03:13:50 +03:00
parking_lot = "0.10"
dag: add CloneData Summary: This is the object that will be used to bootstrap a Dag after a clone. Reviewed By: quark-zju Differential Revision: D24808328 fbshipit-source-id: 2c7e97c027c84a11e8716f2e288500474990169b
2020-11-11 03:45:19 +03:00
quickcheck = { version = "0.9", optional = true }
dag: abstractions around remote protocols Summary: In the future the client will have a sparse IdMap, and needs the server (who has a complete IdMap)'s help to convert between Id and Slice (commit hash) for commits in the MASTER group. This diff defines basic abstractions for communications between a sparse IdMap and a complete IdMap. The basic flows are: To convert Id to Slice: Id -> Request --> Response -> Slice To convert Slice to Id: Slice -> Request --> Response -> Id (`->`: client-side; `-->`: server-side) Reviewed By: sfilipco Differential Revision: D18664206 fbshipit-source-id: 93a6b671be30ab1247c71d814817a2ea06b6bc66
2019-12-18 06:25:48 +03:00
serde = { version = "1", features = ["derive"] }
dag: add indexedlog feature to gate out indexedlog Summary: In the future we'd like to allow building the dag crate without the indexedlog portion. This diff adds support for that. Reviewed By: DurhamG Differential Revision: D25769054 fbshipit-source-id: eb5a200841f878836a9f68e65e7d50be7e6b9a79
2021-01-27 04:08:20 +03:00
tempfile = { version = "3", optional = true }
dag: use concrete error types Summary: This is more complex than previous libraries, mainly because `dag` defines APIs (traits) used by other code, which might raise error type not interested by `dag` itself. `BackendError::Other(anyhow::Error)` is currently used to capture types that do not fit in `dag`'s predefined error types. Reviewed By: sfilipco Differential Revision: D22883865 fbshipit-source-id: 3699e14775f335620eec28faa9a05c3cc750e1d1
2020-08-06 22:29:53 +03:00
thiserror = "1"
dag: add some tracing spans Summary: This is useful to investigate internals of dag calculations. Reviewed By: sfilipco Differential Revision: D23095473 fbshipit-source-id: 4750c1b4ffad32b1317051d17db9659aaaed59c4
2020-08-21 03:33:07 +03:00
tracing = "0.1"
dag: add a library Summary: The scmdag library is going to have things related to the commit graph. Reviewed By: sfilipco Differential Revision: D15004984 fbshipit-source-id: f274cceeabae4a57985763216572f7cd055f8e07
2019-04-26 02:59:48 +03:00
[dev-dependencies]
dag: add indexedlog feature to gate out indexedlog Summary: In the future we'd like to allow building the dag crate without the indexedlog portion. This diff adds support for that. Reviewed By: DurhamG Differential Revision: D25769054 fbshipit-source-id: eb5a200841f878836a9f68e65e7d50be7e6b9a79
2021-01-27 04:08:20 +03:00
# Note: bindag depends on "dag" with features!
dag: move bindag from benches to a separate crate Summary: This allows bindag to be used outside benches. Reviewed By: sfilipco Differential Revision: D19503374 fbshipit-source-id: 131061f7d1d28125875a86afc330dbb9634249cf
2020-01-23 06:26:26 +03:00
bindag = { path = "bindag" }
dag: move dag subset used by edenapi-types to a separate crate Summary: In the future we want to build dag without indexedlog dep for Mononoke use-case. One of the problem is the ToWire trait implemented on dag::Id by edenapi-types. Within buck, the dag crate will have 2 targets: dag and dag-lite (no indexedlog). They are incompatible meaning that edenapi-types depending on dag-lite will not provide Id::to_wire for crates using dag, or vice-versa. To solve that, we move the Id and other types to a separate crate that only has one buck target so edenapi-types, and segmented_changelog from Mononoke can depend on it without issues. This also makes edenapi-types more lightweight. Reviewed By: sfilipco Differential Revision: D25857917 fbshipit-source-id: d3e15a2b6638cc6e15171a1e9bc37362e03df583
2021-01-27 04:08:20 +03:00
dag-wire-types = { path = "dag-wire-types", features = ["for-tests"] }
dag: enable dev-logger Summary: This makes `RUST_LOG` effective during `cargo test`. Reviewed By: sfilipco Differential Revision: D25622972 fbshipit-source-id: b1b28e8d3bb397055815b4ac7cda8fbfac7ea0eb
2020-12-19 03:54:48 +03:00
dev-logger = { path = "../dev-logger" }
dag: add indexedlog feature to gate out indexedlog Summary: In the future we'd like to allow building the dag crate without the indexedlog portion. This diff adds support for that. Reviewed By: DurhamG Differential Revision: D25769054 fbshipit-source-id: eb5a200841f878836a9f68e65e7d50be7e6b9a79
2021-01-27 04:08:20 +03:00
fs2 = "0.4.3"
indexedlog = { path = "../indexedlog" }
dag: benchmark for inprocess iddag serialization Summary: I am wondering whether we should customize the serialization format for the InProcessStore. I want to have a basis for the comparison before I proceed. Reviewed By: quark-zju Differential Revision: D24580273 fbshipit-source-id: d3ddfdc029dbdd84f60acace06fddc80b4d005f4
2020-10-29 00:54:38 +03:00
mincode = { path = "../mincode" }
spanset: add a benchmark of set operations Summary: This would provide some data about changes around SpanSet. Reviewed By: sfilipco Differential Revision: D15023652 fbshipit-source-id: 4cff7d1876fe20cd876f26926f31e018b6c88fd9
2019-04-26 02:59:50 +03:00
minibench = { path = "../minibench" }
dag: Add InProcessStore as iddagstore Summary: First 6 methods implemented from the IdDagStore trait for the InProcessStore. Any suggestions welcome. Reviewed By: quark-zju Differential Revision: D20499228 fbshipit-source-id: cb536a3a0136077ada78934d82a25d079a5bc809
2020-03-24 23:54:12 +03:00
once_cell = "1"
dag: add indexedlog feature to gate out indexedlog Summary: In the future we'd like to allow building the dag crate without the indexedlog portion. This diff adds support for that. Reviewed By: DurhamG Differential Revision: D25769054 fbshipit-source-id: eb5a200841f878836a9f68e65e7d50be7e6b9a79
2021-01-27 04:08:20 +03:00
quickcheck = "0.9"
dag: make DagAlgorithm async Summary: Update DagAlgorithm and all its users to async. This makes it easier to make IdConvert async. Reviewed By: sfilipco Differential Revision: D25345236 fbshipit-source-id: d6cf76723356bd0eb81822843b2e581de1e3290a
2020-12-10 23:32:23 +03:00
tokio = { version = "0.2", features = ["full"] }
renderdag: move to dag Summary: This allows dag to use renderdag in tests to verify graph result. Previously it was hard because dag <-> renderdag would form circular dependency. It also make it possible to implement more efficient and integrated fast paths for graph rendering. Reviewed By: sfilipco Differential Revision: D22970570 fbshipit-source-id: 526497339bd7aa8898d1af4aa9cf6d2a6797aae0
2020-08-20 01:33:57 +03:00
unicode-width = "0.1.7"
spanset: add a benchmark of set operations Summary: This would provide some data about changes around SpanSet. Reviewed By: sfilipco Differential Revision: D15023652 fbshipit-source-id: 4cff7d1876fe20cd876f26926f31e018b6c88fd9
2019-04-26 02:59:50 +03:00
[[bench]]
name = "spanset"
harness = false
dag: add benchmark about various "segment size" choices Summary: Add a benchmark testing various segment sizes - time to build segments, log size, and ancestor calcuation performance. An initial output looks like: building segment_size=4 0.223 ms segments: [34859, 10972, 3156, 834, 218, 55, 13, 3] log len: 1194609 ancestor calcuation segment_size=4 1.510 s building segment_size=8 0.193 ms segments: [34859, 5472, 737, 95, 11, 1] log len: 958272 ancestor calcuation segment_size=8 1.630 s building segment_size=10 0.213 ms segments: [34859, 4339, 460, 46, 4] log len: 918468 ancestor calcuation segment_size=10 1.739 s building segment_size=12 0.187 ms segments: [34859, 3613, 316, 26, 2] log len: 893901 ancestor calcuation segment_size=12 1.934 s building segment_size=14 0.202 ms segments: [34859, 3034, 228, 16, 1] log len: 873677 ancestor calcuation segment_size=14 2.311 s building segment_size=16 0.199 ms segments: [34859, 2601, 172, 10] log len: 858211 ancestor calcuation segment_size=16 2.139 s building segment_size=18 0.193 ms segments: [34859, 2280, 133, 7] log len: 847505 ancestor calcuation segment_size=18 2.301 s building segment_size=20 0.175 ms segments: [34859, 2043, 105, 5] log len: 839458 ancestor calcuation segment_size=20 2.335 s building segment_size=22 0.187 ms segments: [34859, 1847, 85, 3] log len: 832764 ancestor calcuation segment_size=22 2.500 s building segment_size=24 0.206 ms segments: [34859, 1668, 71, 2] log len: 826775 ancestor calcuation segment_size=24 2.570 s building segment_size=32 0.194 ms segments: [34859, 1230, 38, 1] log len: 811701 ancestor calcuation segment_size=32 3.091 s building segment_size=64 0.215 ms segments: [34859, 598, 9] log len: 790230 ancestor calcuation segment_size=64 4.215 s building segment_size=128 0.281 ms segments: [34859, 293, 2] log len: 779475 ancestor calcuation segment_size=128 7.573 s It seems segment size = 8 to 20 might be a reasonable choice. Reviewed By: sfilipco Differential Revision: D16660078 fbshipit-source-id: f8af64c703ce0209b9b4c09112c9bdc4a1371172
2019-08-10 02:12:58 +03:00
[[bench]]
dag: add dag_ops benchmark Summary: This will guide optimizations. Right now, gca_one "large sets" can take forever to run. The code to build the mozilla DAG was extracted to a single file to be sharable. Reviewed By: sfilipco Differential Revision: D16992730 fbshipit-source-id: 1538f5b0098cd06cb179bd556df285055e1d62b6
2019-09-14 05:26:34 +03:00
name = "segment_sizes"
harness = false
[[bench]]
name = "dag_ops"
dag: add benchmark about various "segment size" choices Summary: Add a benchmark testing various segment sizes - time to build segments, log size, and ancestor calcuation performance. An initial output looks like: building segment_size=4 0.223 ms segments: [34859, 10972, 3156, 834, 218, 55, 13, 3] log len: 1194609 ancestor calcuation segment_size=4 1.510 s building segment_size=8 0.193 ms segments: [34859, 5472, 737, 95, 11, 1] log len: 958272 ancestor calcuation segment_size=8 1.630 s building segment_size=10 0.213 ms segments: [34859, 4339, 460, 46, 4] log len: 918468 ancestor calcuation segment_size=10 1.739 s building segment_size=12 0.187 ms segments: [34859, 3613, 316, 26, 2] log len: 893901 ancestor calcuation segment_size=12 1.934 s building segment_size=14 0.202 ms segments: [34859, 3034, 228, 16, 1] log len: 873677 ancestor calcuation segment_size=14 2.311 s building segment_size=16 0.199 ms segments: [34859, 2601, 172, 10] log len: 858211 ancestor calcuation segment_size=16 2.139 s building segment_size=18 0.193 ms segments: [34859, 2280, 133, 7] log len: 847505 ancestor calcuation segment_size=18 2.301 s building segment_size=20 0.175 ms segments: [34859, 2043, 105, 5] log len: 839458 ancestor calcuation segment_size=20 2.335 s building segment_size=22 0.187 ms segments: [34859, 1847, 85, 3] log len: 832764 ancestor calcuation segment_size=22 2.500 s building segment_size=24 0.206 ms segments: [34859, 1668, 71, 2] log len: 826775 ancestor calcuation segment_size=24 2.570 s building segment_size=32 0.194 ms segments: [34859, 1230, 38, 1] log len: 811701 ancestor calcuation segment_size=32 3.091 s building segment_size=64 0.215 ms segments: [34859, 598, 9] log len: 790230 ancestor calcuation segment_size=64 4.215 s building segment_size=128 0.281 ms segments: [34859, 293, 2] log len: 779475 ancestor calcuation segment_size=128 7.573 s It seems segment size = 8 to 20 might be a reasonable choice. Reviewed By: sfilipco Differential Revision: D16660078 fbshipit-source-id: f8af64c703ce0209b9b4c09112c9bdc4a1371172
2019-08-10 02:12:58 +03:00
harness = false
dag: benchmark for inprocess iddag serialization Summary: I am wondering whether we should customize the serialization format for the InProcessStore. I want to have a basis for the comparison before I proceed. Reviewed By: quark-zju Differential Revision: D24580273 fbshipit-source-id: d3ddfdc029dbdd84f60acace06fddc80b4d005f4
2020-10-29 00:54:38 +03:00
[[bench]]
name = "inprocess_iddag_serde"
harness = false
Reference in New Issue Copy Permalink