sapling/eden/mononoke/blobrepo
Simon Farnsworth 103b3116d4 Use filenodes where available to speed up derived data for merges
Summary:
Fetching all history of both filenodes to see if there's common history either side of a merge is wasteful, and in some megarepo work is causing long delays deriving merge changesets.

Where we have already derived filenodes for a given merge's ancestors, we can go faster; we can use the linknodes to determine the older of the two filenodes, and fetch only history for the newer of the two.

This is imperfect for the import use case, since filenodes depend on hgchangesets, and the batching in use at the moment prefers to generate all derived data of a given type before moving onto another type, but it's an improvement for cases where some filenodes are already derived (e.g. due to import of a repo with a similar history).

Reviewed By: StanislavGlebik

Differential Revision: D28796253

fbshipit-source-id: 5384b5d2841844794a518c321dbf995891374d3a
2021-06-03 02:33:40 -07:00
..
blobrepo_hg Update to Rust 1.52.1 2021-05-19 22:13:47 -07:00
blobsync thrift/lib/rust: update to Bytes 1.x 2021-05-20 09:44:41 -07:00
changeset_fetcher rust: remove patch for async-compression 2021-05-05 12:20:34 -07:00
common Use filenodes where available to speed up derived data for merges 2021-06-03 02:33:40 -07:00
errors mononoke: add mapping for megarepo 2021-05-11 02:54:01 -07:00
override rust: remove patch for async-compression 2021-05-05 12:20:34 -07:00
repo_blobstore rust: remove patch for async-compression 2021-05-05 12:20:34 -07:00
src blobrepo: delete BlobRepo::new_dangerous 2021-04-29 06:11:20 -07:00
test mononoke: initialize loggers, config, caching, tunables & runtime in MononokeMatches 2021-04-16 10:27:43 -07:00
Cargo.toml thrift/lib/rust: update to Bytes 1.x 2021-05-20 09:44:41 -07:00