sapling/eden
Meyer Jacobs 53b9b6ec57 scmstore: evict EdenApi fetches to disk concurrently
Summary:
Use the new async `files_attrs` method to concurrently fetch files from EdenApi, write them to disk, and read them back as a mmap-ed `LazyFile`.

Also remove scmstore prefetch chunking with the previous approach required.

Previously, we fetched all the requested files from EdenApi into memory as a batch, then wrote them to disk afterward. This caused OOMs for extremely large fetches, and required chunking scmstore prefetches, which had a negative performance impact.

Reviewed By: DurhamG

Differential Revision: D31445678

fbshipit-source-id: 9a2e1476fb8ddfcd546a5e0b501cc91cc2a97303
2021-10-13 10:59:01 -07:00
..
fs Separate constructor for passing spawner 2021-10-12 18:35:11 -07:00
hg-server mononoke: remove edenapi_server 2021-10-13 09:45:20 -07:00
integration suppress errors in fbcode/eden - batch 1 2021-10-12 13:08:00 -07:00
locale add a copyright header to glibc_en.po 2019-04-26 14:38:27 -07:00
mononoke mononoke: remove edenapi_server 2021-10-13 09:45:20 -07:00
scm scmstore: evict EdenApi fetches to disk concurrently 2021-10-13 10:59:01 -07:00
test_support test_support: canonicalize the temporary directory path 2021-08-16 16:08:45 -07:00
test-data fix fsck snapshot integration tests 2021-07-14 16:20:04 -07:00
.gitignore eden: wire up mac contbuild 2019-02-05 21:52:30 -08:00
Eden.project.toml Eden.project.toml file for Nuclide 2018-04-26 11:05:23 -07:00