sapling/eden/fs
Adam Simpkins 983f454135 limit the number of tree prefetch operations that can run in parallel
Summary:
Add a config option to restrict the number of tree prefetches that can run in
parallel.  Without this applications that recursively walk a checkout tree can
end up spawning a huge number of asynchronous prefetch operations.  These
prefetch operations are quite expensive today, as we currently have to fetch
the full file contents in order to retrieve the file sizes.  A recursive
directory walk can end up building up a huge backlog of in-progress tree
prefetches.  This will slow down the directory walk, and it can take tens of
minutes to finish processing the prefetch backlog even after the directory
walk is aborted.

Reviewed By: chadaustin

Differential Revision: D19136685

fbshipit-source-id: cdc7a570d016fd7ca81a639cef83380b197acdfc
2019-12-20 16:14:19 -08:00
..
benchharness Tidy up license headers 2019-10-11 05:28:23 -07:00
config limit the number of tree prefetch operations that can run in parallel 2019-12-20 16:14:19 -08:00
fuse fix warnings in the macOS build 2019-12-20 16:14:17 -08:00
inodes limit the number of tree prefetch operations that can run in parallel 2019-12-20 16:14:19 -08:00
journal rename tracing to telemetry 2019-10-15 13:39:41 -07:00
model Add EdenMount diff to generate the ScmStatus 2019-12-10 14:07:24 -08:00
rocksdb Remove dead includes in eden 2019-10-11 16:45:01 -07:00
service make EdenMount::getRootTree return a future 2019-12-20 16:14:18 -08:00
sqlite fix a missing dependency in a CMakeLists.txt file 2019-11-21 21:43:54 -08:00
store kill ObjectStore::getBlobMetadata 2019-12-20 16:14:18 -08:00
takeover refactor the EDEN_BUG() macro 2019-11-22 15:38:33 -08:00
telemetry log to scuba upon automatic gc 2019-12-10 16:16:35 -08:00
testharness make EdenMount::getRootTree return a future 2019-12-20 16:14:18 -08:00
utils fix warnings in the macOS build 2019-12-20 16:14:17 -08:00
win kill ObjectStore::getBlobMetadata 2019-12-20 16:14:18 -08:00
CMakeLists.txt hg status tests for Eden Windows 2019-12-10 14:07:26 -08:00