sapling/eden/mononoke/blobstore
Thomas Orozco ce0af2d591 mononoke/virtually_sharded_blobstore: deduplicate puts based on data being put
Summary:
This updates the virtually_sharded_blobstore to deduplicate puts only if the
data being put is actually the data we have put in the past. This is done by
keeping track of the hash of things we've put in the presence cache.

This has 2 benefits:

- This is safer. We only dedupe puts we 100% know succeeded (because this
  particular instance was the one to attempt the put).
- This is creates less surprises, notably it lets us overwrite data in the
  backing store (if we are writing something different).

Reviewed By: StanislavGlebik

Differential Revision: D22392809

fbshipit-source-id: d76a49baa9a5749b0fb4865ee1fc1aa5016791bc
2020-07-06 12:10:46 -07:00
..
blobstore_stats mononoke: Add logging blobstore 2020-05-15 10:28:31 -07:00
cacheblob Switch Blobstore to new-style futures 2020-06-26 03:54:42 -07:00
chaosblob Switch Blobstore to new-style futures 2020-06-26 03:54:42 -07:00
delayblob Switch Blobstore to new-style futures 2020-06-26 03:54:42 -07:00
factory eden: remove unused Rust dependencies 2020-06-17 17:55:03 -07:00
fileblob Switch Blobstore to new-style futures 2020-06-26 03:54:42 -07:00
if cargo_from_buck: Hide generated code from rustfmt 2020-06-10 19:29:49 -07:00
logblob Switch Blobstore to new-style futures 2020-06-26 03:54:42 -07:00
memblob Switch Blobstore to new-style futures 2020-06-26 03:54:42 -07:00
multiplexedblob Switch Blobstore to new-style futures 2020-06-26 03:54:42 -07:00
packblob mononoke: fix unused imports 2020-06-29 03:22:11 -07:00
prefixblob mononoke: fix unused imports 2020-06-29 03:22:11 -07:00
readonlyblob Switch Blobstore to new-style futures 2020-06-26 03:54:42 -07:00
redactedblobstore Switch Blobstore to new-style futures 2020-06-26 03:54:42 -07:00
samplingblob mononoke: fix unused imports 2020-06-29 03:22:11 -07:00
sqlblob Support BlobstoreWithLink in Sqlblob 2020-06-26 03:54:42 -07:00
src Switch Blobstore to new-style futures 2020-06-26 03:54:42 -07:00
test Switch Blobstore to new-style futures 2020-06-26 03:54:42 -07:00
throttledblob Switch Blobstore to new-style futures 2020-06-26 03:54:42 -07:00
virtually_sharded_blobstore mononoke/virtually_sharded_blobstore: deduplicate puts based on data being put 2020-07-06 12:10:46 -07:00
Cargo.toml Switch Blobstore to new-style futures 2020-06-26 03:54:42 -07:00