mirror of
https://github.com/facebook/sapling.git
synced 2024-10-10 16:57:49 +03:00
ff10fff199
Summary: This adds support for chunking in the Filestore. To do so, this reworks writes to be a 2 stage process: - First, you prepare your write. This puts everything into place, but doesn't upload the aliases, backmappings, and the logical FileContents blob representing your file. If you're uploading a file that fits in a single chunk, preparing your writes effectively makes no blobstore changes. If you're uploading chunks, then you upload the individual chunks (those are uploaded essentially as if they were small files). - Then, you commit your write. At that point, prepared gave you `FileContents` that represent your write, and a set of aliases. To commit your write, you write the aliases, then the file contents, and then a backmapping. Note that we never create hierarchies when writing to the Filestore (i.e. chunked files always reference concrete chunks that contain file data), but that's not a guarantee we can rely on when reading. Indeed, since chunks and files are identical as far as blobstore storage is concerned, we have to handle the case where a chunked file references chunks that are themselves chunked (as I mentioned, we won't write it that way, but it could happen if we uploaded a file, then later on reduced the chunk size and wrote an identical file). Note that this diff also updates the FileContents enum and adds unimplemented methods there. These are all going away later in this stack (in the diff where I incorporate the Filestore into the rest of Mononoke). Reviewed By: StanislavGlebik Differential Revision: D16440678 fbshipit-source-id: 07187aa154f4fdcbd3b3faab7c0cbcb1f8a91217 |
||
|---|---|---|
| .. | ||
| if | ||
| mocks | ||
| src | ||
| Cargo.toml | ||