sapling/cmds/admin
Thomas Orozco f9360cab9d mononoke/filestore: incorporate in Mononoke
Summary:
NOTE: This isn't 100% complete yet. I have a little more work to do around the aliasverify binary, but I think it'll make sense to rework this a little bit with the Filestore anyway.

This patch incorporates the Filestore throughout Mononoke. At this time, what this means is:

- Blobrepo methods return streams of `FileBytes`.
- Various callsites that need access to `FileBytes` call `concat2` on those streams.

This also eliminates the Sha256 aliasing code that we had written for LFS and replaces it with a Filestore-based implementation.

However, note that this does _not_ change how files submitted through `unbundle` are written to blobstores right now. Indeed, those contents are passed into the Filestore through `store_bytes`, which doesn't do chunking. This is intentional since it lets us use LFS uploads as a testbed for chunked storage before turning it on for everything else (also, chunking those requires further refactoring of content uploads, since right now they don't expect the `ContentId` to come back through a Future).

The goal of doing it this way is to make the transition simpler. In other words, this diff doesn't change anything functionally — it just updates the underlying API we use to access files. This is also important to get a smooth release: it we had new servers that started chunking things while old servers tried to read them, things would be bad. Doing it this way ensures that doesn't happen.

This means that streaming is there, but it's not being leveraged just yet. I'm planning to do so in a separate diff, starting with the LFS read and write endpoints in

Reviewed By: farnz

Differential Revision: D16440671

fbshipit-source-id: 02ae23783f38da895ee3052252fa6023b4a51979
2019-07-31 05:19:40 -07:00
..
blacklist.rs mononoke: convert DB connection instantiation to future 2019-07-16 03:17:58 -07:00
blobstore_fetch.rs mononoke: don't require MononokeId impls to know how to recompute themselves from a value 2019-07-31 05:19:36 -07:00
bonsai_fetch.rs mononoke: refactor the admin tool into components 2019-05-21 12:25:59 -07:00
bookmarks_manager.rs mononoke: make admin tool support bookmark deletion 2019-06-21 02:35:27 -07:00
cmdargs.rs mononoke: refactor the admin tool into components 2019-05-21 12:25:59 -07:00
common.rs mononoke: Rename Bookmark to BookmarkName 2019-05-21 12:26:02 -07:00
content_fetch.rs mononoke/filestore: incorporate in Mononoke 2019-07-31 05:19:40 -07:00
hash_convert.rs mononoke: refactor the admin tool into components 2019-05-21 12:25:59 -07:00
hg_changeset.rs mononoke: refactor the admin tool into components 2019-05-21 12:25:59 -07:00
hg_sync.rs mononoke: convert DB connection instantiation to future 2019-07-16 03:17:58 -07:00
main.rs mononoke: make admin tool capable of fetching non-manifold blobstores 2019-07-12 10:50:50 -07:00
public_phases.rs mononoke: convert DB connection instantiation to future 2019-07-16 03:17:58 -07:00
skiplist_subcommand.rs mononoke: improve memory usage on mononoke startup and reduce number of small allocations 2019-07-19 04:30:26 -07:00