sapling/eden/scm/lib
Meyer Jacobs 75105421ce edenapi: Hide edenapi wire types from externally visible API
Summary:
Introduce separate wire types to allow protocol evolution and client API changes to happen independently.

* Duplicate `*Request`, `*Entry`, `Key`, `Parents`, `RepoPathBuf`, `HgId`, and `revisionstore_types::Metadata` types into the `wire` module. The versions in the `wire` module are required to have proper `serde` annotations, `Serialize` / `Deserialize` implementations, etc. These have been removed from the original structs.
* Introduce infallible conversions from "API types" to "wire types" with the `ToWire` trait and fallible conversions from "wire types" to "API types" with the `ToApi`. API -> wire conversions should never fail in a binary that builds succesfully, but wire -> API conversions can fail in the case that the server and client are using different versions of the library. This will cause, for instance, a newly-introduced enum variant used by the client to be deserialized into the catch-all `Unknown` variant on the server, which won't generally have a corresponding representation in the API type.
* Cleanup: remove `*Response` types, which are no longer used anywhere.
* Introduce a `map` method on `Fetch` struct which allows a fallible conversion function to be used to convert a `Fetch<T>` to a `Fetch<U>`. This function is used in the edenapi client implementation to convert from wire types to API types.
* Modify `edenapi_server` to convert from API types to wire types.
* Modify `edenapi_cli` to convert back to wire types before serializing responses to disk.
* Modify `make_req` to use `ToWire` for converting API structs from the `json` module to wire structs.
* Modify `read_res` to use `ToApi` to convert deserialized wire types to API types with the necessary methods for investigating the contents (`.data()`, primarily). It will print an error message to stderr if it encounters a wire type which cannot be converted into the corresponding API type.
* Add some documentation about protocol conventions to the root of the `wire` module.

Reviewed By: kulshrax

Differential Revision: D23224705

fbshipit-source-id: 88f8addc403f3a8da3cde2aeee765899a826446d
2020-09-23 17:27:08 -07:00
..
async-runtime Prepare for rustfmt 2.0 2020-09-07 20:47:59 -07:00
auth auth: allow specifying a CA certificate bundle 2020-07-16 19:48:36 -07:00
backingstore revisionstore: add refresh function 2020-09-17 10:16:03 -07:00
blackbox Prepare for rustfmt 2.0 2020-09-07 20:47:59 -07:00
bookmarkstore types: address clippy warnings 2020-03-16 14:58:21 -07:00
cdatapack cmake: always build support for the EdenSCM backing store 2019-11-22 13:00:07 -08:00
clib cmake: always build support for the EdenSCM backing store 2019-11-22 13:00:07 -08:00
clidispatch Prepare for rustfmt 2.0 2020-09-07 20:47:59 -07:00
cliparser debug: introduce error classification and metadata propagation 2020-07-15 10:03:10 -07:00
commitcloudsubscriber improve scm daemon checks and check workspace name as well 2020-09-18 14:01:11 -07:00
commitstore/bench-serialize cargo: bump serde_cbor to 0.11 2020-02-21 14:08:43 -08:00
configparser third-party/rust: import async-compression + update zstd 2020-09-15 07:59:53 -07:00
cpython-async cpython-async: expose Rust Future to Python 2020-09-21 13:28:07 -07:00
cpython-ext cpython-async: expose Rust Stream to Python 2020-09-21 13:28:07 -07:00
dag Update formatter to rustfmt 2.0 2020-09-09 07:52:34 -07:00
dev-logger dev-logger: a simple library to enable env_logger for testing 2020-03-10 14:16:38 -07:00
drawdag Prepare for rustfmt 2.0 2020-09-07 20:47:59 -07:00
edenapi edenapi: Hide edenapi wire types from externally visible API 2020-09-23 17:27:08 -07:00
edenfs-client fix the Windows build 2020-09-09 10:39:35 -07:00
encoding Move fb-mercurial sources into an eden/scm subdirectory. 2019-11-13 16:04:48 -08:00
fsinfo Update formatter to rustfmt 2.0 2020-09-09 07:52:34 -07:00
fsyncglob hgcommands: add debugfsync 2020-08-27 18:26:03 -07:00
hg-http hg-http: optionally print stats 2020-09-23 17:19:28 -07:00
hg-metrics metrics: crate for collecting metrics 2020-09-09 17:35:48 -07:00
hgcommands version: print EdenSCM instead of Mercurial 2020-09-15 21:03:59 -07:00
hgcommits Prepare for rustfmt 2.0 2020-09-07 20:47:59 -07:00
hgtime hgtime: address clippy warnings 2020-03-16 14:58:22 -07:00
http-client http-client: add stats reporting hook 2020-09-09 17:35:48 -07:00
indexedlog Update formatter to rustfmt 2.0 2020-09-09 07:52:34 -07:00
linelog Move fb-mercurial sources into an eden/scm subdirectory. 2019-11-13 16:04:48 -08:00
lz4-pyframe Update formatter to rustfmt 2.0 2020-09-09 07:52:34 -07:00
manifest manifest: add testutil in core package 2020-01-14 11:49:52 -08:00
manifest-tree Update formatter to rustfmt 2.0 2020-09-09 07:52:34 -07:00
metalog Prepare for rustfmt 2.0 2020-09-07 20:47:59 -07:00
mincode Move fb-mercurial sources into an eden/scm subdirectory. 2019-11-13 16:04:48 -08:00
minibench mononoke/mercurial: make revlog crate OSS buildable 2020-04-08 09:49:11 -07:00
minibytes minibytes: address clippy warnings 2020-03-16 14:58:22 -07:00
mpatch Move fb-mercurial sources into an eden/scm subdirectory. 2019-11-13 16:04:48 -08:00
mpatch-sys use absolute includes for the native cext modules 2020-02-19 13:05:06 -08:00
mutationstore mutationstore: add a native path to calculate 'obsolete()' 2020-08-21 13:00:45 -07:00
nodemap Update formatter to rustfmt 2.0 2020-09-09 07:52:34 -07:00
pathmatcher Prepare for rustfmt 2.0 2020-09-07 20:47:59 -07:00
procinfo Update formatter to rustfmt 2.0 2020-09-09 07:52:34 -07:00
radixbuf radixbuf: use concrete error types 2020-08-06 12:31:57 -07:00
renderdag renderdag: move to dag 2020-08-21 13:00:45 -07:00
revisionstore edenapi: Hide edenapi wire types from externally visible API 2020-09-23 17:27:08 -07:00
revlogindex Update formatter to rustfmt 2.0 2020-09-09 07:52:34 -07:00
spawn-ext Update formatter to rustfmt 2.0 2020-09-09 07:52:34 -07:00
taggederror taggederror: Introduce taggederror-util for more ergonomic error tagging for eden error types. 2020-08-06 19:37:25 -07:00
taggederror-util taggederror: Introduce taggederror-util for more ergonomic error tagging for eden error types. 2020-08-06 19:37:25 -07:00
third-party build: rename third-party rust fbthrift crate 2020-08-26 12:26:21 -07:00
thrift-types thrift: update thrift types 2020-09-09 17:35:48 -07:00
tracing-collector Prepare for rustfmt 2.0 2020-09-07 20:47:59 -07:00
treestate Prepare for rustfmt 2.0 2020-09-07 20:47:59 -07:00
types edenapi: Hide edenapi wire types from externally visible API 2020-09-23 17:27:08 -07:00
util Prepare for rustfmt 2.0 2020-09-07 20:47:59 -07:00
version configparser: fix non-fb dependencies (#45) 2020-08-26 16:31:00 -07:00
vfs fsinfo: recognize EdenFS mounts on Windows 2020-08-12 15:47:49 -07:00
vlqencoding mutationstore: move MutationEntry type to types crate 2020-04-23 08:58:10 -07:00
workingcopy filesystem: add treestate walking logic 2020-04-24 13:58:53 -07:00
xdiff Prepare for rustfmt 2.0 2020-09-07 20:47:59 -07:00
xdiff-sys Update libra to latest revision 2020-07-16 21:10:44 -07:00
zstdelta third-party/rust: import async-compression + update zstd 2020-09-15 07:59:53 -07:00
zstore zstore: add simple caching 2020-05-01 14:24:52 -07:00
CMakeLists.txt cmake: do not compile configparser 2020-08-06 09:00:20 -07:00
README.md Move fb-mercurial sources into an eden/scm subdirectory. 2019-11-13 16:04:48 -08:00

lib

Any native code (C/C++/Rust) that Mercurial (either core or extensions) depends on should go here. Python code, or native code that depends on Python code (e.g. #include <Python.h> or use cpython) is disallowed.

As we start to convert more of Mercurial into Rust, and write new paths entrirely in native code, we'll want to limit our dependency on Python, which is why this barrier exists.

See also hgext/extlib/README.md, mercurial/cext/README.mb.

How do I choose between lib and extlib (and cext)?

If your code is native and doesn't depend on Python (awesome!), it goes here.

Otherwise, put it in hgext/extlib (if it's only used by extensions) or mercurial/cext (if it's used by extensions or core).