Commit Graph

82875 Commits

Author SHA1 Message Date
Muir Manders
aba56cfd2e scmstore: kill "enableshim" flag
Summary: Kill scmstore.enableshim flag, always using scmstore over content store.

Reviewed By: sggutier

Differential Revision: D45556672

fbshipit-source-id: 159eb2bfa14a9870ac0a3931f18f654c638bcc3f
2023-06-25 23:58:14 -07:00
Muir Manders
a73edbc8b6 scmstore: fix LFS compat w/ Python LFS extension
Summary: This fixes compatibility if both the Python LFS extension and remotefilelog.lfs are enabled. In particular, if we find an LFS pointer in the non-LFS indexedlog storage (i.e. inserted by Python LFS extension when remotefilelog.lfs was not enabled), we now upgrade it to the the scmstore pointer store.

Reviewed By: quark-zju

Differential Revision: D46714084

fbshipit-source-id: 4761f1c05017897544b33b0c322d4c3bce81274d
2023-06-25 23:58:14 -07:00
Muir Manders
37bd20598f scmstore: add lfs "passthrough" mode
Summary: Tweak things so scmstore is compatible with the python lfs extension. In particular, if remotefilelog lfs support isn't enabled, don't treat lfs pointers specially (i.e. just store them as regular file data). This is what contentstore does, and it is required for compatibility tests that use remotefilelog with the python extension. (This is not used in production.)

Reviewed By: zzl0

Differential Revision: D46674241

fbshipit-source-id: faa5b5b992a7e2cc61bf98ba2919753e9825bb0a
2023-06-25 23:58:14 -07:00
Muir Manders
d64ce8a516 undo: fix compat w/ debugruntest
Summary:
Use a different strategy to avoid "undo" on nested runcomand calls.

Previously it would remove the runcommand wrapper, but that effectively disables the undo extension for subsequent commands under debugruntest. Instead, we now have some global state that we unset when a command finishes so we can tell the difference between nested commands in the same process, and serial commands in the same process.

Reviewed By: zzl0

Differential Revision: D46646009

fbshipit-source-id: 47387c412da246e13b2b7c947ca04f3e419f5a87
2023-06-25 23:58:14 -07:00
Muir Manders
a0216a7ae7 status: propagate invalid path errors from Rust
Summary:
Now we propagate invalid path errors (e.g. invalid utf-8, invalid path components) to Python, and warn about them.

This is a change in behavior in that we don't bail out on invalid paths.

Reviewed By: quark-zju

Differential Revision: D46646008

fbshipit-source-id: af7fabdfcb559b987cd8254e28429256baaf34da
2023-06-25 23:58:14 -07:00
Open Source Bot
6bd90a4155 Updating submodules
Summary:
GitHub commits:

7f489d67d4
f179cd0751
6e7d9fcda6
8f5d6d2c4a
7159deb6ac
15fef787c6
f9cc464da7
711f0e30fc

Reviewed By: jailby

fbshipit-source-id: 7a31dbfb44a207fba22fcdce0d951e8ac3b18eb6
2023-06-25 18:07:43 -07:00
Open Source Bot
8c903aedb0 Updating submodules
Summary:
GitHub commits:

ab5a666f7e
f3aa240a8b
e6e895f6f0
0faddf6e18
4c4bd94362
08d90e4e30
9d910bd0a8

Reviewed By: jailby

fbshipit-source-id: 37d161a4526b9b7ec09e63e1079ec5877b607392
2023-06-25 02:55:05 -07:00
Genevieve (Genna) Helsel
4c884e60a9 rename SqliteConnection variable in SqliteDatabase
Summary: No functional change here, just giving the variable a more descriptive name

Reviewed By: chadaustin

Differential Revision: D46325246

fbshipit-source-id: daa40b625ccec66224c632309105c814a931b26f
2023-06-24 19:10:17 -07:00
Genevieve (Genna) Helsel
66cfc12580 tune some SQLite settings
Summary: Tuning particular numbers (like page size) did not show performance improvement when benchmarking, but enabling these two modes did show slight improvement.

Reviewed By: chadaustin

Differential Revision: D46325226

fbshipit-source-id: 6e0cc424f4d29c76be3237178a8a73f03066f67b
2023-06-24 18:47:59 -07:00
Open Source Bot
61fd6c1f5c Updating submodules
Summary:
GitHub commits:

9bd57cddec

Reviewed By: jailby

fbshipit-source-id: c97b95cafd79c553831ddad6d4c52682e9f4be9c
2023-06-24 17:01:05 -07:00
Genevieve (Genna) Helsel
38b1163680 serialize OverlayDir in BufferedSqliteInodeCatalog to save on memory usage
Summary:
Serializing and deserialzing the OverlayDir has similar runtime to copying the structure directly but is more memory efficient. For the benchmark I was running on Linux

```
I0509 16:33:45.357141 2489454 BufferedSqliteInodeCatalog.cpp:303] odirSize: 900, serializedSize: 254
```

Reviewed By: mshroyer

Differential Revision: D46325184

fbshipit-source-id: 8d5c063002e4601f81592941ee8791f239c85682
2023-06-24 16:26:16 -07:00
Open Source Bot
a529564ec4 Updating submodules
Summary:
GitHub commits:

94ef26a640
f21c106331
0fdfb8192d
eb11a7d5d1
4336489067
9740755397
55cde2d215
fff0708704

Reviewed By: jailby

fbshipit-source-id: 6a2f1d6d9c3269ba131724f38b7628b8b2c5e091
2023-06-24 16:09:12 -07:00
Barys Skarabahaty
1fde39a3ee Clarify blake3 key configuration
Summary: per title

Reviewed By: xavierd

Differential Revision: D46990909

fbshipit-source-id: 5d7211b15f3bcdddff6dac0667e7c52e0cb71795
2023-06-24 02:54:18 -07:00
Open Source Bot
4343497ddc Updating submodules
Summary:
GitHub commits:

9eb65689e4
df48b2d713
49a911971e

Reviewed By: jailby

fbshipit-source-id: 8c16c4b53a22084465a7ca42bdd99c93050497f9
2023-06-24 02:35:38 -07:00
Open Source Bot
d402d1098d Updating submodules
Summary:
GitHub commits:

01351730b6

Reviewed By: jailby

fbshipit-source-id: 60ee6c48fbd631a893ed2433ad9c87e002e90a08
2023-06-23 21:51:57 -07:00
Zhaolong Zhu
691efdacb7 tests: fix .t tests by disabling rust status
Summary:
D45510982 enabled rust status for debugruntest, but some tests are not
ready yet. This diff disable rust status explicitly for those tests.

Reviewed By: quark-zju

Differential Revision: D46985910

fbshipit-source-id: 92e1c825d420f7897f165dce93297991901ad6db
2023-06-23 19:51:27 -07:00
Open Source Bot
805a6fb528 Updating submodules
Summary:
GitHub commits:

b35508b736
7e7452ed50
96e0f79065
f6184b4941

Reviewed By: jailby

fbshipit-source-id: f2a0a8823aa63101f1c48080791a9b71e0d54765
2023-06-23 18:45:55 -07:00
Open Source Bot
5130322240 Updating submodules
Summary:
GitHub commits:

550ea3804d
154c26f186
93b2aea533
db3bb4c179
8d362b9546
c841815003
e64f1df3d4
1aa21edd7f
dc3d71649e
fc71dd8351
fb3c0ccbd8
072b44464d
787b688ab8

Reviewed By: jailby

fbshipit-source-id: 99864426247a6050d13f47cc3a3ad1a1e34144d0
2023-06-23 17:13:25 -07:00
Xavier Deguillard
95f27884de cli: add missing blob metadata fetching in eden trace hg --help
Summary: The documentation didn't mention what the nametag emoji meant, fix this.

Reviewed By: chadaustin

Differential Revision: D46987216

fbshipit-source-id: 7c001cfc2b6268cfe9dd9e6514a68494bec54ed2
2023-06-23 15:46:21 -07:00
Skotch Vail
e362fb385e eden typo in redirect message
Summary: fixing typo

Reviewed By: chadaustin

Differential Revision: D46951682

fbshipit-source-id: b3560391bee6e9fec51a5fc577ee3045cb34559d
2023-06-23 15:27:50 -07:00
Open Source Bot
c599e2e7dc Updating submodules
Summary:
GitHub commits:

901ce6f54a
6f504f5f3c
e102fd7ff5
94c0981726
ac3fdbaf04
ca50ccc71a
e64ab4c7ac
4d05f2794f
44505b6d03
f21eb92a02
eb5af42694
cc4fac0d09
7972b53958
f7845fcf75
ea3830bfa0

Reviewed By: jailby

fbshipit-source-id: e4b4b49f9a2739f87b67e1f88da8647a71f85394
2023-06-23 15:12:49 -07:00
Barys Skarabahaty
0476b4c187 Add a possibility to configure the default blake3 key value
Summary: Adding a possibility to configure the default blake3 version that could be used if config is not set.

Reviewed By: xavierd

Differential Revision: D46934813

fbshipit-source-id: 6d6032eec1204800f06d5794c5150db7e139a6fa
2023-06-23 14:58:01 -07:00
Nick Terrell
71aa94bdba Add cmake build system
Summary:
X-link: https://github.com/facebookincubator/zstrong/pull/492

* Adds a cmake build system that gets dependencies using getdeps.
* Adds a helper script `build.py` to invoke getdeps & cmake (see README.md).
* Configures VSCode's `cmake-tools` extension to work with our build system.
* Adds getdeps autogenerated CI for linux & mac.
* Add cmake-based CI for linux & max to `dev-ci.yml` that includes `-Werror`

bypass-github-export-checks

Reviewed By: Cyan4973

Differential Revision: D46699912

fbshipit-source-id: 06b8e7327b3c0f46b0428d8b5ce9a632cc550646
2023-06-23 14:27:40 -07:00
Open Source Bot
d6cc7ae7c5 Updating submodules
Summary:
GitHub commits:

291c5a12fa
44ad48e70a
841daa0607
bca56f87ac
e972e6f7fe

Reviewed By: jailby

fbshipit-source-id: 2056c99bfc4d65c3a200c3d2e41eb2d5a18f843f
2023-06-23 12:23:48 -07:00
Liubov Dmitrieva
ecbd5a685c avoid establishing wire proto connections for fully edenapi pulls
Summary:
avoid establishing wire proto connections for fully edenapi pulls (segmented changelog `hg pull`)

we can speed up the command by not sending clinettelemetry and hello for this
use case that will significantly reduce wireproto traffic: https://fburl.com/scuba/mononoke_test_perf/hlllh1id

we will aslo save time not establishing wire proto connection (this is always a
separate connection than edenapi protocol)

at the moment this only helps for master segmented changelog pulls but this is
our top used command

Reviewed By: quark-zju

Differential Revision: D46313581

fbshipit-source-id: 275de25ab751f8339afe28ea937d5e7c5eac8984
2023-06-23 05:30:55 -07:00
Open Source Bot
0e070061f6 Updating submodules
Summary:
GitHub commits:

c82d4fb9d7
e8ba4325d0
5ae762c8b0

Reviewed By: jailby

fbshipit-source-id: c0d3d7cb979d5cc92494f7a0dc3c3c070d19566e
2023-06-23 05:28:49 -07:00
Open Source Bot
7f50d5856c Updating submodules
Summary:
GitHub commits:

a89fa0edc3
65b501b814

Reviewed By: jailby

fbshipit-source-id: 8bab77d632d7d73f4c18a0314f419a1ef0dc9cf3
2023-06-23 00:03:24 -07:00
Open Source Bot
bf73051916 Updating submodules
Summary:
GitHub commits:

e54e2c39ce
b7d3802d76
6ca9baa225
afd7fbdb7c
439267f61a
84d2e629be
66f7540eff
5c21ecbec6
21617da981

Reviewed By: jailby

fbshipit-source-id: 32bdb7577fe23e6d916cae83bc270b630340f194
2023-06-22 22:44:44 -07:00
Muir Manders
0a2bb133f6 eden: share treestate between Python and Rust
Summary:
Make the eden dirstate map use a treestate object under the hood instead of a plain Python dictionary. This way Python and Rust can stay in-sync wrt the dirstate.

I'm working on making everything use the Rust status internally (e.g. "hg commit" uses the Rust status). For this to work, pending dirstate changes from Python need to be visible to the Rust status. Non-EdenFS handles this by sharing the same treestate object between Rust and Python. This doesn't work for EdenFS since EdenFS uses its own dirstate format completely separate from the Rust workingcopy.

However, the Rust workingcopy already converts the EdenFS dirstate into an in-memory treestate object for compatibility. In this commit, I pass this treestate object along from Rust to the eden_dirstate_map to act as the underling _map. This way, mutations from Python will be available to the Rust status code.

This isn't as nice as completely migrating to treestate, but it is much easier and is a step in the right direction.

Reviewed By: quark-zju

Differential Revision: D46840436

fbshipit-source-id: 99904622507645001cc5a9f2096da9d83cda98d4
2023-06-22 21:57:53 -07:00
Chad Austin
51081a4442 nodeipc: fix build on macOS
Summary:
On macOS, some of these types are u32. On glibc, usize. Add more
compatible casts.

This fixes the Watchman build on macOS.

Reviewed By: zzl0

Differential Revision: D46959090

fbshipit-source-id: a15635d10bb0ff687d2aab8fb608b6d841c157fd
2023-06-22 21:13:05 -07:00
Open Source Bot
5753bec3bc Updating submodules
Summary:
GitHub commits:

0a6e373cd2

Reviewed By: jailby

fbshipit-source-id: 23b07454b8abd93adf10d0b4bc94b0153748b865
2023-06-22 21:10:49 -07:00
Open Source Bot
2c2c93ada5 Updating submodules
Summary:
GitHub commits:

813dbbb833
fb5748decf
79387614e7

Reviewed By: jailby

fbshipit-source-id: ae72203ba7f8f70e7428b88de446a9e7dc4ac3e2
2023-06-22 13:58:03 -07:00
Mark Shroyer
8fe8b6143d Remove Scuba and ODS URLs from eden rage
Reviewed By: xavierd

Differential Revision: D46917457

fbshipit-source-id: 581cff90237dd49558aef56f68659fa95d30dc7b
2023-06-22 13:56:24 -07:00
Mark Shroyer
befa2c913f Add edenhost link to rage output
Summary: Adds a link to a host dashboard to rage output.

Reviewed By: xavierd

Differential Revision: D46917455

fbshipit-source-id: 5acd4679b74ba87bb0e1e232d14cf04fe2a8313b
2023-06-22 13:56:24 -07:00
Mark Shroyer
34b6dbfce6 Use hostname normalizer in Python CLI
Summary: Apply hostname normalization to Python CLI

Reviewed By: xavierd

Differential Revision: D46539537

fbshipit-source-id: 9675eb9ad3769ba75764b5853712c4c27c90884f
2023-06-22 13:56:24 -07:00
Mark Shroyer
f388db1255 Move get_normalized_hostname to a new :hostname target
Summary:
This prevents a dependency cycle when using get_normalized_hostname in
telemetry code.

Reviewed By: xavierd

Differential Revision: D46910713

fbshipit-source-id: 35ebd7505512d418c6558f6f06b055b651a34ab1
2023-06-22 13:56:24 -07:00
Open Source Bot
2721ba2c89 Updating submodules
Summary:
GitHub commits:

fe773b7e84
0b32a87ad8
f2c51976e4
866b50c289
56fde403a6

Reviewed By: jailby

fbshipit-source-id: 98201bf66e639ce55f4e8ec8c2c3d22e2f3ddb0e
2023-06-22 12:54:59 -07:00
Open Source Bot
b7cc45edef Updating submodules
Summary:
GitHub commits:

6d298a673f
5c227af84c
f4947ae6ab

Reviewed By: jailby

fbshipit-source-id: 1cdfb721a21d0ee3e0fc501e3dff07af327a306d
2023-06-22 11:19:59 -07:00
Mateusz Kwapich
35d04fb79f add --no-merge flag
Summary:
This flag allows the repo import to progress through all the steps
but bail before actually merging in the repos.

Currently the repo_import tool is so slow that all the pre-merge steps
can take hours. This makes it really hard to control when the actual merge
commit will happen. This flag will allow us to prepare all those steps
ahead-of-time and then resume with just merge in mind.

I don't think it's a proper long-term fix but I found it useful when working
wath whatsapp/biz and would use it again util we properly optimize repo_import
tool.

Differential Revision: D46802952

fbshipit-source-id: 2e8185482c4ba9c04fed20013efcc80d75e80bad
2023-06-22 10:31:22 -07:00
Zhaolong Zhu
0d05f5fcdb tests: fix test-sparse-merges.t by disable rust status
Summary:
D45510982 enabled rust status for debugruntest, but this test is not
ready yet. This diff disable rust status explicitly in the test.

Reviewed By: quark-zju

Differential Revision: D46938285

fbshipit-source-id: b9cb514d8721328a65ac88229aeff8f85dbaf922
2023-06-22 09:43:50 -07:00
Egor Tkachenko
6daec5ad8d non-oss work 84/n
Differential Revision: D46901370

fbshipit-source-id: 45e8549191975ba143194e0de32f3c3948ebb36f
2023-06-22 07:46:20 -07:00
Egor Tkachenko
cd679ea8ec non-oss work 83/n
Differential Revision: D46860120

fbshipit-source-id: 21a71f785bc2261db654b0f72890668c12c3d30b
2023-06-22 07:46:20 -07:00
Open Source Bot
557aae8cea Updating submodules
Summary:
GitHub commits:

60ee35ab1a
9c6dfe46ad

Reviewed By: jailby

fbshipit-source-id: a549f8a2ef98c2ccf66532875b3b42c6d8b45032
2023-06-22 07:38:35 -07:00
Haitao Mei
773bd915e7 new admin tool unlink keys after doing a sanitising check
Summary: This diff allows the new admin tool to double check if the key is really we wanted to delete, before doing the actual deletion.

Reviewed By: mitrandir77

Differential Revision: D46901306

fbshipit-source-id: 58904c5272d22b696dd22b3c83a9caf33fa3a0b2
2023-06-22 02:16:25 -07:00
Open Source Bot
b2c2fc97a9 Updating submodules
Summary:
GitHub commits:

abaf30ed12
05a1d52e77
77ef320ec0

Reviewed By: jailby

fbshipit-source-id: 460f886fb558444fd3cc6d6777e5bc9713d28070
2023-06-22 01:12:59 -07:00
Open Source Bot
3f13b94527 Updating submodules
Summary:
GitHub commits:

7c401174ee
4a63e8e38a
654157881e
14042e907d
adb8bde36e
c2c00d4511
f8490462a5
f7b4ec0cca
29eca1aca9
54d971f5bc
bd6ba31647
95982f2b00
561063004d

Reviewed By: jailby

fbshipit-source-id: fc460893401db3402786ca33c9d890b6ef13c780
2023-06-21 21:51:34 -07:00
Open Source Bot
fc28b555ae Updating submodules
Summary:
GitHub commits:

b711e709da
8895d3f000
ba533b19f4
8cd513080a
4963d2d72b
76b91938d8
c4f642c257
95abad79b0
d4086e2a83
05335fd085
a9b85d004c
0442e2a1de
98921bb659
bea323cf20

Reviewed By: jailby

fbshipit-source-id: af107657c955f987274e592962e82aa8f8d35c9d
2023-06-21 20:46:04 -07:00
Nick Terrell
87b1af7755 Add benchmark
Summary:
X-link: https://github.com/facebookincubator/velox/pull/5350

Adds the latest google benchmark version (v1.8.0) to the manifests.

This is required by Zstrong, which I'm adding in a stacked diff.

bypass-github-export-checks

Reviewed By: quark-zju

Differential Revision: D46747196

fbshipit-source-id: 624ca665cff0617d515a1647683870c7a5cb5c66
2023-06-21 19:48:28 -07:00
Open Source Bot
3c7ac286e0 Updating submodules
Summary:
GitHub commits:

a88f1d172f
c6f92edfa3
21c0de214d

Reviewed By: jailby

fbshipit-source-id: 16d84061f980603436406a472e17de9d4a4f7851
2023-06-21 18:34:40 -07:00
Mateusz Kwapich
c79fc047d3 improve repo_create_commit docs
Summary:
Similarly named method in scmquery pushes commits onto some branch.
Let's make the description very clear.

Reviewed By: malmond77

Differential Revision: D46916234

fbshipit-source-id: 6137f42df97be80fff2775638f766f05c1113488
2023-06-21 18:33:21 -07:00