Commit Graph

85693 Commits

Author SHA1 Message Date
Youssef Ibrahim
b018862a3a segmented_changelog: convert segmented_changelog_tailer_log_sampling_rate tunable to JK
Summary: Part of deprecating mononoke tunables

Differential Revision: D50972212

fbshipit-source-id: c3e09688d8fd5d211df0b4d2e51f8f034f51be90
2023-11-04 03:46:57 -07:00
Youssef Ibrahim
820756b9dc segmented_changelog: convert segmented_changelog_idmap_log_sampling_rate tunable to JK
Summary: Part of deprecating mononoke tunables

Differential Revision: D50972143

fbshipit-source-id: b8f828f4de5dfcdcba4e15511a04e4ada034b74c
2023-11-04 03:46:57 -07:00
Youssef Ibrahim
4a7d6c56e8 segmented_changelog: convert segmented_changelog_force_reload tunable to JK
Summary: Part of deprecating mononoke tunables

Differential Revision: D50972041

fbshipit-source-id: baf95d4270d291207399d648f246cfa31c8c819d
2023-11-04 03:46:57 -07:00
Youssef Ibrahim
92a69fc4d0 segmented_changelog: convert segmented_changelog_force_reload_jitter_secs tunable to JK
Summary: Part of deprecating mononoke tunables

Differential Revision: D50971748

fbshipit-source-id: e2861c054f4380519c5f39ad3c88ce5fbbb52da2
2023-11-04 03:46:57 -07:00
Open Source Bot
26053e359b Updating submodules
Summary:
GitHub commits:

d9a52a7b4b
d2f52f3b49
9ea32b2463

Reviewed By: jailby

fbshipit-source-id: e5ab66d73267b830a776f7969cb8da16b226f013
2023-11-04 02:36:36 -07:00
Open Source Bot
cde565e53a Updating submodules
Summary:
GitHub commits:

27e873bef5
52f792d8b1
c11f1b374c

Reviewed By: jailby

fbshipit-source-id: 953924f9b05f96faee00b015ffe0c8add1570c10
2023-11-03 21:12:05 -07:00
Gary Zheng
3a79200042 Fix typo in docstring of folly::File fuseDevice_
Summary:
spelling mistake

Created from CodeHub with https://fburl.com/edit-in-codehub

Reviewed By: xavierd

Differential Revision: D50990115

fbshipit-source-id: 4dd5b2067e3cd1e72058cddb916e6c9ec0115eb8
2023-11-03 21:06:51 -07:00
Evan Krause
f865fbf257 Make internal debugging more clear about what it's referring to
Summary: Some folks found these debugging tools, so let's make it clear this is data referring to sl command performance and other ISL internal state. Adding the command name makes this much more clear.

Reviewed By: shunfu

Differential Revision: D50994363

fbshipit-source-id: 1cb5942686ea1d9bba93686fce4beb53bf04d1df
2023-11-03 20:13:09 -07:00
Open Source Bot
2207d0f711 Updating submodules
Summary:
GitHub commits:

0b9cdde39f
d11d74fe62
e52d346cbe

Reviewed By: jailby

fbshipit-source-id: f93e7aff7a9580509acd161268989ea83a332327
2023-11-03 19:59:32 -07:00
Evan Krause
b31a3d11ef [isl Fix unused variables
Summary: These appear to not be used

Reviewed By: quark-zju

Differential Revision: D50992180

fbshipit-source-id: 7bf1e1b1b9ec2696e63fc8496fb0900e3994db3c
2023-11-03 19:44:38 -07:00
Open Source Bot
f1bfe8de1f Updating submodules
Summary:
GitHub commits:

6b8b0de9ca
957b10698b
d7d9179e99
b48480cfd0

Reviewed By: jailby

fbshipit-source-id: dd7079d98c2b24167935a4e10a5c4f5b0c57b382
2023-11-03 18:34:48 -07:00
Open Source Bot
b80d60d195 Updating submodules
Summary:
GitHub commits:

c7d0b62f61
957efaed7f
ef2fb2c06b
c9b94a4887
850c3be8ea

Reviewed By: jailby

fbshipit-source-id: b944eea46aa235b18d71006f640d0eaedfc45144
2023-11-03 14:09:31 -07:00
Xavier Deguillard
d42bc3f88b inodes: replace manual try/catch with makeFutureWith
Summary:
makeFutureWith is strictly equivalent to a try/catch but requires less code to
handle exceptions, use it.

Reviewed By: genevievehelsel

Differential Revision: D50902990

fbshipit-source-id: 8d887e2c0efd97244763b27c2b3ec2b20145e97e
2023-11-03 14:01:58 -07:00
Open Source Bot
2a51867ff3 Updating submodules
Summary:
GitHub commits:

45c5ea6474
5fca38ef00
8505b26db1
b27692b508
4ff6893cbd
781caf34e0

Reviewed By: jailby

fbshipit-source-id: ba56e928327ac092d11d1f588b55bdfd43af760e
2023-11-03 12:41:21 -07:00
Liubov Dmitrieva
d937c135a0 instrument in Commit Cloud Updates
Summary:
instrument in Commit Cloud Updates with client request info

this is the first time we will be able to match hg rage logs with dev command timers and with Commit Cloud Updates, that should greatly simplify debugging for Commit Cloud issues

this is the first time we will be able to identify in Commit Cloud Updates if the update was initiated from sapling vs scm daemon

Reviewed By: zzl0

Differential Revision: D50973878

fbshipit-source-id: 536e7c741807bd398db01cd4e6ee3e72a442babf
2023-11-03 10:25:38 -07:00
Open Source Bot
5476e43b22 Updating submodules
Summary:
GitHub commits:

73e5e06453
25c99ae588

Reviewed By: jailby

fbshipit-source-id: 89668f13278b123b99f65c314320bc73bbcbed4f
2023-11-03 09:12:15 -07:00
Liubov Dmitrieva
2f874f5fea set up correct client entry point and also enable printing of
Summary:
set up correct client entry point and also enable printing of Client Correlators in logs

These changes will allow us greatly improve debugging experience of Commit Cloud issues

More precisely, it will allow us to easily match a command from hg rage with 3 scuba tables: dev command timers, CommitCloud Updates and Commit Cloud Requests (and more like Mononoke Test Perf, etc).

Reviewed By: zzl0

Differential Revision: D50967961

fbshipit-source-id: 07ccccc0790194078649c6798bff34a13479a247
2023-11-03 09:10:48 -07:00
Liubov Dmitrieva
3653792341 enable printing of the Client Correlator in the logs for
Summary:
enable printing of the Client Correlator in the logs for background commands

It has been really really hard to debug Commit Cloud issues for years. Now we will change that.

The first step is enabling printing of the Client Correlator for background
commands. This way, looking into "hg rage" you will be able to easily match a
command with the telemetry in the Dev Command Timers scuba table!

Moreover, we are going to instrument the Commitcloud Updates and Commit Cloud
Requests scuba tables with Client Request Info as well in the following
diffs, so then it will be just awesome.

Reviewed By: zzl0

Differential Revision: D50967834

fbshipit-source-id: b5f864cb1971630d57b007fa698216fdc8eca231
2023-11-03 09:10:48 -07:00
Liubov Dmitrieva
0ae5d13733 add scm daemon
Summary:
add scm daemon

this will be used to instrument scm daemon

Reviewed By: zzl0

Differential Revision: D50967508

fbshipit-source-id: 87fe3cde032ba605d11df0d86a592ab793e61244
2023-11-03 09:10:48 -07:00
Clara Rull
feb9a818ba Remove per request blobstore qps in scs tunable
Summary:
This tunable controls the amount or blobsotre reads and writes within a single request.
Since it was set in January 2021 (3 years ago) (https://www.internalfb.com/code/configerator/[773df72c41aa]/source/scm/mononoke/tunables/default.cconf?lines=70-71) it has not been changed, so removing it and setting it to the specified value in configerator

Reviewed By: mzr

Differential Revision: D50968709

fbshipit-source-id: c713e0ffde42aab379a3cb6486fab77c1fb506d7
2023-11-03 07:58:32 -07:00
Open Source Bot
6fe1903eb6 Updating submodules
Summary:
GitHub commits:

e7287b3b89
98bcda8e67
0a75b60592

Reviewed By: jailby

fbshipit-source-id: cc1882eefecbb42d31d369a620475a299876f255
2023-11-03 07:34:19 -07:00
Youssef Ibrahim
28b3de876c preloaded_commit_graph_storage: convert preloaded_commit_graph_reloading_interval_secs tunable to JK
Summary: Part of deprecating mononoke tunables

Reviewed By: mzr

Differential Revision: D50970077

fbshipit-source-id: 1fb7077922462571f19c7eb952e666f0da24eed5
2023-11-03 07:04:34 -07:00
Youssef Ibrahim
147cf71aa7 sql_commit_graph_storage convert commit_graph_prefetch_step_limit tunable to JK
Summary: Part of deprecating mononoke tunables

Reviewed By: mitrandir77

Differential Revision: D50970019

fbshipit-source-id: ba91f9265069675738c000c78c4f77eb46d072f3
2023-11-03 07:04:34 -07:00
Youssef Ibrahim
288f08f5d9 caching_commit_graph_storage: convert disable_commit_graph_memcache_for_prefetch tunable to JK
Summary: Part of deprecating mononoke tunables

Reviewed By: mitrandir77

Differential Revision: D50969827

fbshipit-source-id: 2bcfee30db30d4746ce9ee523823079cbf795288
2023-11-03 07:04:34 -07:00
Youssef Ibrahim
8d834fd927 caching_commit_graph_storage: convert disable_commit_graph_prefetch tunable to JK
Summary: Part of deprecating mononoke tunables

Reviewed By: mitrandir77

Differential Revision: D50969758

fbshipit-source-id: 1ca006daf9e1753649f9314fc41424182b0152a3
2023-11-03 07:04:34 -07:00
Youssef Ibrahim
382f6787d3 edenapi: convert enable_streaming_commit_graph_edenapi_endpoint tunable to JK
Summary: Part of deprecating mononoke tunables

Reviewed By: mitrandir77

Differential Revision: D50969669

fbshipit-source-id: a759a77c69bfdc0435c4b13eef4baa0a51a78739
2023-11-03 07:04:34 -07:00
Haitao Mei
a65371e9fe Derived data service - change derived_data_disable_derivation_workers to be a JK
Summary:
As titled

JK was added here: 421f83d8d9

Reviewed By: YousefSalama

Differential Revision: D50969301

fbshipit-source-id: c1fa92c45afaa4b1161c6cf7cfedf42ad081e7ba
2023-11-03 06:26:52 -07:00
Open Source Bot
3ec63a0ec3 Updating submodules
Summary:
GitHub commits:

175fd51711
49d206a8ed

Reviewed By: jailby

fbshipit-source-id: 43184ee380cdc076aee0d13bae1435c8a1b9636c
2023-11-03 04:53:13 -07:00
Liubov Dmitrieva
9395cac429 add client request info
Summary: add client request info into new commit graph scuba table

Reviewed By: clara-9

Differential Revision: D50905572

fbshipit-source-id: 7aaf08015afab296504017bf944aa748b92259a3
2023-11-03 02:37:57 -07:00
Open Source Bot
5322782915 Updating submodules
Summary:
GitHub commits:

114ffeceac
bd9d6717d5

Reviewed By: jailby

fbshipit-source-id: fe3d46816fdb540f9f06e23b00df17aa8d02e3d7
2023-11-03 00:55:46 -07:00
Open Source Bot
522067798b Updating submodules
Summary:
GitHub commits:

79d37e349e
b787289835
e0d4bc86f6

Reviewed By: jailby

fbshipit-source-id: 5490817d2ef5b685d4a42806a4ee34f114a79c92
2023-11-02 16:04:38 -07:00
Muir Manders
9b7b160c4c tests: deflake test-fb-ext-sampling.t
Summary: Only check for metrics we logged ourselves in the test for stability.

Reviewed By: sggutier

Differential Revision: D50945520

fbshipit-source-id: f087271cfba818e78e40ed019ed635f3610e3db5
2023-11-02 15:44:35 -07:00
Evan Krause
32b2e936d0 Open webview app directly instead of using "open"
Summary:
It seems some semantics of /usr/bin/open may have changed in macOS Sonoma. We used to have `sl isl` open the generated app bundle using `/usr/bin/open /path/to/Sapling.app`. This now seems to exit immediately. I'm not quite sure why.

Instead, we can simply invoke the inner executable directly. That still opens the app, shows the webview, and appears in the dock and everything, but it doesn't exit immediately.

Reviewed By: sggutier

Differential Revision: D50939280

fbshipit-source-id: 3680e93a7dbd06d3dce63cce3d38e5a72a2c7ae1
2023-11-02 14:54:48 -07:00
Evan Krause
732d132ffd Only use tar extract if python supports it
Summary: We were doing a version check to use `filter=data` when untaring ISL. This is fragile because the python verison support for this is really random. Let's instead detect the feature directly, [as suggested here](https://peps.python.org/pep-0706/#backporting-forward-compatibility:~:text=if%20hasattr(tarfile%2C%20%27data_filter%27)%3A%0A%20%20%20%20my_tarfile.extractall(filter%3D%27data%27)%0Aelse%3A%0A%20%20%20%20%23%20remove%20this%20when%20no%20longer%20needed%0A%20%20%20%20warn_the_user(%27Extracting%20may%20be%20unsafe%3B%20consider%20updating%20Python%27)%0A%20%20%20%20my_tarfile.extractall())

Reviewed By: sggutier

Differential Revision: D50937875

fbshipit-source-id: 98f8e95211d9e7b522b13f8e7c75d02b8499d1b8
2023-11-02 14:54:48 -07:00
Open Source Bot
f11a98fa4a Updating submodules
Summary:
GitHub commits:

f949ffbaba
2648e0a747
d985e4e704
47b8372c08
060232f864
cbb31308cd

Reviewed By: jailby

fbshipit-source-id: 3d340a9993050bb01302c9dbad122f5172568781
2023-11-02 14:53:35 -07:00
Rajiv Sharma
ff130643d2 Start supporting merges for GitDeltaManifest
Summary: With the optimizations made so far, we should be able to support deltafication of merges in addition to regular commits.

Reviewed By: mitrandir77

Differential Revision: D50943028

fbshipit-source-id: fcb822c4dd505b6ec2834d3cb7e2f92c7e9d69ef
2023-11-02 14:23:26 -07:00
Liubov Dmitrieva
c0d5868531 instrument streaming clone
Summary: instrument streaming clone with client request info

Reviewed By: mitrandir77

Differential Revision: D50927546

fbshipit-source-id: c7e1ce4f5e0d352ebc26f843a29bb0395eeb3202
2023-11-02 13:45:44 -07:00
Liubov Dmitrieva
0d01b7cd18 bugfix and unit tests
Summary:
bugfix (one element of enum wasn't covered) and adding comprehensive unit tests for conversion

add tests for converting from and to a string

Reviewed By: clara-9

Differential Revision: D50927331

fbshipit-source-id: d4393da70eaec6ad203f7a41a612d8e1211e4bfd
2023-11-02 13:45:44 -07:00
Liubov Dmitrieva
b0a78d61b1 instrument mirror hg commits
Summary: instrument mirror hg commits

Reviewed By: mitrandir77

Differential Revision: D50927336

fbshipit-source-id: db987f4a38cb89808d2de1381bf8ade89827ce24
2023-11-02 13:45:44 -07:00
Open Source Bot
1bbc9aa257 Updating submodules
Summary:
GitHub commits:

a6e21655bb
6a0e1ab17b
c8c8dfb634
ebc61427c5
a33a8b888a

Reviewed By: jailby

fbshipit-source-id: fd2c4a02514af7436e5fae8c7126826a8c1457d5
2023-11-02 13:44:29 -07:00
Saul Gutierrez
07250d30aa symlinks: add helper functions for resolving symlink paths
Summary: Adds some helper functions that will be used for resolving symlinks on D50793884

Reviewed By: xavierd

Differential Revision: D50888103

fbshipit-source-id: dadf02e4635cc86ef9470c4f925386711d42d0e6
2023-11-02 13:43:33 -07:00
Guy Lewin
60e6a946e8 Upgrade openssl and openssl-sys crates
Summary:
Changelogs:
- https://github.com/sfackler/rust-openssl/blob/openssl-v0.10.58/openssl/CHANGELOG.md#v01058---2023-11-01
- https://github.com/sfackler/rust-openssl/blob/openssl-sys-v0.9.94/openssl-sys/CHANGELOG.md#v0994---2023-11-01

Reviewed By: zertosh

Differential Revision: D50936191

fbshipit-source-id: 5afd45cce06deddfc231d2c2ca075cc5fcc0fc2c
2023-11-02 13:20:06 -07:00
Open Source Bot
3206f3a325 Updating submodules
Summary:
GitHub commits:

64b4776627
1f58e47402
af568adc2f
58d8725277
f5a09d0ea7
6637ef52bc
89e383588e
2664d257b6
824ef10481

Reviewed By: jailby

fbshipit-source-id: 79907aa993724eafc84d50d453a5a8fc05f9d178
2023-11-02 12:31:05 -07:00
Rajiv Sharma
2c9a3cbeba Fix use of delta bug in bundle generation
Summary: This is a facepalm bug that I left in the current code which led us to creating bundles that do include deltas at all. Also, the size comparison that we do for deltas is too aggressive so this diff relaxes that constraint.

Reviewed By: mitrandir77

Differential Revision: D50936705

fbshipit-source-id: 54900a96c0b87e809cfbf17f09231fd7e47c2932
2023-11-02 12:02:44 -07:00
Open Source Bot
0fec12c3e6 Updating submodules
Summary:
GitHub commits:

b589527a84
d62707bf4d
957b12fde5
0eeddc6fe0
8785f3780a
8e1adab5ce
488f147df8
9b6b30735d
63618b7cfc
80eaddf917

Reviewed By: jailby

fbshipit-source-id: 89c68e2a53505a5108579971ab78cba3abb5fcbd
2023-11-02 10:39:42 -07:00
Liubov Dmitrieva
ef38678886 add a test showing the we indeed enforce client info header from now on
Summary:
add a test showing the we indeed enforce client info header from now
on in lfs

Differential Revision: D50930502

fbshipit-source-id: 2d056728a9f8c3dbfd9b4977d07c61977aa5ff76
2023-11-02 09:29:25 -07:00
Liubov Dmitrieva
43e56d5921 add a test showing the we indeed enforce client info header from now
Summary:
add a test showing the we indeed enforce client info header from now
on

Differential Revision: D50930216

fbshipit-source-id: 0e419a7dbfc99bc7c1deefb2f461f71a3f103fb8
2023-11-02 09:29:25 -07:00
Open Source Bot
18aaa04e1d Updating submodules
Summary:
GitHub commits:

e89b990eae
ba2734ab4d

Reviewed By: jailby

fbshipit-source-id: 185be2633a44760c1a08a48717eed88a7fc6d569
2023-11-02 08:42:14 -07:00
Liubov Dmitrieva
6057a8af30 make x-client-info header mandatory in POST/GET requests
Summary:
make x-client-info header mandatory in POST/GET requests

a custom mandatory header would protect us from CSRF attacks

we are excluding the health checks for now since they are used by proxygen and tupperware that don't provide the header

Reviewed By: mitrandir77

Differential Revision: D50882840

fbshipit-source-id: 21a9a89af6156046dd03f4fbcb94dc6d268566b9
2023-11-02 08:01:44 -07:00
Liubov Dmitrieva
7fe7a130c2 log client request info
Summary:
log client request info

there are some blobstore acceses where we don't log, logging here should help

Reviewed By: clara-9

Differential Revision: D50905311

fbshipit-source-id: fe4cc393b1e34be4171901055ed8f4769e951b78
2023-11-02 07:35:37 -07:00