Commit Graph

61327 Commits

Author SHA1 Message Date
Jun Wu
2af1daa778 smartlog: remove support for legacy graph renderer
Summary: Always use the Rust graph renderer.

Reviewed By: DurhamG

Differential Revision: D24299594

fbshipit-source-id: 0f9b9688d2447ca4f05bfd50fc133e2606d2020b
2020-10-19 17:07:30 -07:00
Jun Wu
9bf6b674a6 config: use Rust graph render as default
Summary: Change the legacy Python graph render to Rust renderer.

Reviewed By: DurhamG

Differential Revision: D24317802

fbshipit-source-id: 4c3dc3a6dd02b7ebe79596a8e77f4b6b139d2e20
2020-10-19 17:07:30 -07:00
svcscm
50eb8c4640 Updating submodules
Summary:
GitHub commits:

7b5bfdb1a8

Reviewed By: yns88

fbshipit-source-id: cedca40ee18867cc6d4b5d94de06d8d794345c7c
2020-10-19 16:08:52 -07:00
Kostia Balytskyi
65c55d0038 megarepotool: add check-push-redirection-prereqs subcommand
Summary: This command will help us understand if it is safe to enable push-redirection with a certain CommitSyncConfigVersion,

Reviewed By: StanislavGlebik

Differential Revision: D24345898

fbshipit-source-id: c2a4c034a9203025ce3534986b3bb986784ff2b1
2020-10-19 15:16:27 -07:00
Jun Wu
9743d2f06a changelog2: keep laziness of findcommonmissing
Summary:
`onlyboth` returns a lazy set for revlog backend.
`torevs` does not work well with such lazy set.
Use `torevset` instead.

Reviewed By: DurhamG

Differential Revision: D24397872

fbshipit-source-id: e7f5c6412b4120305b67103ceff1b1922a67ec7d
2020-10-19 13:17:35 -07:00
svcscm
588b1f3237 Updating submodules
Summary:
GitHub commits:

0e96c6c463

Reviewed By: yns88

fbshipit-source-id: cee8a73017c9ffbcd905205061479c47523c4ed0
2020-10-19 12:46:58 -07:00
Genevieve Helsel
46c1199efb move specs out of fbsource/tools/ and into fbsource/xplat/
Reviewed By: zertosh

Differential Revision: D24287371

fbshipit-source-id: fa28caa28864ead1d724f3851778b1490bdc2026
2020-10-19 12:43:06 -07:00
Chad Austin
e146f08d9a indicate to coreutils that edenfs is a remote filesystem
Summary:
GNU `df` (and any other coreutil that relies on gnulib's ME_REMOTE
flag) detects remote filesystems with some heuristics. One of which is
whether the device type contains a colon. Since edenfs is a remote
filesystem, include a colon, so it's properly detected as such.

Reviewed By: genevievehelsel

Differential Revision: D24174015

fbshipit-source-id: 4b1f2f49c6eee6e690a6f570924274060a66eee7
2020-10-19 12:13:54 -07:00
svcscm
428696c579 Updating submodules
Summary:
GitHub commits:

d80fd6a379
81e350e10b
0ab4fdb6ed
c31f8eb1bd

Reviewed By: yns88

fbshipit-source-id: 1d972da1817e3dfa480fe87d1c7c508c57bb1078
2020-10-19 12:13:54 -07:00
svcscm
0d6cce8e8c Updating submodules
Summary:
GitHub commits:

39f56ff7e8
0781b1bdd4
9344b4f01c
c3d34f3380
d8899a7fc0
f779e9bf2f
1b76617bf0
406dc4e074
b306e39cc2
5e9211be3b
eac36149e7

Reviewed By: yns88

fbshipit-source-id: c8c4cd3732dd56f2d29e530954308114b1933dc9
2020-10-19 10:01:03 -07:00
Stanislau Hlebik
6c634f94ee mononoke: admin command to change mapping version
Summary:
We'll use this command to change the mapping version we use when doing push
redirection.

Reviewed By: ikostia

Differential Revision: D24392308

fbshipit-source-id: 4dab01c0e58a8953a0c6c84c7c166977a6baf00f
2020-10-19 09:46:29 -07:00
Stanislau Hlebik
9ec52564c7 mononoke: force users to specify mapping version in
Summary:
Previously it was just taking the current version. Instead of guessing let's
allow users to specify whatever version they want to rewrite it with.

Reviewed By: ikostia

Differential Revision: D24360918

fbshipit-source-id: d9f4c55cd66931a9f2ab7da3474d2152d77525d0
2020-10-19 09:46:29 -07:00
Stanislau Hlebik
631d1da786 mononoke: remove update_mapping method
Summary:
update_mapping method was silently setting current mapping version. This was
very error-prone and we had a replacement update_mapping_with_version. This
diff removes update_mapping completely.

Reviewed By: krallin

Differential Revision: D24360105

fbshipit-source-id: 57761f4279f75032e9d4ec88a45e5199e250247a
2020-10-19 09:46:29 -07:00
Stanislau Hlebik
5bce95a9d7 mononoke: remove copy-paste initialization of CommitSyncer
Reviewed By: krallin

Differential Revision: D24360097

fbshipit-source-id: bb4fd2de905731a2780ff9cb49f0174a3c0bbdd6
2020-10-19 09:46:29 -07:00
svcscm
82327e1ff2 Updating submodules
Summary:
GitHub commits:

180f85a926
d51c358ccf
f769610382
1d8b0ebc8d
dd41d4eb3d
3b7c02fd30
d2d190dfdd
711b60d51f
f76eb2ba81
86aa646de1
4e0c15f661
62c0fe0baa
463a0298a1

Reviewed By: wittgenst

fbshipit-source-id: 953b072ebf4c967d4871035bc21004e9d5f5c62d
2020-10-19 08:29:09 -07:00
Pavel Aslanov
d752cfa651 batched tailing mode
Summary:
This diff add new mode of tailing based on derived data graph, it uses same functionality as backfill.
- `tail_batch_iteration` uses `bounded_traversal_dag` directly instead of leveraging `DeriveGraph::derive` so we could warm-up dependencies for each node before calling `DerivedUitls::backfill_batch_dangerous`

Reviewed By: StanislavGlebik

Differential Revision: D24306156

fbshipit-source-id: 006cb6d4df9424cd6501cb4a381b95f096e70551
2020-10-19 07:30:03 -07:00
Lukas Piatkowski
87db93687e rust/shed/hostname: rename hostname dependency to unbreak doctests (#15)
Summary:
Pull Request resolved: https://github.com/facebookexperimental/rust-shed/pull/15

With the update from rustc 1.44 to 1.47 the doctests started to break when building a crate that depends on a different crate of the same name, see this: https://github.com/rust-lang/cargo/issues/6819

This diff also removes the TravisCI build as it was broken and unused for some time.

Reviewed By: krallin

Differential Revision: D24390815

fbshipit-source-id: fa9c78ef394640afbf8c419f8276bbf339960406
2020-10-19 07:21:38 -07:00
Thomas Orozco
fde21ba026 mononoke/lfs_server: log client attempt
Summary:
I updated the client to send this earlier this week. Let's start collecting it
server side. The bottom line is this will let us identify when we reject a
client that is done retrying.

Reviewed By: HarveyHunt

Differential Revision: D24361884

fbshipit-source-id: b31e53c7dc989f1698e28b2a0bf14dc3fdbb507a
2020-10-19 05:01:57 -07:00
svcscm
75119ab8c8 Updating submodules
Summary:
GitHub commits:

283ff0f3e4
0969fa22c9
ce1a25ba37
ea1a43b9ed

Reviewed By: wittgenst

fbshipit-source-id: 825c423d255212355a0e69178916d2433ec6bcd2
2020-10-19 05:01:57 -07:00
svcscm
90214ec181 Updating submodules
Summary:
GitHub commits:

4df1a8e035
6cc4b27d62
3d182ce9cc

Reviewed By: wittgenst

fbshipit-source-id: 53e5fa80ec04d81f9cc942776ea5a4b169408e31
2020-10-19 04:26:33 -07:00
Lukas Piatkowski
ba1369bdfb rust/oss: update rustc version to 1.47 in rust-shed and eden GitHub workflows (#14)
Summary:
Pull Request resolved: https://github.com/facebookexperimental/rust-shed/pull/14

Pull Request resolved: https://github.com/facebookexperimental/eden/pull/68

Internal codebase was updated to 1.47 with code changes that are no longer compatible with 1.44. Updating to OSS 1.47 to fix build.

Reviewed By: ikostia, mzr

Differential Revision: D24389087

fbshipit-source-id: b4152b7761b4f584e44ff5e0dfe415414ced8a94
2020-10-19 03:53:24 -07:00
Jan Mazur
d7cf79cf5a print regex when rejecting a file
Summary: It will be much more convenient for end user to know why certain limit is enforced.

Reviewed By: krallin

Differential Revision: D24364473

fbshipit-source-id: ad86384f7f7a246bc3735028339cfd54a1d0254a
2020-10-19 03:27:50 -07:00
svcscm
cf9e791f35 Updating submodules
Summary:
GitHub commits:

b8f4647698
4ecb20335a
a3e4bbad46

Reviewed By: wittgenst

fbshipit-source-id: b59507d27a0e1646b76982c21519195802a8bd33
2020-10-19 01:56:02 -07:00
Jan Mazur
805523a1f9 adjust integration tests because of changed IpAddr Debug trait
Summary:
I think that this: 6293dca1e8
"broke" (in a sense that they need to be adjusted - run with --interactive) some of our integration tests.
In fbcode seem like it was D24363513.
This commit deleted derived Debug trait of enum IpAddr in favor of implementing it with already existing fmt::Display.
I think this change landed with rust 1.7.0 which hit fbcode recently.

Reviewed By: StanislavGlebik

Differential Revision: D24382155

fbshipit-source-id: bce5998015bfdd7c0b01a5c6ee5a661f9f00df5a
2020-10-19 01:30:28 -07:00
svcscm
2d83de6547 Updating submodules
Summary:
GitHub commits:

e184b41448

Reviewed By: wittgenst

fbshipit-source-id: fdb0f29ae610c4177cf6d52995cfced811406405
2020-10-19 01:23:57 -07:00
svcscm
52a2b093ae Updating submodules
Summary:
GitHub commits:

8f478394ca
95e749f361
08a5b3075f
89bf46418f
04964e202c

Reviewed By: wittgenst

fbshipit-source-id: bbbe47ec55361a548f1072ea832ab66929294ce2
2020-10-18 14:26:22 -07:00
svcscm
8274b68ea7 Updating submodules
Summary:
GitHub commits:

33f9f7bebb
19facb06ab
1a01e6fadb
b992f2bf0a
8b46ce7e56
dfe54a50a1
721acd8ba8
71019f88fd

Reviewed By: wittgenst

fbshipit-source-id: e048fbee7901cdfbb5073fd826c92f1fccc9c781
2020-10-17 14:16:46 -07:00
svcscm
a338060279 Updating submodules
Summary:
GitHub commits:

8ff312b604
19bef61c09

Reviewed By: wittgenst

fbshipit-source-id: 2b25ec1a193404fa06aee1471ef26c1d95c56850
2020-10-17 14:16:46 -07:00
svcscm
ab88396f47 Updating submodules
Summary:
GitHub commits:

c23c2a5c49

Reviewed By: wittgenst

fbshipit-source-id: d9d7af3bbe87c881927c6bf2bcde4098a904530d
2020-10-16 23:05:20 -07:00
Chad Austin
bef06ca978 don't load hidden config files
Summary:
Chef writes root-owned temporary files in /etc/eden/config.d. If
edenfsctl attempts to read those configs at this time, it will
fail. Just skip all hidden files.

Reviewed By: kmancini

Differential Revision: D24377953

fbshipit-source-id: 765b7f096b62e6749e186adc3e90bbc7814079c8
2020-10-16 20:50:32 -07:00
Chad Austin
83dbe9d985 compute deterministic paths in debugInodeStatus
Summary:
InodeBase::getPath is not deterministic under concurrent
renames. Instead, thread the paths down through the recursion so
they're consistent.

Reviewed By: genevievehelsel

Differential Revision: D24297724

fbshipit-source-id: 3e8664ce2bc5159e464d1d76ed37294c4eac1709
2020-10-16 19:13:19 -07:00
Jun Wu
6dac514fae continue: pass --noninteractive to continued command
Summary: This preserves the `--noninteractive` flag used by some tools.

Reviewed By: DurhamG

Differential Revision: D24040789

fbshipit-source-id: 8d50f3f3ce6b2015f0ef6c3bd1b4fbb874d0ea7d
2020-10-16 18:40:51 -07:00
Jun Wu
b36584e704 configparser: set ui.merge:interactive from ui.merge in user config
Summary:
This restores the compatibility of setting up merge tools using the `ui.merge`
config while still limiting the default `editmerge` tool to interactive
sessions.

Reviewed By: sfilipco

Differential Revision: D24377259

fbshipit-source-id: 3d2befba412b824fc985ddffa131e339644178c2
2020-10-16 18:33:06 -07:00
Jun Wu
122108e46e configparser: move load_user to a testable method
Summary: Make it testable by allowing specifying paths to load as user hgrc.

Reviewed By: sfilipco

Differential Revision: D24377258

fbshipit-source-id: 969028df64d55ad1f1304e35675d84595ed6a2bf
2020-10-16 18:33:06 -07:00
svcscm
2209ea6577 Updating submodules
Summary:
GitHub commits:

85b6dd5f1b
b07f38e007

Reviewed By: wittgenst

fbshipit-source-id: 4b9297f763f1def850ac70231d05fca99f415b4b
2020-10-16 18:33:06 -07:00
svcscm
8f691b16e6 Updating submodules
Summary:
GitHub commits:

d32a42b556
f4ebca8929
c3c46dbf5e
3f6324dee4
ef93c52756
a32fc1f993
936492bcf0
8c6c3b6460
f628cd1035
05f94de511
b656b5499b
9c43bff299
e1db75c548
fd152b4878

Reviewed By: wittgenst

fbshipit-source-id: c0cf72d2d4a29576741edce5617ac065d02b5d93
2020-10-16 13:15:02 -07:00
Lukas Piatkowski
1b5293d584 mononoke/integration: create a Makefile to run tests as part of getdeps.py build (#67)
Summary:
Pull Request resolved: https://github.com/facebookexperimental/eden/pull/67

With this change it will be possible to build dependencies of and run integration tests using getdeps.py.

This is the first goal of Q4 as per https://fb.quip.com/v8YzAYNSYgot: "Get Open Source version of integration tests running on Legocastle".

Before this diff:
The OSS integration tests run now on GitHub by:
- Building some test dependencies with getdeps.py
- Building some test dependencies with homebrew/apt-get
- Running tests via python script

The OSS integration tests were not running on Sandcastle.

After this diff:
The OSS integration tests run on Github by:
- Building and executing tests via getdeps.py (execution of tests happens by getdeps.py calling Make calling python script)

The OSS integration tests run on Sandcastle using the same getdeps.py setup as Github.

Reviewed By: krallin

Differential Revision: D24253268

fbshipit-source-id: cae249b72d076222673b8bbe4ec21866dcdbb253
2020-10-16 12:23:33 -07:00
Arun Kulshreshtha
d16a62ce06 edenapi: send user agent string
Summary:
Include a `User-Agent` header in EdenAPI requests from Mercurial. This will allow us to see the version in Scuba, and in the future, will allow us to distinguish between requests send by Mercurial and those sent directly by EdenFS.

Keeping with the current output of `hg version`, the application is specified as "EdenSCM" rather than "Mercurial".

Reviewed By: singhsrb

Differential Revision: D24347021

fbshipit-source-id: e323cfc945c9d95d8b2a0490e22c2b2505a620dc
2020-10-16 11:05:24 -07:00
svcscm
b06145e033 Updating submodules
Summary:
GitHub commits:

6c45ed2cf0

Reviewed By: wittgenst

fbshipit-source-id: 6051565e3cc5cfda5a801f546aad4a4d3b929cde
2020-10-16 11:02:17 -07:00
Stanislau Hlebik
76ae65bd46 mononoke: add subcommand to prepare pushredirection rollout
Reviewed By: krallin

Differential Revision: D24282770

fbshipit-source-id: dd8a6951048f238bb4b24cec4f669a1a58a7adee
2020-10-16 10:49:19 -07:00
Kostia Balytskyi
0ae6fcbddb cross_repo_sync: tweak validation logging
Summary: Log more stuff at `debug!`.

Reviewed By: StanislavGlebik

Differential Revision: D24361631

fbshipit-source-id: fb4d46eac11ef70a9a1ee8645ed0efcc4035b594
2020-10-16 10:45:45 -07:00
generatedunixname89002005325677
3bd11a5817 Daily arc lint --take RUSTFMT
Reviewed By: zertosh

Differential Revision: D24357892

fbshipit-source-id: dec7969a8bb9302689e4a10656a60e1a38daef80
2020-10-16 10:41:29 -07:00
svcscm
37ce4f4bec Updating submodules
Summary:
GitHub commits:

288031fefa
cb9a3237b0
7cc4023712

Reviewed By: wittgenst

fbshipit-source-id: 412b1f32af41d75f4c153cf6e6522f166c61cea3
2020-10-16 10:25:47 -07:00
Simon Farnsworth
3c7ce4eed1 hg histedit: document autoverb badly
Summary: This was competely undocumented, and thus undiscoverable. Add some documentation, so that it's at least clear the feature exists

Reviewed By: singhsrb

Differential Revision: D24332961

fbshipit-source-id: 9e73163a9314ceb7f953a3b1ac0f58c9a6e6d4d9
2020-10-16 09:30:28 -07:00
Thomas Orozco
ada1d7e7a9 mononoke/{multiplexedblob,logblob}: capture operation perf counters
Summary:
This updates multiplexedblob and logblob to capture perf counters for the
operations we run, and log them to Scuba. Along with the previous diffs in this
stack, this gives us the number of Manifold retries, total delay, and conflicts
all logged to blobstore trace on a per-operation basis.

Reviewed By: HarveyHunt

Differential Revision: D24333039

fbshipit-source-id: 9c7d0a467f8df08dcb2a0d3bb6b543cdb3ea1d90
2020-10-16 08:57:13 -07:00
Thomas Orozco
63158883e3 mononoke/manifoldblob: log retries, delay and conflicts to perf counters
Summary:
This updates ManifoldBlob to log the aformentioned data points to perf
counters. There's a bit of refactoring that also had to go into this to make
`ctx` available everywhere it's needed.

Reviewed By: aslpavel

Differential Revision: D24333040

fbshipit-source-id: 1b63bcd1e1ee36bae4dbbc1da053c7f1bdf96675
2020-10-16 08:57:13 -07:00
Thomas Orozco
80bb3074bc mononoke/context: allow forking perf counters
Summary:
This adds support for "forking" perf counters at a point in the stack, giving
you a CoreContext that logs to one or more sets of perf counters.

This is useful for low level operations where we want to collect granular more
logging data — in particular blobstore operations, where we'd like to collect
the time spent waiting for Manifold retries or the number of Manifold retries
in blobstore trace for each individual blobstore operation (we can't do that
using the `CoreContext` we have because that would be missing

The implementation supports a list of reference counted perf counters in the
CoreContext. When you want to add a new counter, we replace the list with a new
one, and give you a reference to the one you just added. When you write, we
write to all perf counters, and when you read, we read from the "top" perf
counter (which is always there). To read from one of the forked counters, you
use the reference you got whne you created it.

Reviewed By: aslpavel

Differential Revision: D24333041

fbshipit-source-id: ce318dfc04a1ea435b2454b53df4cae93d57c0a5
2020-10-16 08:57:13 -07:00
svcscm
d4742ee98b Updating submodules
Summary:
GitHub commits:

62c2caaed1
16458d9954
fdf917e56b
e886f49099

Reviewed By: wittgenst

fbshipit-source-id: 83956742485f4be11fe02c08c1d7b752e307859e
2020-10-16 08:52:19 -07:00
Stanislau Hlebik
4931e6654b mononoke: add a tool that backfills noop mapping
Summary:
The x-repo usually have "noop" mapping i.e. mapping that doesn't change the
paths (it might have arbitrary name though)

It's useful for commits that are identical between small and large repo to be
able to backfill this mapping. This diff adds a command to do that.

Reviewed By: krallin

Differential Revision: D24337281

fbshipit-source-id: 89a058f95677e4a5c8686122a317eadf8b1bb995
2020-10-16 08:47:04 -07:00
Stanislau Hlebik
4e0280a42e mononoke: refactor waiting for replication from run_mark_not_synced
Summary: It will be used in the next diff, so let's move it to a separate function.

Reviewed By: krallin

Differential Revision: D24334717

fbshipit-source-id: e50d13d45c633397504cf08954f2ced9ace8f570
2020-10-16 08:47:04 -07:00