Commit Graph

61702 Commits

Author SHA1 Message Date
Alex Hornby
aaa2f671c4 mononoke: implement FromStr for BookmarkName
Summary:
implement FromStr for BookmarkName, can use it to handle bookmarks
more uniformly with other types in the walker

Reviewed By: mitrandir77

Differential Revision: D24725786

fbshipit-source-id: e7eb7ece4a4bdc5dfd91f253f0383829c4ecc73b
2020-11-13 05:25:58 -08:00
Alex Hornby
99cb9d4f9f mononoke: add AliasKey to walker so can add FromStr
Summary: Refactor from non-FromStr node parsing to FromStr, make it consistent with other node keys.

Reviewed By: mitrandir77

Differential Revision: D24711374

fbshipit-source-id: 84200b781bfad0f860acd8aecb95ff238490b92d
2020-11-13 05:25:58 -08:00
Alex Hornby
5d2375c45f mononoke: use PathKey for Node::Fsnode in walker
Reviewed By: mitrandir77

Differential Revision: D24711373

fbshipit-source-id: cdddd994ac5a6ae6a8c5f686e952d10f0f34176d
2020-11-13 05:25:58 -08:00
Alex Hornby
28d7bc6daf mononoke: use PathKey for parsing of Node::HgFileNode in walker
Summary: use PathKey for parsing of Node::HgFileNode in walker.

Reviewed By: ikostia

Differential Revision: D24711375

fbshipit-source-id: 4fe5887ba44ca9fca1dde54eaa75b30114b3b4b8
2020-11-13 05:25:58 -08:00
Alex Hornby
557d6b58ab mononoke: add PathKey to walker, use in parse_node
Summary: add PathKey newtype to Node so can implement FromStr and use it in parsing for HgManifest

Reviewed By: mitrandir77

Differential Revision: D24711371

fbshipit-source-id: a9879f6d2e16eb54b2ca7af4e812a4f031c9e584
2020-11-13 05:25:58 -08:00
Alex Hornby
8cbe06923d mononoke: Add UnitKey to walker node definition, use in parse_node
Summary: Add UnitKey newtype to walker so that can implement FromStr,  this is leading up to all node keys supporting from_str at which point I can generate NodeType::parse_node.

Reviewed By: mitrandir77, ikostia

Differential Revision: D24711376

fbshipit-source-id: aa4e26eb8e9206673298b632a079d2cc66d152ee
2020-11-13 05:25:57 -08:00
Kostia Balytskyi
8d4db7b334 rate_limits: import thrift changes
Summary: This just imports D24871255.

Reviewed By: krallin

Differential Revision: D24871790

fbshipit-source-id: e5367eef5dfa4ce261fe9474f53df5ebb3cf6c4d
2020-11-13 05:18:33 -08:00
svcscm
792ae29c65 Updating submodules
Summary:
GitHub commits:

79c7dd968e

Reviewed By: 2d2d2d2d2d

fbshipit-source-id: 94171048cf7eb592f3d65110aaa3243192cea6f0
2020-11-13 03:41:01 -08:00
Kostia Balytskyi
749ae9e0da rate_limits: extract counter_check_and_bump into a fn
Summary: This is mostly a slight refactoring to help code reuse. However, there's a small behavior change as well (which I think is acceptable): before we compared `count` vs `max_value`, and now we compare `count + bump` vs `max_value`.

Reviewed By: krallin

Differential Revision: D24871175

fbshipit-source-id: 94e53ff2c05b4f9b236473c7e4b6d78229b64d53
2020-11-13 03:19:04 -08:00
Mark Juggurnauth-Thomas
2a76d65847 derived_data: rename BonsaiDerived::derive03 to derive
Summary: Now that `derive03` is the only version available, rename it to `derive`.

Reviewed By: krallin

Differential Revision: D24900106

fbshipit-source-id: c7fbf9a00baca7d52da64f2b5c17e3fe1ddc179e
2020-11-13 01:48:03 -08:00
Mark Juggurnauth-Thomas
383e60ed8c derived_data: remove old futures version of BonsaiDerived::derive
Summary:
Now that all code is using `BonsaiDerived::derive03`, we can remove the old
futures version `BonsaiDerived::derive`.

Reviewed By: krallin

Differential Revision: D24900108

fbshipit-source-id: 885d903d4a45e639e4d44e19b5d70fac26bce279
2020-11-13 01:48:03 -08:00
Mark Juggurnauth-Thomas
37ab107de9 derived_data: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900119

fbshipit-source-id: e1dee3796b48fc12070f6455f4a1b6c7f1bcf32c
2020-11-13 01:48:03 -08:00
Mark Juggurnauth-Thomas
91208a011a repo_client: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900112

fbshipit-source-id: c5dadb4c23808a75460c4a30cbe238025998b543
2020-11-13 01:48:03 -08:00
Mark Juggurnauth-Thomas
2e89b24808 mononoke_api: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900114

fbshipit-source-id: 5a8aab1606172866dca7ce573da267748736e9bf
2020-11-13 01:48:02 -08:00
Mark Juggurnauth-Thomas
0c66cdb98d git: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900113

fbshipit-source-id: 6b0be9b2a555080f8adab4f89ee19b7930571b35
2020-11-13 01:48:02 -08:00
Mark Juggurnauth-Thomas
13f119ca89 commit_rewriting: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900118

fbshipit-source-id: 68ad4edd051cec76794bbd880fc5f9e0c3716fcd
2020-11-13 01:48:02 -08:00
Mark Juggurnauth-Thomas
df13fce307 cache_warmup: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900107

fbshipit-source-id: eec7bd1859d47a8f4f03154825a7716a1affd9a4
2020-11-13 01:48:02 -08:00
Mark Juggurnauth-Thomas
875754fda4 warm_bookmarks_cache: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900121

fbshipit-source-id: abce207db0ef51797b278cd448fb41b5e54875cb
2020-11-13 01:48:02 -08:00
Mark Juggurnauth-Thomas
26aaa544b0 blobrepo: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900110

fbshipit-source-id: 7f73563547e06ee89ece15a614b6efa8c300cab4
2020-11-13 01:48:02 -08:00
Mark Juggurnauth-Thomas
80b9a03608 benchmark: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900111

fbshipit-source-id: af92f04ab0c273dde22e343bf2145d7380093313
2020-11-13 01:48:02 -08:00
Mark Juggurnauth-Thomas
466aff087d backfill_derived_data: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900120

fbshipit-source-id: 5b8ee17205896af26a712831914a97e56693928a
2020-11-13 01:48:02 -08:00
Mark Juggurnauth-Thomas
362c0f5b08 admin: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900124

fbshipit-source-id: 0720bed284b1e901eb3c598943d56ce533898bcf
2020-11-13 01:48:02 -08:00
Mark Juggurnauth-Thomas
a4b6704653 unodes: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900115

fbshipit-source-id: f16c49563247b7f10a4158a5b8852cfc3ace40f5
2020-11-13 01:48:02 -08:00
Mark Juggurnauth-Thomas
657cf2ecd1 mercurial_derived_data: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900122

fbshipit-source-id: b4ef459e2ad384d70be8654f514463f951aedf04
2020-11-13 01:48:02 -08:00
Mark Juggurnauth-Thomas
017cba81f3 fsnodes: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900125

fbshipit-source-id: 266b450aac16f74ad2a5be4a981e5c9d155cf4be
2020-11-13 01:48:01 -08:00
Mark Juggurnauth-Thomas
6f15e8a724 filenodes: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900127

fbshipit-source-id: f7f956ac5441d77392810428c013b160fdfb8932
2020-11-13 01:48:01 -08:00
Mark Juggurnauth-Thomas
0ad9a45b4a fastlog: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900109

fbshipit-source-id: a6e7c226b99794d99f5b2093e591b66bd3f4bacd
2020-11-13 01:48:01 -08:00
Mark Juggurnauth-Thomas
89cfdeccb6 deleted_files_manifest: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900116

fbshipit-source-id: 387e75a4f45a9c283ab73322154c19e314bf6a21
2020-11-13 01:48:01 -08:00
Mark Juggurnauth-Thomas
364f20adad changeset_info: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900117

fbshipit-source-id: 46afb23a5d12af89933fc658ec4225196659faa9
2020-11-13 01:48:01 -08:00
Mark Juggurnauth-Thomas
635e1835a2 blame: switch to BonsaiDerived::derive03
Reviewed By: krallin

Differential Revision: D24900123

fbshipit-source-id: 86d65d939f736589ee6006b7610066a38194971e
2020-11-13 01:48:01 -08:00
svcscm
755c61166f Updating submodules
Summary:
GitHub commits:

660d9244c1

Reviewed By: 2d2d2d2d2d

fbshipit-source-id: 8226b0a2396ccfac891835a49b5e6a35c0f54a88
2020-11-13 01:48:01 -08:00
svcscm
50966da984 Updating submodules
Summary:
GitHub commits:

5cef249c79
13623b3cb7

Reviewed By: 2d2d2d2d2d

fbshipit-source-id: 6a3fa67fe14833ebc06390bfbf49c43138514aea
2020-11-12 22:05:37 -08:00
Durham Goode
2318aa3197 remotefilelog: remove n^2 wirepack behavior
Summary:
The wirepack sending code builds up the entire history blob in memory
before sending it. Previously we did this by appending to the string. In Python
2 this was fast, in Python 3 this is n^2 and n can be 100k+ in cases of long
history.

Let's switch to list+join.

Reviewed By: xavierd

Differential Revision: D24933183

fbshipit-source-id: 5c36d7868e7c64a2292bd68ec2ffb584d85dd98f
2020-11-12 22:02:04 -08:00
svcscm
f789e2d74c Updating submodules
Summary:
GitHub commits:

ceee59a706
60af964372

Reviewed By: 2d2d2d2d2d

fbshipit-source-id: 2c68884514614e64269d6baeefc2058f68fa0906
2020-11-12 22:02:04 -08:00
svcscm
019c38ab47 Updating submodules
Summary:
GitHub commits:

6277fbe00e
1df1fe689b
bb69b4ce7f

Reviewed By: 2d2d2d2d2d

fbshipit-source-id: 69040ffc8845cfb30ae07500f4558f32eb5cf427
2020-11-12 18:11:58 -08:00
Wez Furlong
98c18ed7a8 edenfs: brace for macfuse
Summary:
osxfuse is rebranding as macfuse in 4.x.

That has ripple effects through how the filesystem is mounted and shows up in
the system.

This commit adjusts for the new opaque and undocumented mount procedure and
speculatively updates a couple of other code locations that were sensitive to
looking for "osxfuse" when examining filesystems.

Reviewed By: genevievehelsel

Differential Revision: D24769826

fbshipit-source-id: dab81256a31702587b0683079806558e891bd1d2
2020-11-12 18:09:19 -08:00
Durham Goode
93ae8ba357 sparse: fix xoring of None
Summary:
We got a [report](https://fb.workplace.com/groups/scm/permalink/3379140858802177/) that a new hg build fails with an error because it can't xor None types.

```
thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: PyErr {
ptype: <type 'exceptions.TypeError'>, pvalue: Some("unsupported operand type(s)
for ^: 'NoneType' and 'NoneType'"), ptraceback: Some(<traceback object at
0x00000249BB158248>) }',
```

Full stack trace is here
{P149395441}

This seems likely to be related to the diff I landed recently - D24725902 (7b1798be37).
However it's unclear why it was affecting only windows because I couldn't repro
it on linux.

Turned out that we have experimental.treematcher option disabled on windows,
which causes it to use includematcher instead of treematcher. And includematcher
returns either None or BytesMatchObject and they are impossible to xor.

This diff fixes it by converting them value to bool first, and also it adds a
test for it.

Reviewed By: singhsrb

Differential Revision: D24918192

fbshipit-source-id: 1359e8b97d26d3b1a4795b7b3d4cfa3d6d4ae843
2020-11-12 17:34:07 -08:00
svcscm
0d372cc2c0 Updating submodules
Summary:
GitHub commits:

dcddc5c0d2

Reviewed By: 2d2d2d2d2d

fbshipit-source-id: 98894dfa5dd0041773050830ff0560aab4a797aa
2020-11-12 17:34:07 -08:00
svcscm
1f2301bb3d Updating submodules
Summary:
GitHub commits:

6272327968
e5bb59b39f
941e2a4267
2fb3b7b6a1
4936049350

Reviewed By: 2d2d2d2d2d

fbshipit-source-id: d5c04129ce755ff8cfe278959abf44d819c92f9f
2020-11-12 16:11:50 -08:00
Genevieve Helsel
4cb299af60 externally log result of fsck scans
Summary:
It would be nice to see if there was a fsck on startup, the duration of the fsck, and if it was able to repair all of the problems or not. This diff adds external logging for fsck runs on daemon start.

duration: how long the fsck took
success: false if was not able to repair errors, true if repaired all errors or didn't have to repair at all
attempted_repair: true if we found problems, false otherwise

Reviewed By: chadaustin

Differential Revision: D24774065

fbshipit-source-id: 2fa911652abec889299c74aaa2d53718ed3b4f92
2020-11-12 13:47:50 -08:00
svcscm
01b3042a87 Updating submodules
Summary:
GitHub commits:

501ea69c72

Reviewed By: 2d2d2d2d2d

fbshipit-source-id: 40e5b1f5b7b5b852d30000933ad14c7000127cff
2020-11-12 13:47:50 -08:00
svcscm
8d6f01fef1 Updating submodules
Summary:
GitHub commits:

9cf1b57ccc
33d42f092f
5be956cf83
cfa6e9c67c
c6d72e3435
48afd91bb1
1cd762b705
4aa1abee17
98e0149906
0ba7b0ff9f
f7f4f7824a
37a5099793

Reviewed By: 2d2d2d2d2d

fbshipit-source-id: 774a710b0b329abf97526a21956cab4b02afd9e2
2020-11-12 11:38:09 -08:00
Mark Juggurnauth-Thomas
e8e7b7304a fileblob: flush and sync new file blobs
Summary:
To ensure other parts of Mononoke can fully read new blobs as soon as they've
been written, ensure their buffers are flushed and they've been synced to disk
before returning from the blob put.

Reviewed By: krallin

Differential Revision: D24921657

fbshipit-source-id: df401470aaeeebcdc9d237271b40a399115ba25f
2020-11-12 11:21:55 -08:00
Durham Goode
21468d204c lfs: make lfs http version configurable
Summary:
We've seen http 2 potentially causing hangs for users. Let's make this
configurable for lfs, so we can disable it and see if things get fixed.

Reviewed By: krallin

Differential Revision: D24898322

fbshipit-source-id: dc7842c0247dc6b9590a1f160076b17788aab1b9
2020-11-12 10:59:50 -08:00
Durham Goode
d219661164 http-client: make http version configurable
Summary:
As discussed in a group thread (see link below), HTTP 2 may be causing
hangs for users. Let's start by making the http-client configurable. In
subsequent diffs we'll make edenapi and lfs configurable as well.

Reviewed By: krallin

Differential Revision: D24898323

fbshipit-source-id: f0035a1b8df3cee626ebe519e9e99358c1b3f043
2020-11-12 10:59:50 -08:00
Michel Salim
a00ee9ffee add shared library support to add_fbthrift_cpp_library
Summary:
`add_fbthrift_cpp_library` should honor `BUILD_SHARED_LIBS`, and call
`add_library` with the right setting (`SHARED` if enabled, `STATIC` otherwise)

Reviewed By: yns88

Differential Revision: D24911124

fbshipit-source-id: 79df7640a758a592a3df3e9e79bb129dd57f2d47
2020-11-12 10:57:28 -08:00
Luca Niccolini
375b1b1cf0 add zlib as an explicit dependency for getdeps build
Summary:
needed for QUIC/H3 interop

also make it possible to run getdeps build with extra arguments (--no-tests for
example)

Reviewed By: mjoras

Differential Revision: D24925777

fbshipit-source-id: fbdc1aa56e398d295ef8dac0ad0bab03bd7bd803
2020-11-12 10:32:19 -08:00
svcscm
b57155abd4 Updating submodules
Summary:
GitHub commits:

a1b12752c8
d0cc6fbb2c
45e4cc1438

Reviewed By: 2d2d2d2d2d

fbshipit-source-id: 93b52cda1cac2ae985cfaaa8e8e2c7f55d546581
2020-11-12 10:32:19 -08:00
svcscm
e0f8c5621c Updating submodules
Summary:
GitHub commits:

49a418ea77

Reviewed By: 2d2d2d2d2d

fbshipit-source-id: b6a7362326f04eab572db661466ce26343e46714
2020-11-12 07:55:30 -08:00
Thomas Orozco
3493466385 thrift/compiler: annotate Rust doctests as just text
Summary:
This isn't code that compiles, but the convention in Rust is that code actually
is doctests unless annotated otherwise, so if tested with Cargo, those fail.

This fixes that.

Reviewed By: farnz

Differential Revision: D24917364

fbshipit-source-id: 62fe11700ce561c13dc5498e01d15894b17b5b22
2020-11-12 06:01:47 -08:00