Commit Graph

2954 Commits

Author SHA1 Message Date
svcscm
541029ba4d Updating submodules
Reviewed By: zpao

fbshipit-source-id: 6b3c29d46cdad8cf58d11b6f0911ccda39c7f214
2019-08-21 21:01:09 -07:00
Wez Furlong
3d917744ce watchman: only enable eden support for FB internal builds
Summary:
This simplifies things for the OSS CI situation in
the short term, especially since Eden isn't quite buildable
or usable outside FB at this time.

Reviewed By: chadaustin

Differential Revision: D16953346

fbshipit-source-id: 028150bb3cfc9a8ccbe1197321214b56ad359463
2019-08-21 20:29:07 -07:00
svcscm
5a43f47f11 Updating submodules
Reviewed By: zpao

fbshipit-source-id: 44bb6391719c0472774333328654f0711e8602fb
2019-08-21 17:57:29 -07:00
Chad Austin
c89607f129 build fuse_tester with open source gflags
Summary: Allow building fuse_tester with open source gflags and glog.

Reviewed By: strager

Differential Revision: D16636221

fbshipit-source-id: 5128e936d5a6b6d0ed33bf34b770ee661728af3f
2019-08-21 17:22:46 -07:00
svcscm
908a64b94a Updating submodules
Reviewed By: zpao

fbshipit-source-id: 33f119a97529f4777aee6378082253a6a956f8e9
2019-08-21 17:22:45 -07:00
svcscm
3b9f79ea66 Updating submodules
Reviewed By: zpao

fbshipit-source-id: 80fc0e60f538ca79d31c3152db76cbb9aff10831
2019-08-21 11:20:14 -07:00
Luca Niccolini
cf75a6ba8e do not build proxygen and mvfst for Windows (yet)
Summary:
does not affect the github build.
this is for fb CI

Reviewed By: dddmello

Differential Revision: D16935982

fbshipit-source-id: 61656fa600f19438b5aa89486486ed4ee103dea4
2019-08-21 10:57:35 -07:00
svcscm
dee1387199 Updating submodules
Reviewed By: zpao

fbshipit-source-id: 49d96e515f94bb383f58748eca6fdcc7ac913193
2019-08-21 10:57:35 -07:00
svcscm
cdf1f26cee Updating submodules
Reviewed By: zpao

fbshipit-source-id: f684cffe7928485da7d9c977720ec78b70e33d82
2019-08-20 16:03:11 -07:00
Wez Furlong
b0da5d8238 getdeps: fixup testpilot new test recording
Summary:
In the Facebook infrastructure the testpilot runner talks
to a service to determine whether a given test should be run locally.

The remote service was returning an error for some tests because they
didn't have enough configuration specified.

This diff associates some configuration with the tests based on the
host type and makes things happier.

Reviewed By: Ben0mega

Differential Revision: D16894682

fbshipit-source-id: b6f59b112991160ef26cc126e98041d8908a6273
2019-08-20 15:43:32 -07:00
Adam Simpkins
b918dab7cd fix "eden prefetch" to find the edenfs daemon correctly
Summary:
Update the `eden prefetch` code to use the `require_checkout()` function,
which correctly finds the correct EdenFS instance that is serving this
checkout.  Previously the prefetch logic found the default EdenFS instance,
which may be different from the one that was serving the specified checkout.

Reviewed By: wez

Differential Revision: D16878489

fbshipit-source-id: fed366df61960b5b87399bcd1d2f3f79aefc8dba
2019-08-20 15:35:31 -07:00
svcscm
0b2adfac01 Updating submodules
Reviewed By: zpao

fbshipit-source-id: dd95d921c8b2a7242580c813a4c7d5074d3af9f3
2019-08-20 15:35:30 -07:00
svcscm
a4e9279463 Updating submodules
Reviewed By: zpao

fbshipit-source-id: d7788cb91160f1fddff2b8df7e178c7ef1548636
2019-08-20 09:49:59 -07:00
svcscm
60aedc13ea Updating submodules
Reviewed By: zpao

fbshipit-source-id: 2ab340da3d83e6031a70099de61be188a59c0259
2019-08-20 09:49:59 -07:00
svcscm
03144ccb16 Updating submodules
Reviewed By: zpao

fbshipit-source-id: 083264d2b5f45df19d40bb87b7bb66285c36c8a6
2019-08-19 11:42:58 -07:00
Adam Simpkins
53f8ded39e fbcode_builder: CMake functions for building standalone python programs
Summary:
Add some CMake functions for building standalone executables from Python
source files.  This generates executables similar to PEX
(https://github.com/pantsbuild/pex).

In the future this could potentially be leveraged to directly build XAR files
(https://github.com/facebookincubator/xar).

The main advantages of these functions is that they allow easily defining
"libraries" of python files, and their dependencies, which can then be used
and packaged as part of multiple different standalone executables.

Reviewed By: wez

Differential Revision: D16722499

fbshipit-source-id: e1d829b911dc428e5438b5cf9cebf99b3fb6ce24
2019-08-19 11:08:34 -07:00
svcscm
4534e72815 Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: 306d2a6f53cd045bd821a0d4e90e84e1a0179ca2
2019-08-19 11:08:34 -07:00
svcscm
5f84263ae8 Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: e7188b7b391c9b1387516f958a9122a10a6f6e92
2019-08-18 16:21:40 -07:00
svcscm
a21a621cd4 Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: 46e10115c52ac820d5911250c4390c04b4bb4b12
2019-08-17 18:21:50 -07:00
svcscm
5da58ab496 Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: db4295df02abcf7699c45a48b01154e32ad04d5f
2019-08-16 18:12:38 -07:00
generatedunixname89002005289445
01d06886cb Update pyre version for eden
Summary: Automatic upgrade to remove `version` override and silence errors.

Reviewed By: sinancepel

Differential Revision: D16863919

fbshipit-source-id: c76f41992b9a1a57080eed932724b65c1fd846f5
2019-08-16 14:44:25 -07:00
svcscm
3627152f69 Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: 18643c0b82eaf7436633f902f05f1b2404334527
2019-08-16 12:21:01 -07:00
Chad Austin
2e323b284d switch to fb303's copy of StartingGate
Summary: Now that StartingGate is in a more accessible dependency, use it in Eden's benchmarks.

Reviewed By: strager

Differential Revision: D16705853

fbshipit-source-id: 79ab9e9b32ab93f5b50a06a4889edb5e7b0d7e8b
2019-08-16 11:13:31 -07:00
svcscm
41be5afe0e Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: 0010637ad7fda2d0a56731778b5def92b5ea43eb
2019-08-16 11:13:30 -07:00
svcscm
836d4d02c7 Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: adcf32d04bacad4a77fb9f5e1598eccf6e515f5b
2019-08-15 20:46:47 -07:00
Wojciech Lis
f08c0d4564 eden debug file_stat - add --sizes arg to tool
Summary:
eden debug file_stat - add --sizes arg to tool
Currently using naive shell call and temprary file to store all of the paths to
get the sizes. This is significantly slower than running without sizes and will
be replaced with proper sizes provided by eden thrif call in the future.

This is sufficient to establish the structure of the output of this command and
start integrating it with sandcastle

Reviewed By: strager

Differential Revision: D16836053

fbshipit-source-id: ad47416a0036d1046768fa9b9b6c9dfefbb8edd4
2019-08-15 19:47:39 -07:00
svcscm
2d1616b88b Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: e757c7a80edc58430b7019c7e1ecbc20e278ceeb
2019-08-15 18:37:22 -07:00
Adam Simpkins
117f32ca05 getdeps: distinguish build vs install steps in run_cmake.py
Summary:
Update the generated `run_cmake.py` script to allow the caller to specify that
they just want to run a build without the install step.

Reviewed By: wez

Differential Revision: D16778007

fbshipit-source-id: 1859aca2b80fa7b099b4790682a6508e0185f2a0
2019-08-15 17:58:29 -07:00
Adam Simpkins
e4fca4936d getdeps: honor INSTALL_DIR correctly in the generated run_cmake.py script
Summary:
This cleans up how the `CMAKE_ENV` and `CMAKE_DEFINE_ARGS` variables are
written in the generated `run_cmake.py` script that we emit for CMake-based
projects.

We now emit each entry in these variables on separate lines, just to improve
readability.  (Both of these variables tend to have a number of entries and
are very long if emitted on a single line.)

This also replaces the `-DCMAKE_INSTALL_PREFIX` entry in `CMAKE_DEFINE_ARGS`
to have it correctly honor the `INSTALL_DIR` variable defined in
`run_cmake.py`.  This makes `run_cmake.py` still do the right thing if someone
manually edits it to change the `INSTALL_DIR` value.

Reviewed By: wez

Differential Revision: D16778006

fbshipit-source-id: fee5d25748b87b5d9c57ee2edf8de5e586e872ee
2019-08-15 17:58:29 -07:00
Adam Simpkins
39fdad4d3a getdeps: allow overriding project source, build, and install directories
Summary:
Add arguments to getdeps.py to allow overriding the source, build, and install
directories a per-project basis.  The arguments take the form `[PROJECT:]PATH`
If the `PROJECT` portion is omitted, it defaults to the current project being
built.

In particular this makes it possible to specify `--src-dir .` to tell
getdeps.py to find the project sources from the current directory rather than
downloading them.

Reviewed By: wez

Differential Revision: D16778011

fbshipit-source-id: f33b87213ace04abb66334f588babdf59df91964
2019-08-15 17:58:29 -07:00
Adam Simpkins
c7a0ad4b36 getdeps: fix a crash if the project_hashes directory does not exist
Summary:
This makes getdeps.py no longer crash if used in the folly repository.
Folly does not depend on any other Facebook projects, so it does not
include a `build/deps` directory.

Reviewed By: wez

Differential Revision: D16778009

fbshipit-source-id: 41be53d862f41b62154b081eb90ddba8742658fe
2019-08-15 17:58:28 -07:00
Adam Simpkins
78a214307e getdeps: consolidate code for project subcommands
Summary:
Most of the getdeps subcommands operate on a single project, and some of the
argument parsing and initial logic to load the project is largely the same.
This consolidates that logic into a base class so that we can share this code
across subcommands, instead of repeating it.

This also unifies the behavior so that by default all commands enable tests on
the specified project, and disable test on dependent projects.  Making sure
all commands use the same behavior here is important as whether are not tests
are enabled can affect the project configuration, and therefore affect its
getdeps hash.

Reviewed By: wez

Differential Revision: D16778010

fbshipit-source-id: 044f99ad6cdd4a56f843276cec8ead786249ee7a
2019-08-15 17:58:28 -07:00
Wojciech Lis
4fe5642b14 Formatting the output of the eden debug file_stats as json
Summary:
Formatting the output of the eden debug file_stats as json
This will make it easier to use with further tooling to analyze and build
actionable statistics.

Reviewed By: strager

Differential Revision: D16832739

fbshipit-source-id: fb90ff59f121eeac3bf4865956ed5314ce243844
2019-08-15 16:24:47 -07:00
svcscm
c3641decf8 Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: a9887337afc578680e3c6a43afd51246caca685e
2019-08-15 14:36:54 -07:00
Wez Furlong
6e127b8bd8 eden: fixup spurious errors when using prefetch --pattern-file
Summary:
our argparse stuff was configured to require 1+ patterns
which meant that an invocation like:

```
echo 'fbcode/eden/fs/TARGETS' | eden prefetch --pattern-file /dev/stdin
```

would emit:

```
eden prefetch: error: the following arguments are required: PATTERN
```

the workaround was to specify a dummy pattern argument.

This diff fixes up the argparse config to make the pattern argument be 0+ patterns.

Reviewed By: pkaush

Differential Revision: D16831732

fbshipit-source-id: 93cb4c4677b1af8b9d4824bcad60708c40867375
2019-08-15 14:02:17 -07:00
Wez Furlong
87dad4e133 eden: remove b'filename' from eden prefetch output
Summary:
This was an unanticipated casualty of some unicode vs bytes
work in the past, and we hadn't gotten around to fixing this... until now!

Reviewed By: pkaush

Differential Revision: D16831603

fbshipit-source-id: dd38751e6d0b1c242937a7dbb150f3aa15d1c8ae
2019-08-15 14:02:17 -07:00
svcscm
a241a6941f Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: 15cf80855f4d10a242c7ed38f39de9d8409ed6cc
2019-08-15 14:02:16 -07:00
svcscm
15de398467 Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: f6ffa442b1541648352985c520155ee1a15926ca
2019-08-14 23:56:31 -07:00
Wez Furlong
a7ddbe513b eden: fixup typechecker errors on linux
Summary: The type checker doesn't understand `windll`.  Sanest path is to leave the kernel of this function untyped.

Reviewed By: strager

Differential Revision: D16820160

fbshipit-source-id: 47c1bb5f29b790b48dd28d3b1b1e21b50722eb12
2019-08-14 19:55:33 -07:00
svcscm
02b35131b4 Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: 731dc637a4f543f912bf7a55051c8163f21e97c6
2019-08-14 19:31:40 -07:00
Puneet Kaushik
07958c15ff Implement eden prefetch for Windows
Summary: On POSIX system we use InodeTree structure to implement prefetch. These structures are missing on the Eden Windows. We will instead use mercurial's prefetch to prefetch the contents for us.

Reviewed By: strager

Differential Revision: D16742336

fbshipit-source-id: db0a389503cb98469707c07b6da412056f4dd72e
2019-08-14 19:11:33 -07:00
Puneet Kaushik
a043a4bb35 Updated get_eden_mount_name() to find the eden mount name on Windows
Summary: On Windows, we create a .eden on the root of the repo as compared to in each directory. Updating get_eden_mount_name() to look for .eden in the current parent path.

Reviewed By: strager

Differential Revision: D16742335

fbshipit-source-id: 2d27c54895917524d3d9c233ccc723b51f33f032
2019-08-14 19:11:33 -07:00
Puneet Kaushik
5bd4a8c788 Create .eden at the repo root and store config in it.
Summary: On Linux and Mac, we provision .eden inside every directory, which contains symlinks to other locations. On Windows this won't work as well. First, Projected FS will cache all the .eden and will bump up the number of files on the disk. Second, it would be hard to simulate symlinks from Projected FS.

Reviewed By: strager

Differential Revision: D16724354

fbshipit-source-id: a560698fae8c7f14e475f1c1fb9ecc53e60c189f
2019-08-14 19:11:33 -07:00
svcscm
49882e6dbe Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: b75992be2b9a97040275972abed6a6d25af0a8c0
2019-08-14 19:11:33 -07:00
svcscm
4ab4b081d2 Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: a85a5b8258ce777e5001b0973e173707c729b8e4
2019-08-14 16:39:21 -07:00
svcscm
685418899d Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: 559f1bf10ad130b2139dbf3f9fa06dafed658365
2019-08-14 16:39:21 -07:00
svcscm
c4c460c3e2 Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: c762765b41313e645b8a25516197c7cac293fded
2019-08-14 12:55:11 -07:00
Puneet Kaushik
19aca3a6b2 edenfsctl starts edenfs in background on Windows
Summary: Until now we were running Edenfs on the console. Now we could use edenfsctl start.

Reviewed By: chadaustin

Differential Revision: D16565624

fbshipit-source-id: 9a12e52234d36d7b8ce4e3741ffb62655ae334b2
2019-08-14 12:11:05 -07:00
svcscm
16ddf64dd9 Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: 45a666d17339c7e458f476768e96c2c6e8302b62
2019-08-14 12:11:05 -07:00
svcscm
2ab3e8ef4a Updating submodules
Reviewed By: cdelahousse

fbshipit-source-id: 62dc21b9ccbc77b59ce2881ce82b5e5dc105b511
2019-08-13 14:38:43 -07:00