f37b1ed37f
This is needed for the webide Docker image CI script. |
||
---|---|---|
.. | ||
aws | ||
base64 | ||
bats | ||
bazel | ||
bazel-api-docs | ||
bazel-deps | ||
bazel-project-view | ||
bibtex | ||
bq | ||
buck-out | ||
cabal2nix | ||
cc | ||
chromedriver | ||
circo | ||
convert | ||
coursier | ||
cqlsh | ||
cram | ||
curl | ||
da-ghci | ||
da-ghcid | ||
da-install-git-hooks | ||
da-sdk-head | ||
da-test-haskell-update-expected | ||
da-update-python-srcs | ||
da-virtualenv | ||
dad-add-source-dep.sh | ||
dade | ||
dade-assist | ||
dade-closure-size | ||
dade-collect-garbage | ||
dade-copyright-headers | ||
dade-env | ||
dade-freeze | ||
dade-help | ||
dade-info | ||
dade-init | ||
dade-list | ||
dade-list-broken-symlinks | ||
dade-pipenv-lock | ||
dade-preload | ||
dade-prepare-for-update | ||
dade-raw-preload | ||
dade-release-tool | ||
dade-test-sh | ||
daml-sdk-head | ||
data-uri | ||
dependency-check | ||
docker-credential-gcr | ||
dot | ||
fdp | ||
flake8 | ||
fsc | ||
gawk | ||
gcloud | ||
ghci | ||
ghcid | ||
gradle | ||
grpcurl | ||
gsutil | ||
hlint | ||
hub-detect | ||
ibazel | ||
ipython | ||
jar | ||
java | ||
javac | ||
jfrog | ||
jinfo | ||
jmap | ||
jo | ||
jq | ||
jstack | ||
latexmk | ||
license-checker | ||
live-server | ||
lualatex | ||
m4 | ||
make | ||
makeindex | ||
mvn | ||
nix-prefetch-git | ||
nix-update-src-json | ||
node | ||
node2nix | ||
nodetool | ||
npm | ||
openssl | ||
osht | ||
pandoc | ||
patch | ||
patchelf | ||
pdflatex | ||
pex | ||
pip3 | ||
pip3.6 | ||
pipenv | ||
protoc | ||
pypi2nix | ||
python | ||
python3 | ||
python3.6 | ||
python3.6-da | ||
README.md | ||
runpipenv | ||
sass | ||
sbt | ||
scala | ||
scalac | ||
scaladoc | ||
scalafmt | ||
scalap | ||
semver | ||
sha1sum | ||
shellcheck | ||
sphinx-autobuild | ||
sphinx-build | ||
sphinx-quickstart | ||
start-cassandra | ||
terraform | ||
thrift | ||
tlc2 | ||
tred | ||
unflatten | ||
update-bazel-deps | ||
wget | ||
xmlstarlet | ||
xxd | ||
yapf | ||
yarn | ||
zinc | ||
zip |
dade-nix-install
This tool installs DA-built Nix distribution for MacOS X or Linux. It downloads the release from:
Runtime prerequisites:
uname
,mktemp
,tar
,curl
,awk
to download and perform installationsudo
needed if and only if/nix/store
is not present or is not owned by the current user.
Notes:
- the script checks for High Sierra induced failure of Nix and would reinstall Nix installation automatically in this case.
dade-raw-preload
This tool is meant to be run from a root account and precache all relevant
dev-env provided tools on a given machine. It finds the right user to
impersonate and downloads most recently built tools from hydra.da-int.net
.
Runtime prerequisites:
- Nix installed in a single-user mode (e.g. via
dade-nix-install
) uname
andawk
to detect OS and architecturesudo
to perform the prefetch from under the owner of the/nix/store
It is used to preload dev-env caches on developers workstations. A developer can create a file which would disable the automatic precaching:
touch $HOME/.dade-raw-preload.skip
Note: downloaded tools are not added to Nix garbage collection roots, hence will
get deleted with next nix-collect-garbage
invocation.
Non-code dependencies:
- Hydra jobsets
Used by:
- Casper policy to deploy jobs (owned by Edward Newman) -- based of https://github.com/DACH-NY/da/blob/master/dev-env/bin/download-dade-service-script.sh
Tested by:
- https://github.com/DACH-NY/da/pipeline/jenkins/src/jobs/pipeline/dev-env/dadeRawPreload.Jenkinsjob
- http://ci.da-int.net/job/pipeline/job/dev-env/job/dade-raw-preload/
Implementation sketch:
- finds out the Nix store owner;
- checks for the skip file;
- finds the user's Nix profile and sources it;
- creates a temporary nix.conf to ensure
hydra.da-int.net
is used; - sets up a temporary nix-shell with required tools (e.g. jq);
- fetches all store paths from all last evaluations of all jobsets;
- downloads them (aka "realizes" with
nix-store -r
).
Wrapped tools
Once the dev-env is set up (either through direnv (recommended), or through
manually sourcing one of dev-env/profile_{z,ba}sh.sh
), the shell's PATH
will look through dev-env/bin
first for its executables. The executables in
there are mostly scripts that redirect the call to the corresponding nix-built
executable. However, having that script gives us an opportunity to wrap some
of those commands in special ways; this section is meant to document in what
ways the commands available in dev-env/bin
have been modified from their
vanilla variants.