Commit Graph

187 Commits

Author SHA1 Message Date
Samir Talwar
b93f473c1c
dev-env: Don't use the "extra-" prefix in nix.conf. (#12306)
It turns out this prefix is only supported as of Nix 2.4.

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-07 11:19:40 +00:00
Samir Talwar
3b8a9e4432
Revert "devenv: Just require Nix v2.4 or newer." (#12299)
This reverts commit ed442fa8ae.

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-06 18:02:21 +00:00
Samir Talwar
854b66ee2f
devenv: Use NIX_USER_CONF_FILES to set caches. (#12265)
* devenv: Factor out a function to get the Nix version.

* devenv: On newer versions of Nix, use `NIX_USER_CONF_FILES`.

This stacks, rather than overwrites.

* devenv: Append Nix caches, instead of overwriting them.

The "extra-" prefix tells Nix to append.

We also switch to non-deprecated configuration keys.

CHANGELOG_BEGIN
CHANGELOG_END

* devenv: Just require Nix v2.4 or newer.

* devenv: `NIX_USER_CONF_FILES` may not be set already.
2022-01-05 13:24:52 +01:00
Gary Verhaegen
c673d1fe56
add lf extension to copyright script (#12259)
As requested by @cocreature in #12249.

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-04 16:49:01 +00:00
Gary Verhaegen
ea55ea2d14
Further copyright updates (#12249)
Somewhat error-prone, so please review carefully.

Reasons we need this:

- Some file types are not properly handled by the script.
- The only exclusion mechanism we currently have (`NO_AUTO_COPYRIGHT`)
  is overly coarse.

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-04 16:32:17 +01:00
Gary Verhaegen
d2e2c21684
update copyright headers (#12240)
New year, new copyright, new expected unknown issues with various files
that won't be covered by the script and/or will be but shouldn't change.

I'll do the details on Jan 1, but would appreciate this being
preapproved so I can actually get it merged by then.

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-03 16:36:51 +00:00
Moritz Kiefer
f847767e36
Avoid nix result-* symlinks on CI (#12220)
We really don’t want those anywhere and they currently trip up
blackduck which starts scanning our nix store.

changelog_begin
changelog_end
2021-12-21 07:59:02 -05:00
Andreas Herrmann
4ed9deda39
Remove xxd from dev-env (#11876)
The corresponding Nix attribute is missing
```
$ xxd
[dev-env] Building tools.xxd...
error: attribute 'xxd' in selection path 'tools.xxd' not found
[dev-env] Build of tools.xxd has failed!
```

changelog_begin
changelog_end

Co-authored-by: Andreas Herrmann <andreas.herrmann@tweag.io>
2021-11-25 11:01:04 +00:00
Moritz Kiefer
32e9c4b13a
Bump go rules (#11829)
* Bump go rules

Was debugging something else and this seemed simple enough to factor
it out.

changelog_begin
changelog_end

* Bump Bazel on Windows

changelog_begin
changelog_end

* bump bazel manifest

changelog_begin
changelog_end
2021-11-23 18:58:55 +00:00
Moritz Kiefer
350ad983ea
Bump Windows postgres (#11804)
The old URL returns a 404 now

changelog_begin
changelog_end
2021-11-22 10:38:54 +00:00
Andreas Herrmann
39a38d3a37
Update to Java 11 (#11512)
* Update to Java 11

changelog_begin
changelog_end

* Fix RoundingMode deprecation warnings

* Fix dep-ann warning

* Integer constructor

* JavaX annotation dependency

* javax.xml.bind was removed in Java 11

Using Guava as a replacement, since it is already a project dependency.

* JDK 11 no longer has a separate JRE tree

* Remove unused jdk_nix import

* remove now redundant jdk11_nix

* Java 8 --> 9 increased Instant.now() precision

See https://bugs.openjdk.java.net/browse/JDK-8068730

The precision of `Instant.now()` increased between Java 8 and Java 9.
On Linux and MacOS this doesn't seem to be a problem, as the precision
still seems to be at micro seconds. However, on Windows this now causes
errors of the following form:
```
java.lang.IllegalArgumentException: Conversion of Instant
2021-11-05T13:58:56.726875100Z to microsecond granularity would result
in loss of precision.
```
Suggesting that it now offers sub-microsecond precision.

`TimestampConversion.instantToMicros` had a check to fail if the
conversion lead to a loss of precision. In the specific failing test
case this is not a concern, so this adds a `roundInstantToMicros`
variant that avoids this kind of error.

* TMP round timestamps

* Revert "TMP round timestamps"

This reverts commit af8e261278.

* Skip versions before 1.6.0 in migration tests

changelog_begin
changelog_end

Co-authored-by: Andreas Herrmann <andreas.herrmann@tweag.io>
2021-11-18 14:48:37 +00:00
Moritz Kiefer
9214956218
Enable experimental nix command (#11498)
* Enable experimental nix command

Nix 2.4 got released which confusingly marked the nix command as
experimental despite it being actively worked on and being more stable
than before.

changelog_begin
changelog_end

* switch to CLI flag

changelog_begin
changelog_end

* Revert "switch to CLI flag"

This reverts commit 58d6a25d83.
2021-11-02 10:16:38 +00:00
Moritz Kiefer
55d35e5521
Drop TLA+ from dev-env (#11492)
Our build definitely does not depend on it. If people need it for
something else they can get it from somewhere else.

changelog_begin
changelog_end
2021-11-01 20:45:38 +00:00
Moritz Kiefer
bdad7d5c99
Upgrade Java on Windows (#10965)
* Upgrade Java on Windows

No reason to be stuck on an older patch release.

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end
2021-09-22 15:54:59 +00:00
Moritz Kiefer
3e13e3d87e
Switch to stable urls in scoop python manifest (#10933)
The file changed in the master branch which broke our builds :(

changelog_begin
changelog_end
2021-09-20 12:06:58 +02:00
akshayshirahatti-da
4525b8c265
[JSON-API] vanilla oracle_perf ci job (#10688)
* vanilla job test on main pipeline

changelog_begin
changelog_end

* move job to daily compat tests

* add timeout to dev-env and changes based on code review
2021-09-02 09:31:56 +01:00
Andreas Herrmann
663781a159
Update curl 7.73.0 --> 7.78.0 (#10655)
The download link for the old version 7.73.0 returns 404.

changelog_begin
changelog_end

Co-authored-by: Andreas Herrmann <andreas.herrmann@tweag.io>
2021-08-24 13:45:27 +00:00
Robin Krom
0c1878530b
test: test for platform independent dars (#10535)
We add a CI test to check that dars don't depend on the underlying
operating system where the dar is build.

CHANGELOG_BEGIN
CHANGELOG_END
2021-08-17 18:59:12 +02:00
Miklos
4d1249390e
Introduce buf checks [KVL-980] (#10411)
CHANGELOG_BEGIN
CHANGELOG_END
2021-07-27 16:23:39 +02:00
Andreas Herrmann
6db58695ad
Update vcredist (#10417)
Otherwise Bazel fails to run on Windows server 2019. The symptoms are
the same as with previous vcredist version issues. I.e. any Bazel
command, even `bazel version`, exits immediately and silently.

changelog_begin
changelog_end

Co-authored-by: Andreas Herrmann <andreas.herrmann@tweag.io>
2021-07-27 13:43:21 +02:00
Andreas Herrmann
ad13a86947
Windows dev-env Powershell 7 compatibility (#10408)
* Remove ServerCertificateValidationCallback

Causes issues as in https://github.com/PowerShell/PowerShell/issues/13597

* Get-ChildItem -Name

As of powershell 7 `Get-ChildItem` returns absolute paths which breaks
the later path concatenation `"$Directory\$file"`. This change instructs
`Get-ChildItem` to only return the file name, not the full path.

changelog_begin
changelog_end

Co-authored-by: Andreas Herrmann <andreas.herrmann@tweag.io>
2021-07-26 16:53:23 +02:00
Gary Verhaegen
0e83d3ee45
add tar to dev-env (#10173)
It's already in default.nix, but there was no symlink in `dev-env/bin`.

I need it for #10162 but it felt worth a separate PR.

CHANGELOG_BEGIN
CHANGELOG_END
2021-07-05 12:26:35 +02:00
Moritz Kiefer
a44afcff42
Upgrade nixpkgs (#9908)
* Upgrade nixpkgs

changelog_begin
changelog_end

* Upgrade Bazel on Windows

changelog_begin
changelog_end

* bump bazel hash

changelog_begin
changelog_end
2021-06-24 13:58:56 +00:00
Samir Talwar
e32856ecf4
dev-env: Use nix-shell for scripts instead of sourcing dade-common. (#10088)
* Introduce shell.nix to expose the Nix tooling, if required.

* dev-env: Rewrite the ghcide script to use nix-shell.

* language-support/hs: Use `nix-shell` for export-package.sh.

* Nix: Add a shebang to the Bazel wrapper script.

CHANGELOG_BEGIN
CHANGELOG_END

* dev-env: Standardize the `set` header in `ghcide`.
2021-06-23 09:39:00 +00:00
Samir Talwar
682c096d4f
dev-env: Remove some unused stuff. (#10087)
* dev-env: Replace `gpg` and `make` with symlinks.

* dev-env: Remove sphinx-autobuild. It's brought in by pipenv.

* dev-env: Remove Python 3.6 references. They seem to be unused.

CHANGELOG_BEGIN
CHANGELOG_END
2021-06-23 08:13:38 +00:00
Moritz Kiefer
7ea9340d64
Support old bash in daml-sdk-head (#9593)
changelog_begin
changelog_end
2021-05-06 12:44:19 +02:00
Moritz Kiefer
2de2b13346
Fix typo in daml-sdk-head (#9570)
We don’t want to disable the SDK build by default.

changelog_begin
changelog_end
2021-05-04 12:21:25 +00:00
Moritz Kiefer
ecad128123
Speed up daml-sdk-head Maven installation (#9559)
This PR speeds up the Maven installation by doing 4 things:

1. Disable TS builds. This doesn’t make sense since we never install
them.
2. Add a --skip-sdk option that skips the SDK installation.
3. Add a --skip-jar-docs option that skips javadoc and more
importantly scaladoc.
4. Add a --scala-version=$VERSION option to only build against the
given version.

Unfortunately there are no tests and the CLI is a bit messy (you need
--scala-version=$VERSION and not --scala-version $VERSION).

Both are not great but this is a development only tool and it is bash
so my motivation for fixing it is rather low.

Given that this is growing in complexity a fair bit, I think we might
be better off as a long-term solution to move this towards at least
python or maybe even Haskell or Scala. But definitely nothing for this
PR.

changelog_begin
changelog_end
2021-05-03 18:39:45 +02:00
Stefano Baghino
e1e878a597
Simplify opt-in/out of Oracle when building (#9515)
* Simplify opt-in/out of Oracle when building

- defines Oracle-related environment variables as part of dev-env so that it's the same across CI and dev
- adds a Bazel 'oracle' configuration so that --config=oracle pulls all required environment

changelog_begin
changelog_end

* Address https://github.com/digital-asset/daml/pull/9515#discussion_r621180994

* Also use `$ORACLE_USERNAME` instead of `system` in the `sqlplus` connection string

* Address https://github.com/digital-asset/daml/pull/9515#discussion_r621186459
2021-04-28 06:10:43 +02:00
Moritz Kiefer
a1e898eb09
Add a flag to build daml-sdk-head EE (#9482)
changelog_begin
changelog_end
2021-04-23 11:44:02 +02:00
Gary Verhaegen
7c4b32aee9
use coreutils date on macos (#9228)
macOS uses BSD date by default which has slightly different options.

CHANGELOG_BEGIN
CHANGELOG_END
2021-03-24 13:35:02 +01:00
Moritz Kiefer
c327476da9
Upgrade msys packages (#9139)
* Upgrade msys2 packages

The old ones pull in dependencies that have disappeared.

changelog_begin
changelog_end

* No special assignment

changelog_begin
changelog_end
2021-03-15 12:08:36 +00:00
Moritz Kiefer
5cb857d902
Release EE SDK tarballs and installer (#9086)
* Release EE SDK tarballs and installer

As before, no way of testing this. I’ll do a snapshot afterwards.

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* Rename EE artifacts

changelog_begin
changelog_end
2021-03-11 14:49:48 +01:00
Gary Verhaegen
caa023b72e
ci/cron/check: remove dade-assist calls (#9048)
* ci/cron/check: remove dade-assist calls

We can only run this in a context where the dev-env is already set up
anyway, as that's how we get Bazel to build the script in the first
place.

CHANGELOG_BEGIN
CHANGELOG_END

* remove skip_java logic
2021-03-08 13:55:19 +00:00
Gary Verhaegen
121534c54d
ci/cron/check: low-hanging perf improvement (#9042)
Two quick improvements I made while waiting on #9039:
- Avoid loading Java. When looking at the logs flow by this seemed to be
  taking a huge amount of time.
- Isolate the gcloud config files, which allows for running gcloud
  downloads in parallel.

Together these reduce the `check_releases` runtime from about 5 hours to
about 2. There's much more (and smarter) work needed on this, but this
was really easy to do.

CHANGELOG_BEGIN
CHANGELOG_END
2021-03-08 07:56:33 +00:00
Moritz Kiefer
9dc3d2ace4
Upgrade to Bazel 4.0 (#8798)
* Upgrade to Bazel 4.0

changelog_begin
changelog_end

* Go back to default assignment

changelog_begin
changelog_end
2021-02-11 10:08:47 +01:00
Moritz Kiefer
773ddada04
Upgrade nixpkgs (#8190)
* Upgrade nixpkgs

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* No ibazel

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* Switch agent pool

changelog_begin
changelog_end

* .

* .

changelog_begin
changelog_end
2021-02-08 11:12:07 +00:00
Remy
e2c7dd05cc
tag the docker image build locally (#8760)
This was forgotten in #8745

also add a missing ''\" in the bash script.

CHANGELOG_BEGIN
CHANGELOG_END
2021-02-05 11:07:07 +01:00
Remy
2610026f5a
Script to build docker locally (#8745)
CHANGELOG_BEGIN
CHANGELOG_END
2021-02-04 11:11:35 +00:00
Gary Verhaegen
24a39d4c55
remove dependency-check (#8744)
It relies on a Bintray URL, which is likely to break soon as Bintray
sunsets.

It's also not been referenced by anything in this repo since at least
open-sourcing, so the value it provides seems low. There's no
documentation of why it's here and what its planned usage was, but based
on the [project page](https://github.com/jeremylong/DependencyCheck) I
imagine it's been supplanted by BlackDuck now.

CHANGELOG_BEGIN
CHANGELOG_END
2021-02-04 09:36:33 +00:00
Stefano Baghino
8ec9bc78dd
Add google-java-format to devenv as javafmt (#8687)
Add the https://github.com/google/google-java-format code formatting tool to dev-env.

Uses the name javafmt to call it, to mirror scalafmt.

Making it part of our checks will be done in a follow-up PR to make this easy to review.

changelog_begin
changelog_end
2021-01-29 13:59:26 +01:00
Gary Verhaegen
fef712bf60
Upgrade linux nodes to 20.04 (#8617)
CHANGELOG_BEGIN

- Our Linux binaries are now built on Ubuntu 20.04 instead of 16.04. We
  do not expect any user-level impact, but please reach out if you
  do notice any issue that might be caused by this.

CHANGELOG_END
2021-01-27 17:38:34 +01:00
Moritz Kiefer
e0c5abd647
Switch to GHC 8.10.3 (#8394)
* Switch to GHC 8.10.3

changelog_begin
changelog_end

* Update bazel-haskell-deps.bzl

Co-authored-by: Andreas Herrmann <42969706+aherrmann-da@users.noreply.github.com>

* Comment on rules_haskell patch

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

Co-authored-by: Andreas Herrmann <42969706+aherrmann-da@users.noreply.github.com>
2021-01-25 11:53:53 +00:00
Gary Verhaegen
58e8b9c40f
remove dade-test-sh (#8479)
Looks like an unfinished attempt at automating the running of inexistent
bats/osht tests.

CHANGELOG_BEGIN
CHANGELOG_END
2021-01-12 17:09:36 +01:00
Gary Verhaegen
28d9cea05e
remove jfrog-cli (#8477)
As far as I can figure out, this has been unused since #5422.

CHANGELOG_BEGIN
CHANGELOG_END
2021-01-12 15:01:01 +00:00
Moritz Kiefer
329685a57c
Bump jq on Windows (#8443)
msys seems to have forgotten about the old version for some reason
which now breaks our build due to a 404.

changelog_begin
changelog_end
2021-01-09 10:33:28 +01:00
Bernhard Elsner
cda93db944
Daml case and logo (#8433)
* Replace many occurrences of DAML with Daml

* Update docs logo

* A few more CLI occurrences

CHANGELOG_BEGIN
- Change DAML capitalization and docs logo
CHANGELOG_END

* Fix some over-eager replacements

* A few mor occurrences in md files

* Address comments in *.proto files

* Change case in comments and strings in .ts files

* Revert changes to frozen proto files

* Also revert LF 1.11

* Update get-daml.sh

* Update windows installer

* Include .py files

* Include comments in .daml files

* More instances in the assistant CLI

* some more help texts
2021-01-08 12:50:15 +00:00
Andreas Herrmann
a830dd44ea
Update VC redist to 14.28.29325.2 (#8431)
changelog_begin
changelog_end

Co-authored-by: Andreas Herrmann <andreas.herrmann@tweag.io>
2021-01-07 16:31:25 +00:00
Gary Verhaegen
cd858d53d5
remove buck-out (#8426)
Hopefully we don't need it anymore. 🤷

CHANGELOG_BEGIN
CHANGELOG_END
2021-01-07 14:53:33 +00:00
Gary Verhaegen
427179ab27
fix (some) copyright headers (#8422)
This commit fixes a few copyright headers that have been missed in the
automatic update on Jan 1, as well as the generation code in the compat
workspace so it generates the right headers.

CHANGELOG_BEGIN
CHANGELOG_END
2021-01-07 11:48:59 +01:00