Commit Graph

606 Commits

Author SHA1 Message Date
Gary Verhaegen
7387a7c92d
daily: disable http/pg perf test (#14442)
Since yesterday, this test is failing with an OOM error. I hoped I'd
have time to investigate today, but since I didn't and I'm off next week
disabling the test for now seems like the best option to let the overall
daily tests succeed.

The last known success was on 0bf28176a7,
and the first failure was on 444fff1fcf.
We don't test every commit, so any commit in-between could be the cause
of the issue.

Note that the failure does not seem to be flaky, but further testing may
be warranted.

CHANGELOG_BEGIN
CHANGELOG_END
2022-07-16 12:29:05 +02:00
Gary Verhaegen
c9070471cb
docker: bump base image (#14437)
CHANGELOG_BEGIN

- The base image used by the `digitalasset/daml-sdk` Docker image has
  been bumped from Ubuntu Focal to Ubuntu Kinetic. Please remember that
  this image is meant for demonstration purposes only and is not supported
  for use in any kind of production setup.

CHANGELOG_END
2022-07-15 16:06:55 -04:00
Gary Verhaegen
83bf6d60b1
remove Sofia and Robin from release rotation (#14356)
CHANGELOG_BEGIN
CHANGELOG_END
2022-07-05 20:55:12 +00:00
Gary Verhaegen
66f4b243f4
docs: fix top-level update (#14338)
There were two issues:

1. The `Directory.listFilesRecursive` function returns paths that
   include its first argument, so there was never any overlap between
   the sets.
2. That full path doesn't exist on AWS, and was given to AWS because
   `s3Path opts f` returns just `f` if it starts with `/`.

This means that, on the one hand, the script tried to delete
_everything_ from the top-level, which is a bit bad, but, on the other
hand, the script did not actually manage to delete anything at all,
which is basically the status quo.

Note that deleting everything isn't _that_ bad as we reupload right
after and we have a cache in front on the site, so this would only
impact users if they were the first to try and view a given page in that
small time window between deletion and reupload.

This PR should fix both issues by removing the version-specific prefix.

CHANGELOG_BEGIN
CHANGELOG_END
2022-07-04 21:27:36 +02:00
Gary Verhaegen
6cdb68daca
ci/cron: fix Wednesday (#14297)
There's a small, subtle bug that made its way into #14287: apparently
`/dev/stdout` is not defined on CI.

On the bright side, we don't actually need the `out` parameter, so
removing it seems like the easiest fix here.

CHANGELOG_BEGIN
CHANGELOG_END
2022-06-29 17:57:55 +02:00
Moisés Ackerman
6072629c7a
Request review for release rotation PR (#14287)
* Merge ci/cron/wednesday.yml open_pr function into ci/bash-lib.yml

* remove unused function reset from ci/cron/wednesday.yml

* Request review from current release person for rotation PR

changelog_begin
changelog_end
2022-06-28 19:45:37 +02:00
Gary Verhaegen
d6dd03751f
cron: faster check_releases (hopefully) (#14209)
The check_releases job has been a major player in the flakiness of the
daily test lately, simply by _timing out_ despite its 6h limit.

There are smarter, more "permanent" fixes we could implement here, but
as a quick stopgap measure I wanted to try out how much faster we would
go if we didn't need to reestablish a GCloud identity for each file.

CHANGELOG_BEGIN
CHANGELOG_END

run-full-compat: true
2022-06-17 17:56:51 +02:00
Gary Verhaegen
e78303332a
docs: fix top-level update function (#14204)
After yet another report of a ghost file, I stared at the code even
harder than before and finally figured out what was going wrong (or at
least one way it was going wrong): `listDirectory` is not recursive, so
the current code would only delete top-level files.

Hopefully this fixes that. I'll try to do some manual cleanup too.

CHANGELOG_BEGIN
CHANGELOG_END
2022-06-16 18:42:39 +00:00
Gary Verhaegen
928e2b8464
split releases: add parameter (#14032)
This adds parameters to the "split release" job. At the moment, when
run, the job just builds the current commit with a snapshot version.
With this change, we'll be able to build a split release for any commit
with any version tag.

The reason for this change is we want to trigger this job from the
assembly repo, to reduce the number of manual interventions needed in
the release process.

CHANGELOG_BEGIN
CHANGELOG_END
2022-06-03 11:40:48 +02:00
Brian Healey
4de1a5dc59
upgrade to latest released oracle 19.15 (#14079)
CHANGELOG_BEGIN
Update to ensure compatibility with Oracle 19.15
CHANGELOG_END
2022-06-02 18:33:54 -04:00
Gary Verhaegen
672a4bfb9c
fix daml-sdk Docker image (#14055)
It looks like the default image changed from Focal to Jammy, and for
whatever reason that completely breaks `curl`.

This pins us to Focal (for better or worse).

CHANGELOG_BEGIN
CHANGELOG_END
2022-06-01 17:58:22 +00:00
Moritz Kiefer
8143ce5c9c
Disable compat tests for forks (#13964)
They don’t get access to Oracle which just results in them failing
which is clearly no good.

changelog_begin
changelog_end
2022-05-24 10:07:57 +00:00
Claudio Bley
1343dcd827
Remove da_ghc_lib job from CI (#13949) 2022-05-23 15:36:02 +02:00
Gary Verhaegen
e9dc1efe2b
ci: bump Windows vmImage to 2022 (#12557)
Azure is telling us to stop using 2019, so I've updated the job to be
compatible with 2022. (And future Windows images, too.)

CHANGELOG_BEGIN
CHANGELOG_END
2022-05-12 15:02:43 +00:00
Gary Verhaegen
b795b484fc
docs: push source tree deps (#13814)
This PR collects and pushes to Artifactory the dependencies of the
sphinx-source-tree target. This is a first step in moving the actual
source tree to the docs repo.

CHANGELOG_BEGIN
CHANGELOG_END
2022-05-06 15:42:26 +00:00
Sergey Kisel
4c8e027d8d
Append release tag to artifacts published to artifactory. (#13789)
CHANGELOG_BEGIN
CHANGELOG_END
2022-05-04 15:21:56 +00:00
Hubert Slojewski
968ca24b17
Remove kvutils buf configuration and other leftovers [KVL-1427] (#13732)
CHANGELOG_BEGIN
CHANGELOG_END
2022-04-28 16:00:23 +02:00
Gary Verhaegen
9a98fa04f5
fix compat bump (#13702)
CHANGELOG_BEGIN
CHANGELOG_END
2022-04-26 15:46:46 +00:00
Gary Verhaegen
474bbe1327
restore compat update (#13663)
With the new 2.0.0 release process, we're not releasing from the main CI
build anymore, so the compat update PRs are not getting created.

This restores that by making those PR creations part of the daily CI
build.

CHANGELOG_BEGIN
CHANGELOG_END
2022-04-22 17:28:16 +02:00
Moisés Ackerman
611cce8c8c
Add parens in desugared code (#13603)
* Add parens around 'fromAnyException' view pattern in '_tryCatch' desugaring

* Add parens around desugared 'setField' calls and around its first argument.

* Update desugaring golden files

* Add golden test for parens around 'setField' in renamed daml

changelog_begin
changelog_end
2022-04-20 17:05:16 +00:00
Gary Verhaegen
e193f421c6
bump Bazel cache (#13635)
CHANGELOG_BEGIN
CHANGELOG_END
2022-04-20 02:53:43 +02:00
Gary Verhaegen
8a4b2c2844
fix bump-canton (#13626)
- Add notifications so I don't miss te updates.
- Add explicit `fetch` so we can detect if the same branch already
  exists.
- Run from `main` so we geet a fresh view in case of reruns.

CHANGELOG_BEGIN
CHANGELOG_END
2022-04-19 12:27:17 +02:00
Gary Verhaegen
957db9b091
auto-bump canton (#13596)
Or, maybe, break CI trying to.

CHANGELOG_BEGIN
CHANGELOG_END
2022-04-14 17:02:37 +00:00
Sergey Kisel
2b4b2f2d3e
Add ledger-service/jwt to test evidence generator. (#13579)
* Add ledger-service/jwt to test evidence generator.

CHANGELOG_BEGIN
CHANGELOG_END
2022-04-14 17:39:36 +02:00
Gary Verhaegen
f6d471eacc
remove Windows installer (#13586)
The installer is now created in the assembly repo. Keeping the code
around here is just confusing.

Note that this should not impact our ability to publish patch releases
on pre-2.0 versions, as all of the files involved are non-yml.

CHANGELOG_BEGIN
CHANGELOG_END
2022-04-13 16:18:07 +02:00
Gary Verhaegen
4a93384414
bump nightly version (#13573)
The release process for 2.1.0 is ongoing. I think it's safe to say at
this point if we need to change the RC we'll do it with backports.

CHANGELOG_BEGIN
CHANGELOG_END
2022-04-12 13:18:41 +02:00
Gary Verhaegen
90e03a3044
docs cron: do not build post-2.0 (#13572)
After 2.0, the docs need to be built alongside Canton files, and that is
taken care of by the [docs.daml.com] repo.

[docs.daml.com]: https://github.com/digital-asset/docs.daml.com

CHANGELOG_BEGIN
CHANGELOG_END
2022-04-12 13:13:50 +02:00
Sergey Kisel
7dd678c920
Publish security test evidence to assembly repo (#13544)
Publish security test evidence to assembly repo

CHANGELOG_BEGIN
CHANGELOG_END
2022-04-12 08:46:20 +02:00
Robin Krom
8c046c7776
ghc-lib:remove unused let bindings (#13525)
* ghc-lib:remove unused let bindings

This updates ghc-lib, such that no unused let bindings are created in
Archive choices.

Fixes #13431.

CHANGELOG_BEGIN
CHANGELOG_END

* update ghc-lib hash

* Update of InterfaceDesugared.daml
2022-04-11 12:34:17 +00:00
Gary Verhaegen
19714e27c6
ci/cron/docs: fix file verification (#13475)
There is no `versions.json` in daml-on-sql docs.

CHANGELOG_BEGIN
CHANGELOG_END
2022-03-31 14:25:40 +02:00
Moisés Ackerman
f9f1611d46
Unsafe interface conversion primitives (#13391)
* Add unsafeFromInterface method to HasFromInterface class

* Use unsafeFromInterface instead of fromInterface + experimental primitive

* Drop THROW_WRONGLY_TYPED_CONTRACT experimental primitive

* Add UnsafeFrom{,Required}Interface LF primitives

* Add convertPrim cases for UnsafeFrom{,Required}Interface

* Add InterfaceGuarded tests for WronglyTypedContract cases

changelog_begin
changelog_end

Co-authored-by: Sofia Faro <sofia.faro@digitalasset.com>
2022-03-25 10:07:14 +00:00
Sofia Faro
79715ad32d
interfaces: Drop the typerep, raise WronglyTypedContract (#13314)
* Drop the typerep in interface desugaring.

GHC PR: https://github.com/digital-asset/ghc/pull/110

Fixes https://github.com/digital-asset/daml/issues/13275 and https://github.com/digital-asset/daml/issues/13283

changelog_begin
changelog_end

* compile ghc-lib

* update bazel-haskell-deps

* update InterfaceTypeRepCheck test

* scalafmt

* update compile.yml

* update bazel-haskell-deps last time
2022-03-17 16:12:46 +00:00
Gary Verhaegen
1af8934be6
remove Samir's accesses (#13247)
CHANGELOG_BEGIN
CHANGELOG_END
2022-03-10 13:55:10 +00:00
Stefano Baghino
b8fd1747e8
Remove mentions of Daml connect (#13230)
Daml Connect is no longer a thing. I replaced usages with
either Daml or Daml SDK.

changelog_begin
changelog_end
2022-03-09 18:18:51 +00:00
Gary Verhaegen
961ca80b77
hunt down DAML (#13191)
Process:

- `git ls-files | xargs sed -i 's/DAML/Daml/g'`
- `git add -p`

To review:

- Check for false positives by carefully reviewing the diff in this PR.
- Check for false negatives with `git grep DAML`.

CHANGELOG_BEGIN
- Removed all traces of DAML. This may affect error messages and debug
  outputs.
CHANGELOG_END
2022-03-08 14:25:25 +01:00
Gary Verhaegen
54dc19deb8
add release instructions to release notification (#13160)
Because we can't expect people to magically know where to find them.

CHANGELOG_BEGIN
CHANGELOG_END
2022-03-04 11:33:15 +00:00
Gary Verhaegen
0002b7ebae
guard nightly (#13158)
In some cases we may end up with the tip of the main branch built as a
split release manually. When Azure then tries to run it, the release
fails (typically on the upload to NPM step).

Normally, Azure is set to run this only once per commit, but that only
applies when the run is successful. So if it breaks in a reproducible
way (e.g. because the version already exists on NPM), Azure will keep
trying every day.

This PR adds a simple guard that makes the nightly build _not_ a release
commit if the reelease already exists, which should short-circuit most
of the jobs in the build and finish successfully.

CHANGELOG_BEGIN
CHANGELOG_END
2022-03-04 11:16:01 +00:00
Victor Peter Rouven Müller
0dc167fa48
[JSON-API] Remove dependency on user provided tokens for the perf runner & refactor main (#13114)
* Don't error when user tokens are provided for the perf runner

changelog_begin
changelog_end

* Better token parsing error handling & extract user id to allocate the user if so

* make the code prettier

* Fix & simplify token parsing

* fix formatting of bazel file

* Update ledger-service/http-json-perf/src/main/scala/com/daml/http/perf/Main.scala

Co-authored-by: Raymond Roestenburg <98821776+ray-roestenburg-da@users.noreply.github.com>

* correctly handle the response of createUser & don't throw if no LedgerId was found in the token

* Wrap exceptions in Futures

* Refactor Main.scala of the perf runner completely & remove dependency on user provided JWT's

* Minimize diff

* simplify code further

* Update ledger-service/http-json-perf/src/main/scala/com/daml/http/perf/Main.scala

Co-authored-by: Stefano Baghino <43749967+stefanobaghino-da@users.noreply.github.com>

* Update ledger-service/http-json-perf/src/main/scala/com/daml/http/perf/Main.scala

Co-authored-by: Stefano Baghino <43749967+stefanobaghino-da@users.noreply.github.com>

* Update ledger-service/http-json-perf/src/main/scala/com/daml/http/perf/Main.scala

Co-authored-by: Stefano Baghino <43749967+stefanobaghino-da@users.noreply.github.com>

* Fix build

* Don't pass a jwt to the perf runner anymore everywhere it was used & fix ledger id to be right

* Minimize diff

Co-authored-by: Raymond Roestenburg <98821776+ray-roestenburg-da@users.noreply.github.com>
Co-authored-by: Stefano Baghino <43749967+stefanobaghino-da@users.noreply.github.com>
2022-03-03 16:12:40 +00:00
Moisés Ackerman
7ca26b01ce
make interface declaration where optional (#13129)
* Extend InterfaceSyntax test file with interfaces declared without 'where'

changelog_begin
changelog_end
2022-03-03 11:09:56 +00:00
Moisés Ackerman
2dbd91aab9
Interface methods can use plain function declaration syntax (#13102)
* Update 'implements' blocks to use new syntax

* Add InterfaceSyntax test case

* Add InterfaceMultipleMethodDeclsError test case

* Add InterfaceDifferentNumArgsError test case

changelog_begin
changelog_end
2022-03-02 15:59:01 +00:00
Moisés Ackerman
7af4215261
Interfaces accept at most a single ensure clause (#13093)
* Add test for multiple ensure declarations in interface

* update ghc patch

* Update expected result for daml-doc interface test

changelog_begin
changelog_end
2022-02-28 14:12:40 +01:00
Moisés Ackerman
42462f4574
Notify Moisés on slack (#13026) 2022-02-22 17:07:50 +00:00
Moisés Ackerman
2532cf8991
Derive Eq for interfaces (#12988)
changelog_begin
changelog_end
2022-02-22 16:33:48 +01:00
Robert Autenrieth
18b681f521
DPP-745 Add Oracle data continuity tests (#12961)
* Add Oracle compatibility tests

changelog_begin
changelog_end

* Clean up

* Remove debug change

* Skip Oracle tests if there is nothing to do

* Add missing line warp

* Use ORACLE_PORT

Co-authored-by: mziolekda <marcin.ziolek@digitalasset.com>

Co-authored-by: mziolekda <marcin.ziolek@digitalasset.com>
2022-02-16 23:37:50 +01:00
Moritz Kiefer
e40f62f88a
Revert "Switch to Bazel 5 (#12935)" (#12974)
This reverts commit 4c0118df4d.

This breaks passing -p to bazel test for Haskell tests, e.g.,

bazel test //compiler/damlc/tests:integration-v1dev --test_arg -p
--test_arg InterfaceEq

which breaks with something horrifying like

moritz@adjunction ~/daml (main)> bazel test //compiler/damlc/tests:integration-v1dev --test_arg -p --test_arg InterfaceEq
[dev-env] Building tools.bazel...
[dev-env] Built tools.bazel in /nix/store/m7gzlmr0pqjpl01ihgvazxgfs3sfwl61-bazel and linked to /home/moritz/daml/dev-env/var/gc-roots/bazel
[dev-env] Building tools.find...
[dev-env] Built tools.find in /nix/store/645v3545lcbx77wq7355rgdrgbhn5wx7-findutils-4.8.0 and linked to /home/moritz/daml/dev-env/var/gc-roots/find
INFO: Invocation ID: 034b3e45-851f-472e-ab71-b7f718829582
DEBUG: /home/moritz/.cache/bazel/_bazel_moritz/bb4e4404f889dc1b816f246b08c0d9ea/external/rules_haskell/haskell/private/versions.bzl:60:10: WARNING: bazel version is too recent. Supported versions range from 4.0.0 to 4.2.1, but found: 5.0.0- (@non-git)
/nix/store/dadkhf8vch2i2kvig962ilfr5j3chshr-go-1.17.6
/nix/store/pzh24n543i6jqa01hdmgqknlyf294bn1-bazel-nixpkgs-posix-toolchain
/nix/store/2hfwndk47wpvaib06qyhcdp83b423xvh-jq-1.6-bin
/nix/store/hjggs9s82qh7r5j8sgapn389hf24wdx8-bazel-nixpkgs-cc-toolchain
/nix/store/yxgg3bn4v288sc00kf09svrwz2r461c9-ghc-native-bignum-9.0.2
/nix/store/2hwx0jhcdsx3wfvmb50ih19jkh2ra4jh-glibc-locales-2.33-108
/nix/store/8wpmx049z8m0ffhy3jyi41qb6pbxwvy8-bazel-nixpkgs-java-runtime
ERROR: file 'external/bazel_tools/src/tools/launcher/_objs/launcher/dummy.pic.o' is generated by these conflicting actions:
Label: @bazel_tools//src/tools/launcher:launcher
RuleClass: cc_binary rule
Configuration: 869f6bbd14d2ac66dcacb164312d88fa059b017e3c17513cb5051b23879ac7f9, 8c138cc79f95329f01b0d325511ad0ea89ca5126e421e67e5239706d0f247c2c
Mnemonic: CppCompile
Action key: 3d79fe1470dcb842d5944c98dfe7a62715db6d86fdb12d3ff60af3bdf41b7996
Progress message: Compiling src/tools/launcher/dummy.cc
PrimaryInput: File:[/home/moritz/.cache/bazel/_bazel_moritz/bb4e4404f889dc1b816f246b08c0d9ea/external/bazel_tools[source]]src/tools/launcher/dummy.cc
PrimaryOutput: File:[[<execution_root>]bazel-out/k8-opt/bin]external/bazel_tools/src/tools/launcher/_objs/launcher/dummy.pic.o
Owner information: ConfiguredTargetKey{label=@bazel_tools//src/tools/launcher:launcher, config=BuildConfigurationValue.Key[869f6bbd14d2ac66dcacb164312d88fa059b017e3c17513cb5051b23879ac7f9]}, ConfiguredTargetKey{label=@bazel_tools//src/tools/launcher:launcher, config=BuildConfigurationValue.Key[8c138cc79f95329f01b0d325511ad0ea89ca5126e421e67e5239706d0f247c2c]}
MandatoryInputs: are equal
Outputs: are equal
ERROR: file 'external/bazel_tools/src/tools/launcher/_objs/launcher/dummy.o' is generated by these conflicting actions:
Label: @bazel_tools//src/tools/launcher:launcher
RuleClass: cc_binary rule
Configuration: 869f6bbd14d2ac66dcacb164312d88fa059b017e3c17513cb5051b23879ac7f9, 8c138cc79f95329f01b0d325511ad0ea89ca5126e421e67e5239706d0f247c2c
Mnemonic: CppCompile
Action key: 9f46e824944add9e9951ef51ddb6cb4b744bc97f90b5749132179d1d1699dfa1
Progress message: Compiling src/tools/launcher/dummy.cc
PrimaryInput: File:[/home/moritz/.cache/bazel/_bazel_moritz/bb4e4404f889dc1b816f246b08c0d9ea/external/bazel_tools[source]]src/tools/launcher/dummy.cc
PrimaryOutput: File:[[<execution_root>]bazel-out/k8-opt/bin]external/bazel_tools/src/tools/launcher/_objs/launcher/dummy.o
Owner information: ConfiguredTargetKey{label=@bazel_tools//src/tools/launcher:launcher, config=BuildConfigurationValue.Key[869f6bbd14d2ac66dcacb164312d88fa059b017e3c17513cb5051b23879ac7f9]}, ConfiguredTargetKey{label=@bazel_tools//src/tools/launcher:launcher, config=BuildConfigurationValue.Key[8c138cc79f95329f01b0d325511ad0ea89ca5126e421e67e5239706d0f247c2c]}
MandatoryInputs: are equal
Outputs: are equal
ERROR: com.google.devtools.build.lib.skyframe.ArtifactConflictFinder$ConflictException: com.google.devtools.build.lib.actions.MutableActionGraph$ActionConflictException: for external/bazel_tools/src/tools/launcher/_objs/launcher/dummy.o, previous action: action 'Compiling src/tools/launcher/dummy.cc', attempted action: action 'Compiling src/tools/launcher/dummy.cc'

changelog_begin
changelog_end
2022-02-16 18:24:00 +00:00
Moritz Kiefer
4c0118df4d
Switch to Bazel 5 (#12935)
* Switch to Bazel 5

changelog_begin
changelog_end

* .

* .

changelog_begin
changelog_end
2022-02-16 10:47:05 +00:00
Moritz Kiefer
67f214b1d1
Fix daml script reference in copy-unix-release-artifacts (#12933)
I also changed CI config so we run this on every build but only upload
on releases. That should hopefully make sure we catch this immediately
next time. The script is fast enough that this shouldn’t slow this
down meaningfully.

changelog_begin
changelog_end
2022-02-15 09:53:15 +01:00
Moisés Ackerman
4848519fc6
Enable go-to-definition for interface methods and choices (#12903)
* Extend interface go to def test to cover methods and choices

changelog_begin
changelog_end
2022-02-15 08:30:30 +00:00
Gary Verhaegen
c04fa81d6a
ci: bump Windows workdirs (#12918)
Since #12645, we added a new pipeline, so we need to add a corresponding
entry.

As for #12645, the content of the files and the directory structure is
taken directly from a live CI node, as printed by the (now-named)
`workdirs` step.

CHANGELOG_BEGIN
CHANGELOG_END
2022-02-14 18:49:32 +00:00
Gary Verhaegen
c2a6397751
re-enabble patch-bazel-windows (#12905)
This reverts a small part of 9e1e42d27c
(#12901).

Microsoft seems to have given us our free parallel jobs back, so we can
run the patch_bazel job again.

Fixes #12900.

CHANGELOG_BEGIN
CHANGELOG_END
2022-02-14 11:23:48 +00:00