Commit Graph

743 Commits

Author SHA1 Message Date
Gary Verhaegen
c720361b7b
check-releases: fix typo (#18324) 2024-01-30 10:31:30 +01:00
Gary Verhaegen
5f7f9784a4
check-releases: record verified releases (#18313)
With the current setup, every single day we download every single
artifact of evry single release we've ever made on GitHub, twice (once
from GitHub, once from GCS). Then we check signatures and compare the
two.

With this change, we save a representation of the state of both GCS and
GitHub, and if that representation hasn't changed, we assume the
artifacts haven't changed either. The assumption seems reasonable to me
as the representation includes platform timestamps, which no user can
tamper with as far as I'm aware.

Note: we do not save the entire GitHub release representation, and
instead just save relevant metadata for the associated artifacts. The
goal of this job is to verify that the artifacts haven't changed; it is
acceptable (and even expected in routine circumstances) that the
release description will change, as well as its "prerelease" and "latest
release" flags.
2024-01-29 16:18:37 +01:00
Gary Verhaegen
c590c6c942
fix daily report (#18309)
broken by #18203
2024-01-29 12:24:18 +00:00
azure-pipelines[bot]
e82166fe7b
bump blackduck script to 745a1566 (#18292)
Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2024-01-26 09:55:37 +01:00
Gary Verhaegen
939e2240cf
smaller title/branch name for canton update PRs (#18265) 2024-01-25 13:37:54 +01:00
azure-pipelines[bot]
7ec33db439
update canton to 20240123.12376.0.vce2030db/3.0.0-snapshot.20240123.12376.0.vce2030db (#18256)
* update canton to 20240123.12376.0.vce2030db/3.0.0-snapshot.20240123.12376.0.vce2030db

tell-slack: canton

* Resolve import warnings

* Add ledger-api v2 experimental_features proto

to adapt to https://github.com/DACH-NY/canton/pull/16603/files#diff-3b3a96cb2f2ad9cfe33444f1327479d8d0ca48663fb7dd0a6a5e53c5d86afede

* Removing compatiblity_target_protobuf

as the corresponding compatibility change would move into the
canton repo as per https://github.com/DACH-NY/canton/issues/16637

---------

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
Co-authored-by: oliverse-da <oliver.seeliger@digitalasset.com>
2024-01-24 14:26:56 +01:00
Gary Verhaegen
0b9c7faad2
fix external PRs (#18251) 2024-01-23 17:42:31 +01:00
Paul Brauner
6393fd084c
Remove LF1 in the compiler (#18203)
* make lf v2 and daml3-script the default

* delete V1 integration tests

* Remove LF major version V1 from the compiler

run-all-tests: true

* fix security evidence

* fix //compiler/damlc/tests:damlc-test

* fix //compiler/damlc/tests:data-dependencies

* fix //compiler/damlc/tests:integration-v2*

* fix //compiler/damlc/tests:packaging

* fix //compiler/damlc/tests:platform-independence-dar-hash-file-matches

* fix //compiler/damlc/tests:stable-packages

* fix DarReaderTest.scala

* fix DecodeCommonSpec.scala

* fix //daml-lf/archive:proto_immutability_check

* fix DamlLfEncoderTest.scala

* fix //language-support/java/codegen:test

* fix //daml-assistant/integration-tests:integration-tests

* fix artifacts.yaml

run-all-tests: true
run-full-compat: true

* Disable scenario-perf for now

See https://github.com/digital-asset/daml/pull/18217.

run-all-tests: true
run-full-compat: true

* restore explicit target version in docs template

run-all-tests: true
run-full-compat: true

* Restore DamlLfEncoderTest.scala.

Introduce a ENGINE_LF_VERSIONS constant in daml-lf.bzl instead.

run-all-tests: true
run-full-compat: true

* delete daml-lf/scenario-interpreter/src/perf

run-all-tests: true
run-full-compat: true

* Address review comments.

* Apply

Co-authored-by: Moisés Ackerman <6054733+akrmn@users.noreply.github.com>

* Restore golden/BUILD.bazel and port to 2.1

run-all-tests: true
run-full-compat: true

---------

Co-authored-by: Moisés Ackerman <6054733+akrmn@users.noreply.github.com>
2024-01-19 15:19:34 +00:00
Gary Verhaegen
39ea58901e
fix daily test report (#18215) 2024-01-18 14:05:27 +00:00
Paul Brauner
c6cf5b787b
Only drop canton3 code into canton on main (#18204) 2024-01-17 18:38:45 +01:00
Gary Verhaegen
73f4cdd5bd
don't run update_canton on run-full-compat PRs (#18196) 2024-01-16 20:42:26 +01:00
Gary Verhaegen
1c8cbb7c05
daily: fix report (#18191) 2024-01-16 14:41:26 +00:00
Gary Verhaegen
fd0494fe41
canton bump pr: better branch name (#18190) 2024-01-16 14:06:51 +01:00
Gary Verhaegen
179d85362d
update copyright (#18167)
* update copyright

* undo hack from #18168

* update hash in platform-independence-pre-check
2024-01-15 20:27:42 +01:00
Gary Verhaegen
2e28102699
ci/cron/daily: fix typo (#18176) 2024-01-15 18:02:22 +01:00
Gary Verhaegen
7be5899f5c
try to fix split-release job for main-2.x (#18161) 2024-01-15 10:55:40 +00:00
Gary Verhaegen
1168e35455
run more things on main-2.x (#18154)
Specifically:

- m1 builds
- BlackDuck & notices bump
- daily compatibility tests
- daily compat update (if needed)
- daily perf test & report

Also, merge the canton update jobs as that makes a lot more sense at
this point. Future divergences can be expressed by changing the files in
their respective branches.

This PR will need to be backported to main-2.x to fully take effect.
2024-01-12 21:05:47 +01:00
mziolekda
7108f2c76a
Remove triggers (#18142)
* remove triggers

* adopt the codebase to missing triggers

run-all-tests: true

* fix builid

* Remove oracle tests
2024-01-12 17:55:05 +01:00
Gary Verhaegen
79107eff7b
fix release scripts for http-json removal (#18149) 2024-01-12 14:54:09 +01:00
mziolekda
576560428f
remove non-repudiation (#18089)
run-all-tests: true
2024-01-10 20:23:04 +00:00
Paul Brauner
bef1938a21
fix calls to open_pr (#18129) 2024-01-10 16:57:05 +01:00
Paul Brauner
489916a1e2
Fix the canton-2.x code drop (#18125)
When deciding whether it's worth creating a PR, diff against the main-2.x branch, not the main one.
2024-01-10 14:19:55 +00:00
Gary Verhaegen
e67f988baf
fix daily snapshot for 2.x (#18123) 2024-01-10 11:39:55 +00:00
Paul Brauner
2a77ae5d0d
Use different branch names for the two code drops (#18120)
The code drop task targeting main-2.x uses the same feature branch name for its PR as the task targeting main. First one wins. This PR fixes that.
2024-01-10 10:30:51 +01:00
Gary Verhaegen
546211105f
only notify canton if upgrade build fails (#18114) 2024-01-10 06:46:38 +01:00
Paul Brauner
54009a41e6
also code drop on main-2.x (#18111) 2024-01-09 18:20:53 +01:00
Gary Verhaegen
bab51e6304
main-2.x: run daily-snapshot job (#18109) 2024-01-09 16:30:31 +01:00
Gary Verhaegen
559a633557
enable prs builds on PRs targeting main-2.x (#18105) 2024-01-09 16:08:17 +01:00
Gary Verhaegen
0b5c4b2a08
remove hourly canton-3x build (#18085)
We want to run this daily instead, which already happens as part of the
daily canton bump PR.
2024-01-04 19:07:41 +01:00
Gary Verhaegen
d48f3130ea
tell team-canton-notifications on canton update failures (#18086) 2024-01-04 19:07:31 +01:00
Remy
ea4085bd28
do not build canton as separate task (#18058) 2023-12-21 09:47:48 +01:00
Paul Brauner
56018b5d6e
do a proper canton 3.x code drop in the canton-3x directory (#17980)
* do a proper canton 3.x code drop in the canton-3x directory

* copy the code from canton3

* address Gary's comments

* fix canton-3x
2023-12-06 10:47:47 +01:00
azure-pipelines[bot]
aa67b0bf30
bump blackduck script to bee7a8c6 (#17984)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2023-12-06 10:47:10 +01:00
dylant-da
40b5eb8476
Fix split release for deps (#17968)
* Resolve release version for sdk build checks

* lint

* lint

run-full-compat: true

* Simple test for using daml-script in release versions

* Fix build issues in tests using pSdkVersion

run-full-compat: true

* Fix build issues with DamlcIntegration

* fix bad sdk version being an invalid version

run-full-compat: true

* Fix the linux "mmap 4096 bytes at (nil): Cannot allocate memory" error

* Fix compat tests on Windows

run-full-compat: true

* test windows os correctly

run-full-compat: true

* temporarily disable canton_3x

run-full-compat: true

---------

Co-authored-by: Paul Brauner <paul.brauner@digitalasset.com>
2023-12-05 23:46:27 +01:00
Paul Brauner
1794212369
build canton 3x in the CI (#17966)
* build canton 3.x in build.yml

* Apply suggestions from code review

Co-authored-by: Gary Verhaegen <gary.verhaegen@digitalasset.com>

* Apply suggestions from code review

Co-authored-by: Gary Verhaegen <gary.verhaegen@digitalasset.com>

* apply suggestions

---------

Co-authored-by: Gary Verhaegen <gary.verhaegen@digitalasset.com>
2023-12-05 15:18:35 +00:00
Paul Brauner
e22f8bebd9
Run costly tests after only after merging (#17956)
* do not run pr-only tests on main, do not run main-only tests on prs

* split data dep tests into main-only and pr-only

* run non-dev conformance tests on main only
2023-12-04 10:52:33 +01:00
tudor-da
e9c4feb562
Make ci/build-canton-3x.sh work on MacOS by managing dir exclusions (#17916)
* Make ci/build-canton-3x.sh work on MacOS by managing dir exclusions

* No need to add the cloned sources to git
2023-11-27 10:08:58 +00:00
Paul Brauner
18e0e9e656
Test that canton 3.x builds with bazel hourly (#17876)
* introduce a canton2 directory

* rename to canton-3x and only keep the bazel rules

* add canton-3x to bazelignore

* fix visibility rules

* add a build-canton-3x script

* add build-canton-3x.sh temporarily to prs.yml to test it out

* try sending a message to stack when failing

* backport 243125adee

* restore prs.yml and add the job to azure-cron.yml

* restore tell-slack-failed condition

* address comments

* display the revision at which canton was cloned, to ease debugging
2023-11-23 08:54:35 +01:00
Paul Brauner
ca31b1beab
restrict code drop and canton jars to 2.x (#17882) 2023-11-22 11:19:22 +01:00
Paul Brauner
f7dd1e6124
Stop downloading the canton opensource jar (#17877)
* stop downloading the canton opensource jar

* udpate obsolete README

* fix one remaining mention of @canton

* remove all mentions of canton_dep.bzlP
2023-11-22 08:36:41 +00:00
Paul Brauner
e4d8609515
try to reset the windows cache (#17825) 2023-11-15 02:05:42 +00:00
Gary Verhaegen
444536ba24
fix daily canton bump (#17781) 2023-11-08 16:30:00 +00:00
Paul Brauner
313b789731
Bump netty and grpc-netty (#17770)
* pin dependencies to json and add missing dep

* fix cyclic dep

* remove unused dep

* add missing dep to //ledger-api/testing-utils:testing-utils

* remove unused dep in //ledger/ledger-api-auth:ledger-api-auth

* remove more unused deps

* more dep fixes

* yet more dep fixing

* more fixing..

* more of the same

* hopefully the last deps to fix

* Bump the version of protobuf and fix everything that depends on it. Took shortcuts that I need to fix in a next commit, but would like to run the CI on this now that it compiles

* don't error out in the grpc-haskell patch

* remove obsolete patch

* patch absl to compile on mingw

* Add a patch to recognize the compiler

* Define _DNS_SD_LIBDISPATCH for macOS gRPC

* bump netty_tcnative_version according to https://github.com/grpc/grpc-java/blob/master/SECURITY.md#netty

* pin maven deps

* Fix macos linking errors 'dyld[xxx]: missing symbol called'

* Skip Darwin frameworks in package-app.sh

* pin stackage packages

* pin stackage windows deps

* use the netty version agreed on

* bump the windows global cache to try and debug the upb issue

* restart the CI after timeout

* clean up

* disable failing tests for now

* comment out unused code

* reset the windows machine name to 'default'

---------

Co-authored-by: Moisés Ackerman <6054733+akrmn@users.noreply.github.com>
2023-11-07 19:35:50 +01:00
Gary Verhaegen
442c57b5f4
docker: switch to jammy (#17766) 2023-11-07 12:39:32 +01:00
Remy
44169064ea
fix update_canton_ jobs (#17762) 2023-11-07 11:51:45 +01:00
Gary Verhaegen
00b28969b2
re-start publishing daml-sdk image (#17760)
Turns out some people depend on it. I still think they shouldn't, and we
should work with them to help them move away, but short-term the right
thing to do is to not block their upgrade.
2023-11-06 17:58:23 +01:00
Remy
dc0b2f71a6
mege bump_canton and update_canton_sources jobs (#17757) 2023-11-06 17:37:31 +01:00
Gary Verhaegen
28eadc6e69
fix CODEOWNERS & related files (#17579) 2023-10-16 18:37:14 +02:00
Remy
91b965bd8c
add readme to canton code drop (#17560) 2023-10-16 12:59:20 +02:00
Gary Verhaegen
4a84d2de3c
canton_drop: fix canton credentials (#17551) 2023-10-11 16:13:26 +00:00