Commit Graph

702 Commits

Author SHA1 Message Date
Gary Verhaegen
444536ba24
fix daily canton bump (#17781) 2023-11-08 16:30:00 +00:00
Paul Brauner
313b789731
Bump netty and grpc-netty (#17770)
* pin dependencies to json and add missing dep

* fix cyclic dep

* remove unused dep

* add missing dep to //ledger-api/testing-utils:testing-utils

* remove unused dep in //ledger/ledger-api-auth:ledger-api-auth

* remove more unused deps

* more dep fixes

* yet more dep fixing

* more fixing..

* more of the same

* hopefully the last deps to fix

* Bump the version of protobuf and fix everything that depends on it. Took shortcuts that I need to fix in a next commit, but would like to run the CI on this now that it compiles

* don't error out in the grpc-haskell patch

* remove obsolete patch

* patch absl to compile on mingw

* Add a patch to recognize the compiler

* Define _DNS_SD_LIBDISPATCH for macOS gRPC

* bump netty_tcnative_version according to https://github.com/grpc/grpc-java/blob/master/SECURITY.md#netty

* pin maven deps

* Fix macos linking errors 'dyld[xxx]: missing symbol called'

* Skip Darwin frameworks in package-app.sh

* pin stackage packages

* pin stackage windows deps

* use the netty version agreed on

* bump the windows global cache to try and debug the upb issue

* restart the CI after timeout

* clean up

* disable failing tests for now

* comment out unused code

* reset the windows machine name to 'default'

---------

Co-authored-by: Moisés Ackerman <6054733+akrmn@users.noreply.github.com>
2023-11-07 19:35:50 +01:00
Gary Verhaegen
442c57b5f4
docker: switch to jammy (#17766) 2023-11-07 12:39:32 +01:00
Remy
44169064ea
fix update_canton_ jobs (#17762) 2023-11-07 11:51:45 +01:00
Gary Verhaegen
00b28969b2
re-start publishing daml-sdk image (#17760)
Turns out some people depend on it. I still think they shouldn't, and we
should work with them to help them move away, but short-term the right
thing to do is to not block their upgrade.
2023-11-06 17:58:23 +01:00
Remy
dc0b2f71a6
mege bump_canton and update_canton_sources jobs (#17757) 2023-11-06 17:37:31 +01:00
Gary Verhaegen
28eadc6e69
fix CODEOWNERS & related files (#17579) 2023-10-16 18:37:14 +02:00
Remy
91b965bd8c
add readme to canton code drop (#17560) 2023-10-16 12:59:20 +02:00
Gary Verhaegen
4a84d2de3c
canton_drop: fix canton credentials (#17551) 2023-10-11 16:13:26 +00:00
Remy
0823af627e
fix name of canton update job (#17544) 2023-10-11 13:12:13 +02:00
Remy
1f31feac2b
Code drop of canton community (#17540)
Co-authored-by: Gary Verhaegen <gary.verhaegen@digitalasset.com>
2023-10-10 11:29:37 +00:00
Paul Brauner
158cdd90d7
Fix the external name of daml3-script.dar to mention 2.dev (#17512)
* Fix the external name of daml3-script.dar to mention 2.dev

* make the compilation and distribution of daml3-script dars more future proof

* fix path in ci/copy-unix-release-artifacts.sh
2023-10-03 09:16:00 +00:00
Remy
623f305e9c
Move canton directory to let place for code drop (#17506) 2023-09-29 14:37:01 +00:00
Gary Verhaegen
33929d12ae
fix canton bump (#17494)
We've got a few failures recently that report not having delete access
on GCS. This should address those.
2023-09-27 15:22:44 +02:00
Gary Verhaegen
c1280e4439
run blackduck when intended (#17454)
That is, on the daily run and on blackduck-bump PRs.
2023-09-21 22:50:10 -04:00
azure-pipelines[bot]
7d74dc0aa9
bump canton to 2.8.0-snapshot.20230919.11183.0.v52763301 (#17457)
* bump canton to 2.8.0-snapshot.20230919.11183.0.v52763301

CHANGELOG_BEGIN
CHANGELOG_END

* fix canton url

---------

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
Co-authored-by: Gary Verhaegen <gary.verhaegen@digitalasset.com>
2023-09-20 18:39:59 +02:00
Gary Verhaegen
3d08291ae6
fix typo in bump-canton job (#17435) 2023-09-19 10:36:14 +00:00
Gary Verhaegen
82655f2f29
keep stable copies of Canton artifacts (#17415) 2023-09-18 18:16:24 +02:00
Gary Verhaegen
8494cff36a
blackduck update: do not fail if branch already exists (#17417) 2023-09-18 16:25:05 +02:00
azure-pipelines[bot]
78487e18a8
fix blackduck update PR run (#17402) 2023-09-15 15:42:44 +02:00
Gary Verhaegen
2dbfb68080
fix BlackDuck scan (#17400)
The latest udpate of the BlackDuck script broke our run. In order to get
a successful scan tomorrow, this PR:

- Pins us back on yesterday's script version, and
- Adds an auto-update mechanism.

This way, we get to stay reasonably up-to-date with automated update
PRs, but we also get to choose when we upgrade.
2023-09-14 16:29:39 -04:00
Gary Verhaegen
4bf7693f42
fix cache (#17377)
Looks like the issue was Bazel 5.2.0.
2023-09-08 10:31:42 +02:00
Gary Verhaegen
675a325cd3
fix Linux cache (macOS still seems broken) (#17369) 2023-09-06 21:21:56 +02:00
Gary Verhaegen
a87818464e
fix bazel cache use on CI (#17363) 2023-09-05 16:51:18 +00:00
Moisés Ackerman
6ae0e0111e
Upgrade to Bazel 5 (again) (#17319)
* Update to rules_haskell v0.16
* Update comments re bazel patches
* clean up bazel overrides
* Upgrade to Bazel 5.2.0
* Remove '--distinct_host_configuration=false'
* Update buildifier to 6.3.2
* Suffix macos and ubuntu caches with yyyymm
* bump windows cache to v14
* [REVERTME] bump linux/macos/darwin timeout to 4h
2023-09-01 15:15:36 +02:00
Samuel Williams
6146149a22
Expose daml3-script to sdk (#17291)
* Expose daml3-script to sdk

* Add warning to daml3-script
2023-08-24 10:42:47 +01:00
Samuel Williams
9179b2e7d0
Jar licensing (#17299)
* Add _distribute.jar target with correct license
Use it everywhere

* Fixes from review

* Change NOTICES to NOTICES.txt for consistency
2023-08-22 15:56:29 +01:00
Paul Brauner
21e8a5408e
Update slack_user_ids (#17251)
Add myself to daml/ci/slack_user_ids
2023-08-09 13:59:06 +02:00
Remy
ae596d7398
Revert "Disable temporary windows build" (#17192)
This reverts commit 908a39e55a.
2023-07-28 09:47:00 +00:00
Remy
9f9e25168d
Disable temporary windows build (#17186)
until we have windows back in the pipeline
2023-07-27 09:05:15 +00:00
Raphael Speyer
47d21fe717
JSON API: add PruningTest and make it pass (#17167)
If the ledger has been pruned more recently that the last cached copy, then attempting to fetch the changes since that last offset will fail, rending the relevant template(s) unqueryable. This PR detects that condition, clears the cache for the relevant template and queries again, which will refresh the cache with a fresh copy of the ACS for that template, and serve the query from that.

I also made some usability tweaks around running canton-ee tests, to help improve the dev experience for failures I came across while trying to run them. Specifically
* Use `--config=canton-ee` to opt into the tests which require canton-ee
* When downloading that EE from artifactory, provide better diagnostics if the required auth isn't set up.
2023-07-27 09:12:22 +10:00
Gary Verhaegen
d03ffb0329
fix bump_canton (#17166) 2023-07-24 13:19:05 +02:00
Gary Verhaegen
eda4698ced
enable manual cnaton bumps (#17155) 2023-07-20 14:59:26 +02:00
Gary Verhaegen
03a2d336d2
fix local canton for compat (#17146) 2023-07-19 12:18:58 +00:00
Gary Verhaegen
a6cb39d545
release: notify canton channel (#17151) 2023-07-19 14:04:32 +02:00
Gary Verhaegen
c71b781cc6
stop publishing daml-sdk image (#17132) 2023-07-17 17:21:12 +02:00
Samuel Williams
f82fb77102
Update tests to match canton changes (#17093) 2023-07-12 16:53:32 +01:00
Gary Verhaegen
af9ce9fc8e
delete old logs before starting (#17117) 2023-07-12 10:08:20 +00:00
Gary Verhaegen
3b9951bc7f
run m1 sometimes (#17099) 2023-07-12 11:31:38 +02:00
Gary Verhaegen
0374acb775
ci: compress results on failure (#17108)
Right now logs only get compressed on successful runs, which is not
necessarily when they are smallest.
2023-07-11 17:57:55 +02:00
Gary Verhaegen
242fe0f447
add job attempt to logs (#17091)
For the used-to-be-rare-but-not-so-much-anymore case where the job fails
after having pushed its logs (without this the push fails as we can't
overwrite artifacts).
2023-07-06 15:35:49 +00:00
Gary Verhaegen
53556dad06
ci: run fewer things on m1 (#17092)
This was spurred by the fact that the "report_end" task sometimes fails
on m1 with the "install Bash lib" step just never finishing (and the
whole job then times out after 6h).

Hopefully by running fewer things we get fewer chances of these kinds of
weird issues.

Note that it's unclear if anything actually crashes on the m1 machines
or if this is a loss of connection between Azure Pipelines and the
machine. From what I've seen as soon as that job times out the machine
is able to successfully pick up other jobs. Speaking of, I've also
reduced the 6h timeouts to a more reasonable 3h.
2023-07-06 16:55:39 +02:00
Gary Verhaegen
fbe4d0de1f
ci: rerun m1 three times (#17089)
The m1 build is extra flaky, maybe running it multiple times will help.
2023-07-06 16:42:20 +02:00
Gary Verhaegen
f6a78df1c8
ci: compress Bazel logs (#17090)
We routinely have upwards of 3GB of logs. They are very rarely
downloaded, most people don't even know they're there. Uploading 3GB
takes time. This should make it faster, hopefully.
2023-07-06 16:36:00 +02:00
Gary Verhaegen
cace97977d
fix bump_canton (#17062)
run-full-compat: true
2023-06-29 12:20:38 +00:00
Remy
9e0493cc1a
add support for Canton EE available to JSON API (#17034)
Co-authored-by: Gary Verhaegen <gary.verhaegen@digitalasset.com>
2023-06-29 09:03:32 +00:00
Gary Verhaegen
0e9cb10f7d
optionally get canton EE (#17039) 2023-06-27 11:00:24 +02:00
Gary Verhaegen
f6a51dd083
clean up refresh-get-daml (#16994) 2023-06-15 09:49:07 +01:00
Gary Verhaegen
ed202d1861
refresh-get-daml-com: add invalidation & format (#16993)
* refresh-get-daml-com: add invalidation & format

* test update
2023-06-14 18:54:52 +00:00
Gary Verhaegen
9fadea3f4c
fix get-daml.sh update script (#16992) 2023-06-14 16:58:45 +02:00