Commit Graph

7910 Commits

Author SHA1 Message Date
akshayshirahatti-da
721575ea73
[JSON-API] Postgres perf job (#10986)
* Addition of a postgres perf job

CHANGELOG_BEGIN
CHANGELOG_END

* use a single job with strategy matrix

* cleanup test job from main pipeline
2021-09-23 09:16:58 +01:00
Moritz Kiefer
f2d9f07417
Release RC2 for SDK 1.17.0 (#10996)
changelog_begin
changelog_end
2021-09-23 01:07:48 +02:00
Robert Autenrieth
ced4a27240
Include concurrency info in output (#10970)
changelog_begin
changelog_end
2021-09-22 21:11:26 +02:00
Robert Autenrieth
a0b6800a93
Limit maximum number of concurrent tests (#10969)
* Limit maximum number of concurrent tests

changelog_begin
changelog_end

* Fix CLI description

* Simplify expression

Co-authored-by: Samir Talwar <samir.talwar@digitalasset.com>

* Remove argument that is not needed anymore

Co-authored-by: Samir Talwar <samir.talwar@digitalasset.com>
2021-09-22 21:09:49 +02:00
Gary Verhaegen
a0fe0f6239
release 1.18.0-snapshot.20210921.7889.1.1b473c2b (#10993)
The `main` branch build for #10971 failed. #10979 should have fixed it,
so let's try again.

This needs to be merged _after_ #10979.

CHANGELOG_BEGIN
CHANGELOG_END
2021-09-22 18:59:00 +00:00
Remy
58c82b6e41
LF: reduce usage of NodeCreate.coinst (#10988)
Access directly templateId, argument, and agreementText.

CHANGELOG_BEGIN
CHANGELOG_END
2021-09-22 18:52:23 +00:00
Hubert Slojewski
f56ce2a757
kvutils: Add structured error data to the error metadata [KVL-1032] (#10964)
CHANGELOG_BEGIN
CHANGELOG_END
2021-09-22 16:49:46 +00:00
Sofia Faro
3f4dbf6f8e
interfaces: Syntax highlighting for interfaces (#10987)
* interfaces: Syntax highlighting for 'interface'

To make daml studio look pretty.

changelog_begin
changelog_end

* Add 'implements' as well
2021-09-22 16:40:14 +00:00
Sofia Faro
d52a2857da
interface: Add test for conversion functions (#10991)
Test conversions of both payloads and contract ids

changelog_begin
changelog_end
2021-09-22 16:39:58 +00:00
Gary Verhaegen
28b8d9a1f7
bump dotnet (#10979)
This bumps dotnet to the version required by the latest azuresigntool,
and pins azuresigntool for the future.

As usual for live CI upgrades, this will be rolled out using the
blue/green approach. I'll keep each deployed commit in this PR.

For future reference, this is PR [#10979].

[#10979]: https://github.com/digital-asset/daml/pull/10979

CHANGELOG_BEGIN
CHANGELOG_END
2021-09-22 16:39:40 +00:00
nickchapman-da
fe10ffbe8f
Use ValueEnricher in ScenarioRunner. (#10897)
1st attempt. Causes package recompilation (bad!).

CHANGELOG_BEGIN
CHANGELOG_END

fix build

Change ValueEnricher interface to work without passing an Engine

ValueEnricher has optional preprocessor

simplify new interface to ValueEnricher: caller passes translateValue function
2021-09-22 16:57:52 +01:00
Moritz Kiefer
bdad7d5c99
Upgrade Java on Windows (#10965)
* Upgrade Java on Windows

No reason to be stuck on an older patch release.

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end
2021-09-22 15:54:59 +00:00
Sofia Faro
34390f7062
interfaces: Implemented conversions, added test. (#10982)
Part of #10810

- Implemented ToInterface, FromInterface in speedy
- Added a test that exercises and fetches an interface
- Fixed a bug in SBUChoiceInterface

Hey, interfaces work now!

changelog_begin
changelog_end
2021-09-22 15:50:54 +01:00
Samir Talwar
7740b60836
participant-integration-api: Improve the CommandConfiguration docs. (#10978)
Explaining the limits in more detail.

There were some discrepancies between the documentation and the code; in
particular, if there are too many commands in flight, new ones will just
be held in the queue.

CHANGELOG_BEGIN
CHANGELOG_END
2021-09-22 15:48:25 +02:00
Moritz Kiefer
04f322e2aa
Bump resources for daml-ledger tests (#10984)
changelog_begin
changelog_end
2021-09-22 13:11:14 +00:00
mziolekda
6d9922e1f1
Retry upsert of command deduplication on oracle and h2 [DPP-609] (#10976)
* Retry upsert of command deduplication on oracle and h2 [DPP-609]

CHANGELOG_BEGIN
CHANGELOG_END

* address review comments

* fix a typo
2021-09-22 14:01:54 +02:00
Remy
eb4f1b2a05
LF: Move lookup tests out of EngineTest (#10973)
CHANGELOG_BEGIN
CHANGELOG_END
2021-09-22 13:36:46 +02:00
Moritz Kiefer
99836d2610
Handle fetchByKey callback correctly in scenario runner (#10980)
fixes #10977

Turns out assertions are good unless they’re wrong …

This only affects scenarios, the engine never looks at the callback.

changelog_begin
changelog_end
2021-09-22 13:19:57 +02:00
Stefano Baghino
23e6a2dddb
Improve feedback from failing match in AuthMatchers (#10981)
changelog_begin
changelog_end

Visualizes the top-most exception as part of the test failure when the expected
gRPC error code is not found in the stack trace. This should hopefully improve
our chances to identify the cause of flakes such as the one reported as part of
https://github.com/digital-asset/daml/issues/10974.

Example output in case of a failing match:

```
- should deny access without sufficient authorization *** FAILED *** (39 milliseconds)
  listPackages java.lang.RuntimeException: java.util.concurrent.ExecutionException: io.grpc.StatusRuntimeException: UNAUTHENTICATED:  did not equal DEADLINE_EXCEEDED (AuthMatchers.scala:38)
```

Before this commit, the output for a similar failure would be the something like:

```
- should deny access without sufficient authorization *** FAILED *** (208 milliseconds)
  getPackageStatus <iterator> was empty (AuthMatchers.scala:16)
```
2021-09-22 11:00:12 +00:00
pbatko-da
e299103450
[Short] Small test tool's CLI parser refactor (#10923) 2021-09-22 11:37:50 +02:00
azure-pipelines[bot]
fc153a91b2
release 1.18.0-snapshot.20210921.7889.0.1b473c2b (#10971)
* release 1.17.0-snapshot.20210921.7889.0.1b473c2b

This PR has been created by a script, which is not very smart
and does not have all the context. Please do double-check that
the version prefix is correct before merging.

@garyverhaegen-da is in charge of this release.

Commit log:
```
1b473c2b9a Switch trigger service time provider default to wall-clock time (#10967)
4acf34b5fc Add conversions from/to interfaces in Daml parser (#10954)
d50df11f77 interface: Add to/from interface in scala ast (#10960)
9f88e0919f Drop jdk8 override (#10963)
e0587bcdd2 Add a bit of detail to RegisteredTemplates documentation, motivated by: (#10962)
cebe6ed482 Refactor safetyStep in the simplifier. (#10948)
ac192fc6db interfaces: Add to/from interface in Haskell typechecker (#10951)
4b4d7a3af7 Remove update normalizer which was too aggresive (#10925)
66e1098070 Add tests for the `CompletionFromTransaction` converter [KVL-1104] (#10885)
724e50d739 interfaces: Add to/from interface in Haskell AST (#10945)
9a8d55ad13 Change slack link to discuss wiki. Fixes #10946 (#10947)
8b3b033fad LF: Test preprocessor resuming (#10936)
2edfc062a0 ifaces: name collision, typecheck fetch/exercise (#10896)
5dc15c6911 LF: rename language Interface to PackageInterface (#10938)
054c6abb63 Upgrade canton to a more recent version (#10944)
b8533d50e9 [JSON-API] Production/HA documentation. (#10903)
a33176265a Clarify `CommandTracker` [KVL-1104] (#10943)
5244643d16 Changes to increase timeout and remove assertions around mock CommandSubmissionServiceImpl (#10942)
6cc42ee9f4 rotate release duty after 1.17.0-snapshot.20210915.7832.0.38227a8e (#10892)
88ef05e557 sandbox-classic: Only allow `--max-parallel-submissions` here. (#10941)
ac02dbdeb9 LF: Exhaustive test for valueTranslator. (#10927)
409c0b4f60 interfaces: Add to/from_interface in proto (#10937)
02c8a9dfb8 Split CommonStorageBackend (#10871)
dc71a6aea8 update NOTICES file (#10932)
0ba54a4bf9 Add a missing test case to the `CommandTrackerFlowTest` (#10939)
855ecdf1a7 [DPP-572] Add ledger API test case for verifying conformance to `--min-tls-version` flag. (#10898)
3e13e3d87e Switch to stable urls in scoop python manifest (#10933)
fc2c87d950 ledger-api-client: Generate a submission id if it's empty in the `CommandClient` [KVL-1104] (#10926)
04d8f753b2 Clean up sandbox-on-x conformance tests. (#10766)
b4541b5a4d Logging delay of submitted commands (#10912)
b8e21d8f48 Fix takeFilter for the test StreamConsumer  (#10918)
906368d7e2 LF: exhaustive test for CommandPreprocessor (#10914)
61d214e451 Add fetch, exercise implementations for interfaces in speedy. (#10911)
d01f8e1c35 Fix flaky ApiConfigManagementServiceSpec test (#10922)
50291ed61b interfaces: scala typechecker implementation (#10867)
cac8391d4c Bump ghc-lib to include daml interfaces parser (#10747)
b6a6bf7aac [Ledger API error codes] Extracted common errors and groups [DPP-607] (#10890)
308f938512 Dpp 494 unit testing ha coordinator (#10862)
30f74adc99 Mark Extractor's VeryLargeArchiveSpec test as flaky (#10916)
9582e019ec LF: Refactor PreprocessorSpec test (#10909)
9b0fa29aec Separate exercise & fetch for interfaces from templates (#10908)
f4adee91ca Add conformance test for command deduplication using the CommandService [KVL-1099] (#10883)
8a391189a6 Rename Completion.deduplication_time to deduplication_duration [KVL-1057] (#10900)
8e22bb6b2d Drop ContractId typeparameter from Value (#10827)
45437059d4 Drop cocreature as a codeowner from runtime things (#10906)
e6e81470bb Release 1.17.0 RC from second to last commit (#10904)
f08ac5f65c Desugar interface implements declarations (#10895)
b5648c0e3d Make `CommandTracker` distinguish submissions of the same command using `submissionId` [KVL-1104] (#10868)
```
Changelog:
```
[Triggers Service] The service now starts by default using wall-clock time instead
of static time. If you want to run using static time, you need to do so explicitly
using the new '-s' or '--static-time' CLI option. If you were already using '-w'
or '--wall-clock-time' the flag has no effect. It's anyway safe to leave it there.
Sandbox: Add CLI flag `--min-tls-version` to select minimum enabled TLS version for participant server.

```

CHANGELOG_BEGIN
CHANGELOG_END

* 1.18 not 1.17

changelog_begin
changelog_end

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
Co-authored-by: Moritz Kiefer <moritz.kiefer@purelyfunctional.org>
2021-09-22 10:51:27 +02:00
Stefano Baghino
1b473c2b9a
Switch trigger service time provider default to wall-clock time (#10967)
Fixes #10957

changelog_begin
[Triggers Service] The service now starts by default using wall-clock time instead
of static time. If you want to run using static time, you need to do so explicitly
using the new '-s' or '--static-time' CLI option. If you were already using '-w'
or '--wall-clock-time' the flag has no effect. It's anyway safe to leave it there.
changelog_end
2021-09-21 19:24:09 +00:00
Moritz Kiefer
4acf34b5fc
Add conversions from/to interfaces in Daml parser (#10954)
* Add conversions from/to interfaces in Daml parser

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end
2021-09-21 18:24:12 +00:00
Sofia Faro
d50df11f77
interface: Add to/from interface in scala ast (#10960)
Part of #10810

changelog_begin
changelog_end
2021-09-21 16:30:01 +00:00
Moritz Kiefer
9f88e0919f
Drop jdk8 override (#10963)
The comment here is no longer accurate, Nix upgraded since so we
actually pin an older version for no reason. Perhaps somewhat
ironically while Nix upgraded they left the comment in their
derivation to not upgrade because of jvmci.

changelog_begin
changelog_end
2021-09-21 15:56:32 +00:00
Richard Kapolnai
e0587bcdd2
Add a bit of detail to RegisteredTemplates documentation, motivated by: (#10962)
https://discuss.daml.com/t/does-the-registeredtemplates-field-in-a-daml-trigger-affect-the-acs-which-is-threaded-through-my-rule/145
https://discuss.daml.com/t/do-triggers-get-full-acs-or-prefiltered/403

CHANGELOG_BEGIN
CHANGELOG_END
2021-09-21 15:36:40 +00:00
Sofia Faro
cebe6ed482
Refactor safetyStep in the simplifier. (#10948)
changelog_begin
changelog_end
2021-09-21 15:49:48 +01:00
Sofia Faro
ac192fc6db
interfaces: Add to/from interface in Haskell typechecker (#10951)
* interfaces: Add to/from interface in hs typecheck

changelog_begin
changelog_end

* questionable lint
2021-09-21 15:29:33 +01:00
nicu-da
4b4d7a3af7
Remove update normalizer which was too aggresive (#10925)
CHANGELOG_BEGIN
CHANGELOG_END
2021-09-21 06:12:32 -07:00
Hubert Slojewski
66e1098070
Add tests for the CompletionFromTransaction converter [KVL-1104] (#10885)
CHANGELOG_BEGIN
CHANGELOG_END
2021-09-21 10:48:44 +00:00
Sofia Faro
724e50d739
interfaces: Add to/from interface in Haskell AST (#10945)
Part of #10810

changelog_begin
changelog_end
2021-09-21 10:24:10 +01:00
Sergey Kisel
9a8d55ad13
Change slack link to discuss wiki. Fixes #10946 (#10947)
* Change slack link to discuss wiki. Fixes #10946

* Update CONTRIBUTING.md

CHANGELOG_BEGIN
CHANGELOG_END
2021-09-21 07:26:50 +00:00
Remy
8b3b033fad
LF: Test preprocessor resuming (#10936)
CHANGELOG_BEGIN
CHANGELOG_END
2021-09-21 08:53:37 +02:00
Robin Krom
2edfc062a0
ifaces: name collision, typecheck fetch/exercise (#10896)
* ifaces: name collision, typecheck fetch/exercise

This adds name collision detection and adds typechecking for
fetch/exercising of interface instances.

CHANGELOG_BEGIN
CHANGELOG_END

* turn on exercises in InterfaceDesugared test case

* Update compiler/daml-lf-tools/src/DA/Daml/LF/TypeChecker/NameCollision.hs

Co-authored-by: Sofia Faro <sofia.faro@digitalasset.com>

Co-authored-by: Sofia Faro <sofia.faro@digitalasset.com>
2021-09-20 21:40:26 +00:00
Remy
5dc15c6911
LF: rename language Interface to PackageInterface (#10938)
To avoid confusion with the new Daml concept of Interface.

CHANGELOG_BEGIN
CHANGELOG_END
2021-09-20 19:04:14 +00:00
Oliver Seeliger
054c6abb63
Upgrade canton to a more recent version (#10944)
changelog_begin
changelog_end
2021-09-20 17:42:37 +00:00
akshayshirahatti-da
b8533d50e9
[JSON-API] Production/HA documentation. (#10903)
* Initial draft documentation for JSON API production recommendations

CHANGELOG_BEGIN
CHANGELOG_END

* changes based on draft review

* changes based on code-review

* more changes based on review comments

* add note on performance impact for rebuilding query store
2021-09-20 17:41:18 +00:00
Hubert Slojewski
a33176265a
Clarify CommandTracker [KVL-1104] (#10943)
CHANGELOG_BEGIN
CHANGELOG_END
2021-09-20 17:25:26 +00:00
akshayshirahatti-da
5244643d16
Changes to increase timeout and remove assertions around mock CommandSubmissionServiceImpl (#10942)
CHANGELOG_BEGIN
CHANGELOG_END
2021-09-20 17:38:53 +01:00
azure-pipelines[bot]
6cc42ee9f4
rotate release duty after 1.17.0-snapshot.20210915.7832.0.38227a8e (#10892)
@cocreature is taking care of 1.17.0-snapshot.20210915.7832.0.38227a8e (#10891), so they get pushed back to the end of the line.

Please do not merge this before #10891.

CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-09-20 18:30:01 +02:00
Samir Talwar
88ef05e557
sandbox-classic: Only allow --max-parallel-submissions here. (#10941)
This option is only used by Sandbox Classic and Daml Driver for SQL.
There is no reason for it to be part of the command service
configuration.

CHANGELOG_BEGIN
CHANGELOG_END
2021-09-20 15:38:20 +00:00
Remy
ac02dbdeb9
LF: Exhaustive test for valueTranslator. (#10927)
* LF: Exhaustive test for value translator.

CHANGELOG_BEGIN
CHANGELOG_END

* cosmetic
2021-09-20 14:21:45 +00:00
Sofia Faro
409c0b4f60
interfaces: Add to/from_interface in proto (#10937)
* interfaces: Add to/from_interface in proto

Part of #10810

changelog_begin
changelog_end

* fix typo
2021-09-20 13:44:00 +00:00
Robert Autenrieth
02c8a9dfb8
Split CommonStorageBackend (#10871)
changelog_begin
changelog_end
2021-09-20 15:22:49 +02:00
azure-pipelines[bot]
dc71a6aea8
update NOTICES file (#10932)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-09-20 14:30:48 +02:00
Hubert Slojewski
0ba54a4bf9
Add a missing test case to the CommandTrackerFlowTest (#10939)
CHANGELOG_BEGIN
CHANGELOG_END
2021-09-20 14:25:42 +02:00
pbatko-da
855ecdf1a7
[DPP-572] Add ledger API test case for verifying conformance to --min-tls-version flag. (#10898)
Add CLI flag to select minimum enabled TLS version for participant server

CHANGELOG_BEGIN
Sandbox: Add CLI flag `--min-tls-version` to select minimum enabled TLS version for participant server.
CHANGELOG_END
2021-09-20 12:17:00 +02:00
Moritz Kiefer
3e13e3d87e
Switch to stable urls in scoop python manifest (#10933)
The file changed in the master branch which broke our builds :(

changelog_begin
changelog_end
2021-09-20 12:06:58 +02:00
Hubert Slojewski
fc2c87d950
ledger-api-client: Generate a submission id if it's empty in the CommandClient [KVL-1104] (#10926)
* Throw an exception if the submission id is empty in `CommandTracker`

CHANGELOG_BEGIN
CHANGELOG_END

* Generate a submission ID in the `CommandClient` if it's empty

CHANGELOG_BEGIN
CHANGELOG_END
2021-09-20 10:00:57 +02:00
mziolekda
04d8f753b2
Clean up sandbox-on-x conformance tests. (#10766)
* Clean up sandbox-on-x conformance tests.

CHANGELOG_BEGIN
CHANGELOG_END

* fix a flaky test in config management
2021-09-20 07:52:46 +00:00