Commit Graph

9013 Commits

Author SHA1 Message Date
Moritz Kiefer
c8bbeed0d2
Switch to daml-data gcs bucket for split-releases (#12322)
This is a private bucket which allows us to publish EE artifacts.

We could separate public from private artifacts but keeping everything
in a single location is easier to manage.

changelog_begin
changelog_end
2022-01-10 15:29:26 +01:00
Simon Maxen
3a08380b44
Add report metering protobuf definition [DPP-815] (#12303)
* Add report metering protobuf definition

changelog_begin
Added experimental GRPC endpoint for the reporting of metering 
changelog_end

* Update with review comments

* add changes from joint review by Simon and Simon :D

* Update with review comments

* Update with review comments

Co-authored-by: Simon Meier <simon@digitalasset.com>
2022-01-10 14:05:17 +00:00
Moritz Kiefer
0793bdf744
Upgrade h2 to version 2.0.206 (#12307)
* Upgrade h2 to version 2.0.206

changelog_begin
changelog_end
2022-01-10 14:22:40 +01:00
Simon Meier
6dd0eb774e
ledger api server: support auth0 usernames (#12308)
* ledger api: support Auth0 user names in user management

See the `IdString.UserId` and `IdString.ApplicationId` comments wrt the
character classes being introduced.

Many thanks to @cocreature for helping with deciding on the exact
restrictions of user-ids.

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-10 12:58:43 +00:00
Remy
8f71669b62
Improve ledger export replay (#12191)
This PR

- allows the tool to extract the program directly from the
  export instead.

- make the tool more robust for large export.

  Instead of enumerated all the the transaction present in the ledger
  export and then selecting the one to be benchmark, this new version
  look only for the one choice to be benchmark.

  This make the tool more capable to handle large ledger export as
  - it has to maintain less data in memory
  - it can stop as soon the data is encounter

  This should not impact performance of benchmarking as JMH create a
  new JVM for each benchmark step, so we cannot anyway cache anything
  between run.

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-10 12:42:09 +01:00
Moritz Kiefer
e96e83fdcd
Bump Canton snapshot (#12317)
* Bump Canton snapshot

This bumps to the latest snapshot which should include support for
port files.

changelog_begin
changelog_end

* .

changelog_begin
changelog_end
2022-01-10 11:21:33 +00:00
Moritz Kiefer
103327263a
Bump curl to version 7.81 on Windows (#12314)
7.78 404s now :(

changelog_begin
changelog_end
2022-01-10 10:00:49 +00:00
azure-pipelines[bot]
1b23f91a92
update NOTICES file (#12311)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2022-01-08 12:37:35 +00:00
Victor Peter Rouven Müller
f675f1b4fe
[JSON-API] Add create user endpoint (#12272)
* WIP

* Adjust the format of the CreateUserRequest to be a nicer payload & add a simple test

changelog_begin

- [HTTP-JSON] An endpoint user/create has been added to be able to create a user via the json api

changelog_end

* Update ledger-service/http-json/src/main/scala/com/digitalasset/http/Endpoints.scala

Co-authored-by: Stephen Compall <stephen.compall@daml.com>

Co-authored-by: Stephen Compall <stephen.compall@daml.com>
2022-01-07 22:22:13 +00:00
Samir Talwar
658b8f40e9
ledger-on-sql: Remove H2 support, as it's never used. (#12310)
And potentially a security hazard, if we were ever to use it.

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-07 22:02:59 +00:00
tudor-da
83c7eef6a6
[SoX with conflict checking] Check time model for transaction submissions (#12304)
* [SoX with conflict checking] Check time model for transaction submissions

CHANGELOG_BEGIN
CHANGELOG_END

* Update ledger/sandbox-on-x/src/main/scala/com/daml/ledger/sandbox/bridge/ConflictCheckingLedgerBridge.scala

Co-authored-by: mziolekda <marcin.ziolek@digitalasset.com>

Co-authored-by: mziolekda <marcin.ziolek@digitalasset.com>
2022-01-07 19:31:53 +00:00
tudor-da
e86b307fa5
[Sandbox-on-X with conflict checking] Full conformance test suite (#12309)
changelog_begin
changelog_end
2022-01-07 18:50:06 +01:00
Moritz Kiefer
3b39028622
Upgrade nixpkgs (#12280)
This gives us GHC 9.0.2 and a new Bazel release.

changelog_begin
changelog_end
2022-01-07 15:48:43 +00:00
Moritz Kiefer
2783b7bdad
Support user management in create-daml-app (#12089)
fixes #11998

changelog_begin
changelog_end
2022-01-07 12:45:13 +00:00
nicu-da
1d258a170c
[ledger-api-test-tool] - Future assertions improvements [KVL-1218] (#12294) 2022-01-07 11:26:25 +00:00
Victor Peter Rouven Müller
886d058628
[TS-Bindings] Add support for get user which recently has been added to the json api (#12271)
* Add support for get user which recently has been added to the json api

changelog_begin

- [TS-Bindings] You can now call getUser to gain information about
    the user that is associated with the currently used JWT.

changelog_end

* Apply review comments
2022-01-07 11:21:22 +00:00
Samir Talwar
b93f473c1c
dev-env: Don't use the "extra-" prefix in nix.conf. (#12306)
It turns out this prefix is only supported as of Nix 2.4.

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-07 11:19:40 +00:00
tudor-da
8d0bbde7eb
[SoX conflict checking] Configuration upload conflict checking (#12291)
* [SoX conflict checking] Configuration upload conflict checking

CHANGELOG_BEGIN
CHANGELOG_END

* Created static-time SoX conformance test target
2022-01-07 11:03:48 +00:00
akshayshirahatti-da
19fe4266ed
[Trigger Service/Oauth2-Middleware] Hocon config refactor (#12228)
* Changes to add a pureconfig-util module with some shared config readers, and cleanup some code from oauth2-middleware hocon

CHANGELOG_BEGIN
CHANGELOG_END

* Update triggers/service/auth/src/test/scala/com/daml/auth/middleware/oauth2/CliSpec.scala

Co-authored-by: Stephen Compall <stephen.compall@daml.com>

Co-authored-by: Stephen Compall <stephen.compall@daml.com>
2022-01-07 10:35:31 +00:00
Sofia Faro
8fdc871048
Make daml start integration tests use canton. (#12292)
* Make daml start integration tests use canton.

(Haven't fixed the hot reload test yet.)

changelog_begin
changelog_end

* remove vestigial message

* re-enable hot reload tests for sandbox-kv
2022-01-07 10:13:57 +00:00
nicu-da
ddf4f57b46
CI - Remove backwards compatible check for buf config. [KVL-1131] (#12301) 2022-01-07 02:00:02 -08:00
Simon Meier
a88d875c9a
auth tokens: support legacy sandbox format even with standard JWT claims present (#12297)
Fixes  #12285

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-07 10:33:47 +01:00
Moritz Kiefer
18e1cc5601
Expose trigger actAs party via getActAs (#12296)
fixes #12125

changelog_begin
changelog_end
2022-01-06 21:35:28 +01:00
Moritz Kiefer
2e735c3228
Release RC for SDK 1.18.1 (#12302)
This includes create-daml-app updates for the new daml hub domain and
a fix for the script results timeout issue.

changelog_begin
changelog_end
2022-01-06 19:48:52 +00:00
Moisés Ackerman
eff6df9e52
Fix {im,ex}plictly typoes (#12293)
changelog_begin
changelog_end
2022-01-06 19:15:01 +01:00
Samir Talwar
3b8a9e4432
Revert "devenv: Just require Nix v2.4 or newer." (#12299)
This reverts commit ed442fa8ae.

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-06 18:02:21 +00:00
Alex Matson
2b1db54f14
[create-daml-app] Incorporate hub-react library for new Hub API/domains (#12279)
changelog_begin
changelog_end
2022-01-06 17:36:45 +00:00
tudor-da
d4ebce6f44
[SoX with conflict checking] Implement party allocation validation for transactions conflict checks [DPP-837] (#12283)
* Implement party allocation validation for transactions conflict checks

CHANGELOG_BEGIN
CHANGELOG_END

* Propagate loggingContext to all processing stages
2022-01-06 13:04:15 +01:00
Victor Peter Rouven Müller
bb92c463e7
Fix that tokens without the daml namespace were wrongly interpret as user tokens for some endpoints (#12261)
Changelog entry and commit msg differ here because the bug described in
the changelog was already fixed by adding the user management support
because it caused for the affected endpoints that it will be interpret as
user token while only fetching the ledger id (without actually checking
that it is a user token).

changelog_begin

- [HTTP-JSON] Fixed a bug that caused jwt's without the daml namespace to be rejected for some endpoints (https://github.com/digital-asset/daml/issues/12215)

changelog_end
2022-01-06 10:40:07 +00:00
Moisés Ackerman
9ed1175d41
Use bazel-provided gRPC on Unix-like OSs (#12273) (#12194)
We switch back to bazel-provided gRPC as a temporary fix for #12194

This partially reverts commit 0de7b2eae5 (#11031)

changelog_begin
changelog_end
2022-01-06 09:47:51 +01:00
tudor-da
46ffec6a1a
[Sandbox-on-X] Transaction conflict checking for contracts and keys [DPP-825] (#12204)
* [Sandbox-on-X] Implement transaction submission conflict checking
* Implement the conflict checking ledger bridge
* Adds `conformance-test-conflict-checking` using the --enable-conflict-checking flag

CHANGELOG_BEGIN
CHANGELOG_END

* Dedicated threadpool for ledger bridge

* Fixed BridgeWriteService after rebase

* Update copyright headers

* Address Robert's review comments

* Revert constraining the conflict-checking parallelism

* Ledger bridge uses services thread pool

* Enable PARTICIPANT_DEDUPLICATION_SUPPORT feature flag
2022-01-06 09:06:29 +01:00
akshayshirahatti-da
4f4d18829b
[Trigger-Service] Changes to use a typeconfig conf for trigger-service when provided. (#12217)
* Changes to add the option of starting trigger service with typeconf/HOCON config

CHANGELOG_BEGIN
CHANGELOG_END

* add tests for authorization config and fail on both config file and cli args

* refactor and cleanup config loading and tests

* Changes based on code review comments

* Daml doc changes and making sure that we have defaults for most fields to mirror cli args

CHANGELOG_BEGIN
Trigger Service can now be configured with HOCON config file.
 - If a config file is provided we will choose to start the service using that, else we will fallback to cli arguments.
 - If both config file and cli args are provided we will error out.
CHANGELOG_END

* addressing some more code review comments

* use scalatest inside properly
2022-01-06 00:12:47 +00:00
Kamil Bozek
39dc4676ad
Total average rate SLO in the ledger-api-bench-tool [DPP-826] (#12219)
* Total average item rate service-level objective in the ledger-api-bench-tool.

CHANGELOG_BEGIN
- [Integration Kit] - ledger-api-bench-tool - Support for minimum and maximum average item rate objectives.
CHANGELOG_END

* Updated copyright headers

* Make stream objectives optional

* Add unit tests for optional objectives

* Formatted code changes
2022-01-05 18:46:26 +01:00
Moritz Kiefer
cf45255a0e
New split release (#12270)
Just to give Canton a chance to test against something recent.

changelog_begin
changelog_end
2022-01-05 17:37:59 +00:00
Gary Verhaegen
648021a2e7
Fix es cluster (#12262)
audit log of actions taken to fix cluster post Winter break

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-05 16:29:48 +00:00
Moritz Kiefer
b8c03e36b5
Add a test for the file listing of the released protobufs (#12269)
We messed that up in the past and lost the hierarchical structure so
adding a test seems reasonable and these change sufficiently rarely
that updating it isn’t an issue.

changelog_begin
changelog_end
2022-01-05 16:01:52 +00:00
Hubert Slojewski
cb15ab5adb
Run protobuf compatibility checks for release branches [KVL-1197] (#12246)
CHANGELOG_BEGIN
CHANGELOG_END
2022-01-05 14:45:40 +00:00
nickchapman-da
6bf24fce93
Proxy user management errors via the scenario service proto (#12267)
* Proxy user management errors via the scenario service proto and display them

changelog_begin
changelog_end

* address comment
2022-01-05 13:41:49 +00:00
Hubert Slojewski
c80b2e04a3
daml-lf, kvutils: Move Daml-LF transaction and value handling logic to kv-support [KVL-1168] (#12235)
CHANGELOG_BEGIN
CHANGELOG_END
2022-01-05 14:17:48 +01:00
Moisés Ackerman
ceb83a6ddb
Interface method sigs (#12258)
* Skip _method_ markers during docs generation

* Remove r argument from Method desugar type

* Update HasMethod/mkMethod docs

* define `mkMethod` as compiler "magic"

changelog_begin
changelog_end

Co-authored-by: Sofia Faro <sofia.faro@digitalasset.com>
2022-01-05 13:09:36 +00:00
Sofia Faro
27ecab197b
Update canton snapshot (#12221)
* Update canton snapshot

changelog_begin
changelog_end

* finish removing bootstrap.canton

* minimize changes

changelog_begin
changelog_end

* update snapshot

* Enable self-service error-codes

Co-authored-by: Moritz Kiefer <moritz.kiefer@purelyfunctional.org>
Co-authored-by: Oliver Seeliger <oliver.seeliger@digitalasset.com>
2022-01-05 12:51:36 +00:00
Victor Peter Rouven Müller
dda2115d61
[JSON API] Expose user management service (#12137)
* Expose user management service over the HTTP-JSON API

Fixes #12078

Add user & user/rights endpoint which provide the current user id, primary party and the latter the user rights

Fix new endpoints for ledgers without auth and add test coverage for these

changelog_begin

- [HTTP-JSON] Added GET endpoint:
    - /user which returns the current user id & primary party
    - /user/rights which returns the user rights of the current user

changelog_end

* Update ledger-service/http-json/src/it/scala/http/HttpServiceIntegrationTestUserManagement.scala

Co-authored-by: Stephen Compall <stephen.compall@daml.com>

* Update ledger-service/http-json/src/main/scala/com/digitalasset/http/Endpoints.scala

Co-authored-by: Stephen Compall <stephen.compall@daml.com>

* Apply review comments

* Update ledger-service/http-json/src/main/scala/com/digitalasset/http/domain.scala

Co-authored-by: akshayshirahatti-da <86774832+akshayshirahatti-da@users.noreply.github.com>

Co-authored-by: Stephen Compall <stephen.compall@daml.com>
Co-authored-by: akshayshirahatti-da <86774832+akshayshirahatti-da@users.noreply.github.com>
2022-01-05 12:34:04 +00:00
Samir Talwar
854b66ee2f
devenv: Use NIX_USER_CONF_FILES to set caches. (#12265)
* devenv: Factor out a function to get the Nix version.

* devenv: On newer versions of Nix, use `NIX_USER_CONF_FILES`.

This stacks, rather than overwrites.

* devenv: Append Nix caches, instead of overwriting them.

The "extra-" prefix tells Nix to append.

We also switch to non-deprecated configuration keys.

CHANGELOG_BEGIN
CHANGELOG_END

* devenv: Just require Nix v2.4 or newer.

* devenv: `NIX_USER_CONF_FILES` may not be set already.
2022-01-05 13:24:52 +01:00
Victor Peter Rouven Müller
a8a152bd06
Don't use Alice twice in the test (#12260)
changelog_begin
changelog_end
2022-01-05 11:47:06 +01:00
azure-pipelines[bot]
797b40e438
rotate release duty after 2.0.0-snapshot.20220104.8767.0.d3101e01 (#12264)
@stefanobaghino-da is taking care of 2.0.0-snapshot.20220104.8767.0.d3101e01 (#12263), so they get pushed back to the end of the line.

Please do not merge this before #12263.

CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2022-01-05 11:17:04 +01:00
azure-pipelines[bot]
c6a55f476f
release 2.0.0-snapshot.20220104.8767.0.d3101e01 (#12263)
This PR has been created by a script, which is not very smart
and does not have all the context. Please do double-check that
the version prefix is correct before merging.

@stefanobaghino-da is in charge of this release.

Commit log:
```
d3101e019d Add Flyway validation log line (#12256)
c673d1fe56 add lf extension to copyright script (#12259)
ea55ea2d14 Further copyright updates (#12249)
93e616475e Update ci nodes for copyright update (#12255)
4b4fbf8c2a [ledger-api-test-tool] - adapt the command deduplication conformance to use participant deduplication feature descriptor [kvl-1218] (#12222)
7c011cfb38 Fix tracking of party references (#12253)
cd9911b066 daml-lf, kvutils: Move Daml-LF `Archive` decoding to `kv-support` [KVL-1168] (#12241)
d31066bd68 Make @garyverhaegen-da skip this week's release rotation (#12252)
d2e2c21684 update copyright headers (#12240)
2546af359c rotate release duty after 2.0.0-snapshot.20211214.8692.0.63940872 (#12148)
0e30d468f9 expand CI cluster back (#12239)
d6d473db67 update NOTICES file (#12247)
a51f75d193 give a break to CI (#12238)
4cc4b3baf4 update compat versions for 1.18.0 (#12068)
2141bfbea5 DPP-769 cap internal state (#12135)
e1b4c30132 daml-lf / kvutils: Move Daml-LF proto conversions into kv-support [KVL-1168] (#12216)
51a1f47b43 update NOTICES file (#12232)
8f43c034ec Add transaction statistics to completion info (#12224)
dc6fdaaca9 revert back to running latest blackduck detect 6.9.0 (#12177)
994b2317a1 Add a test for daml start --sandbox-canton (#12223)
9102b0919a [ledger-api-test-tool] - add participant deduplication feature descriptor [kvl-1218] (#12213)
f847767e36 Avoid nix result-* symlinks on CI (#12220)
830497ae34 Add --sandbox-canton option in daml start (#12192)
d922a562a8 DPP-752 refactor event strategy (#12008)
ba0c6c9841 Set --enable-scenarios to False by default (#12156)
56baf036b7 Rename kv-transaction-support library [KVL-1168] (#12212)
5b142eba63 [ledger-api-test-tool] - use offset support feature descriptor [kvl-1218] (#12211)
0142c6a34e Add forM_ compat definition (#12209)
99f9776dd4 New split release for docs tests (#12186)
e182fc5026 [ledger-api] - Move deduplication duration validation into the KV WriteService (#12151)
53d55784a4 [ledger-api] - Add command deduplication features as a feature descriptor [KVL-1218] (#12181)
040f1a933f Release attempt over 9000 (#12206)
```
Changelog:
```
ledger-api - Remove validation for duration deduplication periods, which was validating that the deduplication duration is smaller than the max deduplication duration. This is now up to the ledger to enforce.
```

CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2022-01-05 09:08:14 +01:00
Robert Autenrieth
d3101e019d
Add Flyway validation log line (#12256)
changelog_begin
changelog_end
2022-01-04 21:55:09 +01:00
Gary Verhaegen
c673d1fe56
add lf extension to copyright script (#12259)
As requested by @cocreature in #12249.

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-04 16:49:01 +00:00
Gary Verhaegen
ea55ea2d14
Further copyright updates (#12249)
Somewhat error-prone, so please review carefully.

Reasons we need this:

- Some file types are not properly handled by the script.
- The only exclusion mechanism we currently have (`NO_AUTO_COPYRIGHT`)
  is overly coarse.

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-04 16:32:17 +01:00
Gary Verhaegen
93e616475e
Update ci nodes for copyright update (#12255)
Audit log for CI rotation.

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-04 15:24:31 +00:00