Commit Graph

119 Commits

Author SHA1 Message Date
pbatko-da
c7c211e4df
Remove most of ErrorFactories [DPP-606] (#13146)
changelog_begin
changelog_end
2022-03-07 16:15:21 +01:00
pbatko-da
15aa300fba
Use DamlContextualizedErrorLogger.forTesting (#13137)
changelog_begin
changelog_end
2022-03-04 12:24:08 +01:00
pbatko-da
af27f5d926
Make ErrorFactories into an object in preparation for its removal. [DPP-606] (#13143)
changelog_begin
changelog_end
2022-03-04 09:35:38 +01:00
tudor-da
ea48173350
Switch daml-lf/engine and leger-api-tests/tool not depend on kvutils (#13107)
changelog_begin
changelog_end
2022-03-01 15:41:12 +01:00
Robert Autenrieth
d5a4aea3a7
Fix broken test logback (#13063)
changelog_begin
changelog_end
2022-02-24 10:28:56 +01:00
pbatko-da
15b54a870e
[User management] Enable UM for sandbox-on-x and ledger-on-sql conformance tests (#13041)
The goal is to have a conformance test using Oracle and with UM enabled.

changelog_begin
changelog_end
2022-02-23 15:42:48 +01:00
mziolekda
a235a66f38
Remove unsafe from the buffered-ledger-api-streams (#13022)
* Remove unsafe from the buffered-ledger-api-streams

CHANGELOG_BEGIN
CHANGELOG_END

* and a bazel file
2022-02-22 19:02:05 +01:00
pbatko-da
a4f9dd79c6
[User management] Add race conditions test-tool tests for CreateUser and GrantUserRights [DPP-847] (#12983)
changelog_begin
changelog_end
2022-02-22 17:36:06 +01:00
pbatko-da
98d5bd5f53
[User management] Add submission-id to the logs for mutating user management calls [DPP-887] (#12955)
changelog_begin
changelog_end
2022-02-17 14:29:58 +01:00
tudor-da
4e0cb1080e
Add index DB backend to Sandboxes startup message (#12967)
changelog_begin
changelog_end
2022-02-16 13:34:15 +00:00
nicu-da
55fef9cf6a
[ledger-api] - Rename max deduplication time to max deduplication duration [KVL-1311] (#12939)
changelog_begin
ledger-api - rename ledger configuration max_deduplication_time to max_deduplication_duration
changelog_end
2022-02-15 21:14:26 +01:00
Samir Talwar
ac12112dad
ledger-api-tests: Remove the performance-testing functionality. (#12948)
* ledger-api-tests: Remove the performance-testing functionality.

This has been superseded by the Ledger API Bench Tool.

CHANGELOG_BEGIN
- [Ledger API Test Tool] The performance tests have been removed from
  this tool, in favor of the Ledger API Bench Tool, which is much more
  capable and configurable.
CHANGELOG_END

* ledger-on-sql/sandbox-on-x: Stop running performance tests.

We don't check the results anyway.
2022-02-15 17:06:23 +00:00
tudor-da
2a06a0a78c
Conflict checking enabled by default (#12924)
changelog_begin
changelog_end
2022-02-15 15:51:42 +01:00
Kamil Bozek
dfd38186fe
Remove pre-1.18 error codes [DPP-773] (#12841)
* Remove legacy error codes

CHANGELOG_BEGIN
CHANGELOG_END

* Remove ValidatorFixture

* Removed redundant helper function

* Remove redundant object

* Rebased.

run-full-compat: true

* Rebased.

run-full-compat: true
2022-02-15 15:28:36 +01:00
tudor-da
d97f9815b2
Cleaned Sandbox-on-X logging (#12931)
changelog_begin
changelog_end
2022-02-15 15:23:38 +01:00
mziolekda
8786f81aa2
Remove daml-on-sql (#12891)
* Remove daml-on-sql

CHANGELOG_BEGIN
Remove daml-on-sql
CHANGELOG_END

* migrate daml-on-sql documentation to sandbox-on-x
2022-02-14 17:17:27 +01:00
tudor-da
307931d5b4
Extracted kvutils Config to //leger/ledger-runner-common [DPP-865] (#12889)
* Extracted kvutils Config to //leger/ledger-runner-config

changelog_begin
changelog_end

* Sandbox-on-X logback.xml does not depend on the kvutils/app one

* Remove unused dependencies

* Add copyright header back

* Remove dependency of SoX on kvutils
2022-02-14 13:52:06 +00:00
tudor-da
dd6dab6e6b
[Sandbox-on-X] Address various TODOs (#12823)
* Removed no-action TODOs

changelog_begin
changelog_end

* Assert self-service error codes in SequenceSpec

* Move InternallyInconsistentKeys and InternallyDuplicateKeys to LedgerApiErrors.WriteServiceRejections

* Restructured ledger bridge metrics
* Buffers before each processing stage

* Do not log the failure stacktrace on ledgerId lookup

* Addressed review comments

* Buffer size before prepare submission is 128
2022-02-11 17:03:41 +00:00
Samir Talwar
83ed13d799
Split the ledger-api-test-tool into libraries, under /ledger/ledger-api-tests. [KVL-1076] (#12771)
* Move //ledger/ledger-api-test-tool to //ledger/ledger-api-tests/tool.

And conformance.bzl to //ledger/ledger-api-tests.

* Move test tool infra to //ledger/ledger-api-tests/infrastructure.

* Split the ledger API test tool into smaller libraries.

There is no change to behavior.

CHANGELOG_BEGIN
CHANGELOG_END

* ledger-api-tests: Encapsulate performance tests.

* ledger-api-tests: Extract a "runner" library.

* ledger-api-tests: Publish libraries to Maven Central.

* ledger-api-tests: Fix Scaladoc so it compiles correctly.

Unfortunately I had to remove some Scaladoc in ActiveContractsServiceIT
which is incorrectly interpreted as not being attached to anything.
Fortunately, it's not actually that helpful.

* compatibility: Fix paths to the Ledger API Test Tool.

* Fix release types for ledger API test libraries.

* test-common: Publish generated Scala.

These libraries are dependencies of the ledger API tests components.

* ledger-api-tests: Use "com.daml" as the group ID everywhere.

* ledger-api-tests: Check that tests in `--additional` are valid.

* compatibility: Fix a reference to ledger-api-test-tool I missed.
2022-02-10 13:25:23 +00:00
Marton Nagy
f27977953d
Clean maximum ledger time interface (#12844)
* add Scala Doc, change name for communicating the purpose better
* change return type for not passing data in exceptions
* adapt usage

changelog_begin
changelog_end
2022-02-10 02:06:59 +00:00
tudor-da
a860b9390f
[Sandbox-on-X] Deduplication state perf optimization (#12802)
* [Sandbox-on-X] Optimal deduplication algorithm

changelog_begin
changelog_end

* Dropped `Unsafe` from UnsafeDeduplicationStateQueueMap

* Addressed Marton's review comments
* Update the deduplication state on duplicate
* Optimize `withoutOlderThan`

* Reverted DeduplicationStateQueueMap optimization
2022-02-09 16:08:39 +00:00
pbatko-da
f2b7902c68
[User management] Add CreateUserResponse and GetUserResponse gRPC response wrappers [DPP-854] (#12682)
changelog_begin
Ledger API Specification: CreateUser and GetUser endpoints of UserManagementService now return the CreateUserResponse or GetUserResponse messages, whereas previously they were returning the User message).
changelog_end
2022-02-08 12:29:57 +01:00
tudor-da
c9dcd1c493
Update kvutils Config with missing flags options from SandboxConfig [DPP-864] (#12629)
* Update kvutils Config and SandboxConfig
* Remove `eager-package-loading` and `scenario` from SandboxConfig
* Add `profile-dir` and `stackTraces` to kvutils Config
* Configurable authService in kvutils

changelog_begin
changelog_end

* Addressed Samir's review comments

* Add back Maximum supported deduplication duration enforcement of 1 hour
2022-02-07 20:13:04 +00:00
pbatko-da
fa0062303d
[User management] Use JVM timestamps [DPP-798] (#12662)
I.e. calculate number of microseconds since Unix epoch in JVM rather than separately in each supported database.

changelog_begin
changelog_end
2022-02-07 15:22:28 +01:00
tudor-da
d63651be58
[Sandbox-on-X] Duplicate party allocations explicit rejection (#12767)
* Added test case in PartyManagementServiceIT

changelog_begin
changelog_end

run-full-compat: true
2022-02-07 14:14:19 +01:00
Marton Nagy
79fd012508
Setup logging for sandbox-on-x conformance tests (#12786)
changelog_begin
changelog_end
2022-02-07 11:25:42 +00:00
tudor-da
14a0459f0a
SandboxNextFixture replaced by SOX-based SandboxFixture (#12654)
* SandboxNextFixture replaced by Sandbox-on-X based SandboxFixture

changelog_begin
changelog_end

* Some fixed tests

* No direct dependencies on //ledger/sandbox:sandbox and //ledger/sandbox:sandbox-scala-tests-lib

* Fix after rebase

* Rename SandboxFixture and add a missing dep

* Generate valid party names if hint is empty

* Smaller maxInboundMessageSize

* Added test for empty display name

* SandboxServer is a ResourceOwner
* Uses execution context passed as an input for resource management
* Fixes flaky FlywayMigrations issue with null Thread.currentThread.currentClassLoader
* SandboxServer simplification returns Port instead of ApiServer

* Dedicated PMAllocateWithoutDisplayName for non-Canton ledgers
* Created since Canton does not return empty display names
2022-02-07 09:25:22 +01:00
Marton Nagy
5a2dffd79e
Add multi-db sandbox-on-x conformance tests [DPP-802] (#12585)
* Enhances SandboxOnXRunner with manipulateConfig
* Adds Postgres and Oracle conformance test runner binaries
* Adapts BUILD.bazel

changelog_begin
changelog_end
2022-02-04 15:28:20 +01:00
pbatko-da
97676bdb2c
Increase time-out in OngoingStreamAuthIT (#12747) 2022-02-04 12:44:40 +01:00
pbatko-da
6926e9adb4
Deprecate user identity service [DPP-862] (#12694)
changelog_begin
Ledger API Specification: Ledger Identity service is now deprecated.
changelog_end
2022-02-04 10:32:09 +01:00
tudor-da
c11d4a7978
[Sandbox-on-X] Source record time once and pass downstream (#12722)
changelog_begin
changelog_end
2022-02-03 12:23:34 +01:00
tudor-da
2885a3e02d
[Sandbox-on-X] Increased max deduplication duration to 30 minutes (#12713)
changelog_begin
changelog_end
2022-02-03 12:01:16 +01:00
nicu-da
c6ed12dc6c
[ledger-api-test-tool] - Remove static time flag which was replaced by a feature descriptor (#12714) 2022-02-02 09:30:50 -08:00
tudor-da
784faf6179
[Sandbox-on-X] Fix record time assignment (#12706)
changelog_begin
changelog_end
2022-02-02 15:32:07 +01:00
tudor-da
5390505627
Remove participant-side command deduplication [DPP-848] (#12677)
* Remove participant-side command deduplication

changelog_begin
changelog_end

* Addressed review comments
2022-02-01 20:50:25 +00:00
Simon Maxen
6cdda6fbf7
Metering report [DPP-817] (#12604)
With experimental support for non-aggregated metering reporting

changelog_begin
with experimental support for non-aggregated metering reporting
changelog_end
2022-02-01 10:38:04 +00:00
tudor-da
716cc22ac9
Deduplication offset period errors handled in Sandbox-on-X [DPP-872] (#12652)
* Deduplication offset period errors handled in Sandbox-on-X
* InternalUnsupportedOperation error category

changelog_begin
changelog_end

* Apply suggestions from code review

Co-authored-by: Simon Meier <meiersi-da@users.noreply.github.com>

* Addressed review comments

* Apply suggestions from code review

Co-authored-by: Simon Meier <meiersi-da@users.noreply.github.com>

Co-authored-by: Simon Meier <meiersi-da@users.noreply.github.com>
2022-02-01 10:32:38 +00:00
tudor-da
117c9202cd
Bump sandbox-on-x-it-tests size (#12681)
changelog_begin
changelog_end
2022-01-31 17:12:12 +00:00
tudor-da
92938d5e76
Moved com.daml.platform.sandbox to com.daml.ledger.sandbox in SoX (#12675)
* Moved com.daml.platform.sandbox to com.daml.ledger.sandbox in SoX

changelog_begin
changelog_end

* Reordered imports
2022-01-31 17:04:58 +00:00
tudor-da
bb5722cd1b
Move sandbox-classic test lib and IT tests to Sandbox-on-x (#12641)
* Moved SandboxFixture and IT tests to Sandbox-on-X

changelog_begin
changelog_end

* Addressed review comments
2022-01-31 12:49:46 +01:00
pbatko-da
c72c27c967
[User management] Terminate ongoing streams when user state has changed [DPP-830] (#12437)
CHANGELOG_BEGIN
Ledger API Specification: When using user management based authorization streams will now get aborted on authenticated user's rights change.
CHANGELOG_END
2022-01-28 16:44:39 +01:00
tudor-da
cfa8d30491
[Sandbox-on-X] Ledger-side in-memory command deduplication [DPP-872] (#12596)
* [Sandbox-on-X] Ledger-side in-memory command deduplication

changelog_begin
changelog_end

* Enirched SequenceSpec test

* Participant-side deduplication compatibility tests exclusions

* Fix LedgerConfigurationServiceIT

* Disable command deduplication tests for SoX without conflict checking

* Remove redundant max-dedup-seconds bridge config

* Default max deduplication time 5 minutes

* Deduplication queue length metrics

* Add back removed ledger config test in SequenceSpec
2022-01-28 11:42:25 +00:00
pbatko-da
4ec336dd6a
[User management] Enforce 1k user rights limit [DPP-833] (#12558)
CHANGELOG_BEGIN
Ledger API Specification: Maximum number of user rights per user is now limited to 1000 and is added to UserManagementFeature in VersionService. getLedgerApiVersion endpoint.
CHANGELOG_END
2022-01-27 22:12:34 +01:00
mziolekda
16a13e21b7
Remove redundant conformance tests from ledger-on-sql (#12639)
- Remove duplcate postgres test
- Move oracle tests under the common framework
- Move in-memory-fan-out test to sandbox-on-x

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-27 19:41:05 +00:00
tudor-da
3e16e5ec98
Handle ledger bridge Queue errors (#12510)
changelog_begin
changelog_end
2022-01-26 18:48:00 +00:00
Samir Talwar
ac3ca1d20c
ledger-api-test-tool: Enable command deduplication tests by default [KVL-1261] (#12541)
* ledger-api-test-tool: Enable command deduplication tests by default.

CHANGELOG_BEGIN
- [Ledger API Test Tool] More command deduplication tests have been
  enabled by default. This should not affect testing a fully functioning
  ledger. If any tests fail, they can be temporarily excluded.
CHANGELOG_END
2022-01-25 12:51:45 +01:00
tudor-da
5d93eb93e8
Engine stacktraces are disabled by default (#12562)
changelog_begin
changelog_end
2022-01-25 09:02:29 +00:00
tudor-da
8d65aa3b4d
Remove Sandbox classic stores and related unit tests (#12532)
* Remove Sandbox classic stores and related unit tests

changelog_begin
changelog_end

* Add missing test case in SequenceSpec
2022-01-24 15:03:27 +01:00
tudor-da
bd0ae0239b
Startup initialization header for runners [DPP-860] (#12525)
* Startup header of kvutils Runner

changelog_begin
changelog_end

* Added initialization header for Sandbox-on-X

* Updated Sandbox-on-X init message

* Updated initialization log for kvutils.Runner
2022-01-21 21:11:22 +00:00
Samir Talwar
4d26f0899e
ledger-api-test-tool: Enable ParticipantPruningIT for everyone. [KVL-1261] (#12529)
* ledger-api-test-tool: Enable `ParticipantPruningIT` for everyone.

CHANGELOG_BEGIN
- [Ledger API Test Tool] The ``ParticipantPruningIT`` test case has
  been enabled by default. You may need to disable specific test cases
  accordingly.
CHANGELOG_END

run-full-compat: true

* Enable more ParticipantPruningIT tests across the board.

* ledger-api-test-tool: Exclude a multi-participant test by default.

The test, `PRImmediateAndRetroactiveDivulgence`, will now only run if
more than one participant is specified.

* ledger-api-test-tool: Use a `for` comprehension for readability.

Co-authored-by: tudor-da <tudor.voicu@digitalasset.com>

Co-authored-by: tudor-da <tudor.voicu@digitalasset.com>
2022-01-21 16:16:57 +00:00