Commit Graph

159 Commits

Author SHA1 Message Date
tudor-da
59b606b32b
[LLP] In-memory fan-out buffer size 0 allowed [DPP-1125] (#14334)
* This PR allows using 0-sized in-memory fan-out buffers and other test adjustments
* Allow 0-sized buffer
* Adapt Sandbox-on-X conformance tests

changelog_begin
changelog_end

* Simplified implementation
2022-07-18 08:55:45 +02:00
tudor-da
5f702bbf7d
[LLP] Indexer - Ledger API bypass [DPP-1043] (#14319)
* Moves ParticipantConfig and dependants to `participant-integration-api`

changelog_begin
changelog_end

* Implement Indexer - Ledger API bypass

* Adjust configuration parameters
* Remove run-mode
* Create inMemoryStateUpdaterParallelism

* Rename components

* IndexServiceOwner is not private[platform]

* Address review comments

* Rebase
2022-07-13 15:52:33 +02:00
tudor-da
88784d6c3c
[Explicit disclosure] Update Read- and WriteService interfaces for explicit disclosure [DPP-1094] (#14341)
* Update Read- and WriteService with explicit disclosure payloads

changelog_begin
changelog_end

* Addressed review comments
2022-07-12 08:30:33 +02:00
Sergey Kisel
5b792e91df
Provide a non-zero exit code in case of misconfiguration. (#14364)
CHANGELOG_BEGIN
CHANGELOG_END
2022-07-06 14:32:23 +00:00
Sergey Kisel
f465179ccf
Print configuration which is used on SoX startup [DPP-1075] (#14347)
CHANGELOG_BEGIN
CHANGELOG_END
2022-07-05 15:19:42 +00:00
Sergey Kisel
e151090cf3
Introduction of HOCON configuration for SoX [DPP-1033] (#14029)
* Introduction of HOCON configuration

CHANGELOG_BEGIN
CHANGELOG_END
2022-07-05 15:35:16 +02:00
Sergey Kisel
f9521f27eb
Accept new form of JWT tokens [DPP-1102] (#14323)
* Accept new form of jwt tokens [DPP-1102]

CHANGELOG_BEGIN
CHANGELOG_END
2022-07-04 17:41:08 +02:00
Sergey Kisel
6a80a1a82f
Removal of sandbox-classic module and binary (#14201)
* Removal of sandbox-classic module and binary

CHANGELOG_BEGIN
CHANGELOG_END
2022-06-21 11:09:51 +02:00
Moisés Ackerman
78cc57b243
Add failing daml-test-file (#14176)
fix #14171

CHANGELOG_BEGIN

* [Bugfix] fix failing by-key ops after roll-backed archive and create
  See https://github.com/digital-asset/daml/issues/14171

CHANGELOG_END
2022-06-15 20:00:04 +00:00
Sergey Kisel
a6d6b7c324
Remove AuthServiceConfig from StandaloneApiServer (#14133)
CHANGELOG_BEGIN
CHANGELOG_END
2022-06-09 19:39:04 +02:00
tudor-da
fc47a8995c
[LLP] Implement the possibility to have a shared StringInterningView [DPP-1042] (#14062)
* Allow the possibility to have a shared StringInterningView

changelog_begin
changelog_end

* Solve TODO in RecoveringIndexerIntegrationSpec

* Addressed Marton's review comments

* Added thread-safety mentionsin string interning interfaces
2022-06-08 16:13:31 +02:00
Sergey Kisel
1d8f195438
Sandbox Classic Removal in Tests (#13934)
CHANGELOG_BEGING
CHANGELOG_END
2022-06-07 19:54:52 +00:00
Andreas Lochbihler
4cfffec87a
Extract a contract state machine for transaction interpretation and validation (#14044)
CHANGELOG_BEGIN
CHANGELOG_END
2022-06-02 09:39:37 +00:00
Marton Nagy
f5a2539d6f
Add globalKeyMapping to WriteService [DPP-1067] (#14026)
The field globalKeyMapping is recently added to
lf.transaction.Transaction.Metadata, and which is
computed by the Engine.
This field might be needed for processing by WriteService
implementors.
This PR adds this to the WriteService.

changelog_begin
Global contract key mapping is added to WriteService.
changelog_end
2022-06-01 10:08:18 +02:00
tudor-da
3c5a52b895
[LLP] Move ledger-api-transactions-buffer-max-size to Config from ParticipantConfig (#14009)
* Move `ledger-api-transactions-buffer-max-size` to Config from ParticipantConfig

changelog_begin
changelog_end

* Update ledger/ledger-runner-common/src/main/scala/com/daml/ledger/runner/common/CliConfig.scala

Co-authored-by: mziolekda <marcin.ziolek@digitalasset.com>

Co-authored-by: mziolekda <marcin.ziolek@digitalasset.com>
2022-06-01 05:51:55 +00:00
Sergey Kisel
168f943ff0
Revise the config to use a hierarchical structure [DPP-1029] (#13629)
* Revise the config to use a hierarchical structure [DPP-1029]

CHANGELOG_BEGIN
CHANGELOG_END
2022-05-30 18:02:53 +02:00
tudor-da
0cda5d5c5a
Fix Sandbox-on-X error messages for inconsistent/duplicate key conflicts (#14008)
changelog_begin
changelog_end
2022-05-30 10:24:40 +02:00
tudor-da
506af6c6eb
Introduce instrumented .buffered decorator for Akka Sources and Flows (#13997)
changelog_begin
changelog_end
2022-05-27 13:59:12 +00:00
Simon Maxen
18e9473196
Rate limit [DPP-999] (#13956)
* RateLimitingInterceptor integrated into GrpcServer

changelog_begin
changelog_end
2022-05-25 17:13:49 +01:00
tudor-da
ee9891b4b0
[LLP] Memory safe buffered ledger api streams [DPP-1020] (#13852)
* [TO BE REMOVED] OOM memory test for BufferedTransactionsReader

* [LLP] Memory-safe BufferedTransactionsReader

changelog_begin
changelog_end

* Addressed Simon's review comments

* Non-recusive stream construction

* Remove redundant in-stream buffers

* Addressed Marton's review comments

* Last round of addressing Marton's comments

* Remove MemoryBoundedBufferedTransactionsReaderSpec
2022-05-23 19:06:54 +00:00
Marton Nagy
fb9f10547e
ACS ID fetching rewrite [DPP-986] (#13745)
Simplifies ID fetching logic
Removes dead code / tests
Cleans up factories (Materializer not needed anymore)
Simplifies ConcurrencyLimiter interface
Adds/cleans up unit tests

CHANGELOG_BEGIN
CHANGELOG_END
2022-05-23 09:29:36 +02:00
Sergey Kisel
37b958beb1
Removal of sandbox-common-ce as redundant (#13824)
* Removal of `sandbox-common-ce` as redundant

CHANGELOG_BEGIN
CHANGELOG_END
2022-05-10 13:59:52 +02:00
Marton Nagy
5d8ebd7a08
Switch to asynchronous teardown at Dispatcher (#13631)
Previously a fire and forget release process
was implemented, which in corner cases could
result in exceptions, as API stream was still running after DbDispatcher was released.

This PR changes to waiting for all the streams to finish as releasing Dispatcher (with a timeout of 5 seconds).

CHANGELOG_BEGIN
CHANGELOG_END
2022-05-05 21:15:58 +02:00
Sergey Kisel
50c0f233e8
Address review concerns on security test evidence. (#13794)
* Address review concerns on security test evidence.

CHANGELOG_BEGIN
CHANGELOG_END
2022-05-05 14:12:05 +00:00
Robert Autenrieth
1b9e990511
DPP-925 Move package object (#13741)
* Move package object

changelog_begin
changelog_end

* More consistently use aliases
2022-05-03 21:53:21 +02:00
Marton Nagy
0ea140f51e
Fix random exercise node's childEventId order [DPP-1018] (#13740)
Fixes Index DB insertion order for childEventId.
Adds backwards compatibility treatment: recovering childEventId
order from the order of events at API stream rendering.
Extends TransactionServiceVisibilityIT with the ordering criterion.
Fixes compatibility tests with exclusion.
Adds documentation to event.proto.

CHANGELOG_BEGIN
Fixing Ledger API Bug: Exercise nodes in transaction trees
have child_event_ids out of order.
CHANGELOG_END
2022-05-03 16:02:25 +02:00
Nicu Reut
a792de39a5
Update scalafmt to 3.5.1. (#13584)
CHANGELOG_BEGIN
CHANGELOG_END
2022-04-28 09:57:04 +00:00
Robert Autenrieth
f0303b698e
Rename appendonlydao to dao (#13715)
* Rename appendonlydao to dao

changelog_begin
changelog_end

* fmt
2022-04-27 22:12:40 +02:00
Robert Autenrieth
a88ae129b5
Use small buffers for tests (#13659)
* Use small buffers for tests

changelog_begin
changelog_end

* Update ledger/sandbox-on-x/BUILD.bazel

Co-authored-by: tudor-da <tudor.voicu@digitalasset.com>

Co-authored-by: tudor-da <tudor.voicu@digitalasset.com>
2022-04-26 11:27:59 +02:00
Marton Nagy
94b3a5890e
Fix ACS id retrieval parallelism [DPP-986] (#13550)
This PR fixes an issue with the ACS ID page retrieval: if there is one
of the id page DB fetching is slow, all the rest of the ID fetching
lanes getting fetched, due to continuous demand.
We implemented a treatment to cap the increased number of ID pages
accumulated in memory, by failing the stream.

Switching to mapAsync in pullWorkerSource naturally will
stop demand, in case a single query takes too long.
This also removes the need for the queue size limitting treatment.

* Switches to mapAsync in pullWorkerSource
* Fixes unit test
* Removes queue limiting feature (as it is not necessary anymore)

CHANGELOG_BEGIN
CHANGELOG_END
2022-04-20 15:20:19 +00:00
Sergey Kisel
a6b3d5f581
Cleanup around configuration (#13597)
* Cleanup around configuration

CHANGELOG_BEGIN
CHANGELOG_END

* Removal of unused configuration parameters. Merge cohesive params.

* Removal of ParticipantIndexerConfig as redundant transformation layer.

* Extracting engine config values

* Separation of IndexConfiguration
2022-04-19 13:19:11 +02:00
Remy
4e51194041
LF: Drop byInterface field from Transaction Nodes (#13520)
part of #13491

CHANGELOG_BEGIN
CHANGELOG_END
2022-04-07 11:06:17 +02:00
Sergey Kisel
748510999a
Annotate more Ledger API tests with authorisation test evidence. (#13445)
* Annotate more Ledger API tests with authorisation test evidence.

CHANGELOG_BEGIN
CHANGELOG_END
2022-04-06 13:24:28 +00:00
Sergey Kisel
f2a8220121
Fixing sandbox-on-x test targets. (#13451)
CHANGELOG_BEGIN
CHANGELOG_END
2022-03-30 08:45:45 +02:00
Sergey Kisel
55ca1af7e3
PublicServiceCallAuthTests security test evidence [DPP-961] (#13363)
changelog_begin
changelog_end
2022-03-23 17:37:19 +01:00
tudor-da
49e950dc59
Validated package uploads on SandboxServer startup (#13340)
* Validated package uploads on SandboxServer startup

changelog_begin
changelog_end

* Addressed Martino's review comments
2022-03-21 21:39:51 +01:00
pbatko-da
c6a0275f6e
[Error codes] Fill in missing contexts that were lost where reflection based context population was removed [DPP-606] (#13264)
And rename error arguments that haven't been in camel case yet.

changelog_begin
changelog_end
2022-03-16 15:07:24 +01:00
pbatko-da
ee6a5f9e0e
Handle misc error codes todos. [DPP-606] (#13248)
changelog_begin
changelog_end
2022-03-14 17:16:31 +01:00
pbatko-da
92e3e9e2df
Add unit tests for ErrorCode [DPP-799] (#13236)
changelog_begin
changelog_end
2022-03-14 12:38:23 +01:00
pbatko-da
fbb3ba55c2
Simplify implementations of BaseError trait [DPP-606] (#13185)
1. Remove `BaseError.Impl`, `LoggingTransactionErrorImpl` and `LoggingPackageServiceError` 
and instead provide more direct `DamlError` and `DamlErrorWithDefiniteAnswer`.


2. Remove custom implementation of `TransactionError.rpcStatus` and instead provide simpler one in `DamlErr.r.rpcStatus` (which works by first calling `code.asGrpcStatus` and then converting the result to `com.google.rpc.status.Status`).

3. Remove `GrpcStatus.toProto` and instead use `DamlError.rpcStatus`.

4. Use `asGrpcStatus` and `asGrpcError`  instead of `asGrpcStatusFromContext` and `asGrpcErrorFromContext` where possible.


changelog_begin
changelog_end
2022-03-10 12:12:14 +01:00
pbatko-da
c7c211e4df
Remove most of ErrorFactories [DPP-606] (#13146)
changelog_begin
changelog_end
2022-03-07 16:15:21 +01:00
pbatko-da
15aa300fba
Use DamlContextualizedErrorLogger.forTesting (#13137)
changelog_begin
changelog_end
2022-03-04 12:24:08 +01:00
pbatko-da
af27f5d926
Make ErrorFactories into an object in preparation for its removal. [DPP-606] (#13143)
changelog_begin
changelog_end
2022-03-04 09:35:38 +01:00
tudor-da
ea48173350
Switch daml-lf/engine and leger-api-tests/tool not depend on kvutils (#13107)
changelog_begin
changelog_end
2022-03-01 15:41:12 +01:00
Robert Autenrieth
d5a4aea3a7
Fix broken test logback (#13063)
changelog_begin
changelog_end
2022-02-24 10:28:56 +01:00
pbatko-da
15b54a870e
[User management] Enable UM for sandbox-on-x and ledger-on-sql conformance tests (#13041)
The goal is to have a conformance test using Oracle and with UM enabled.

changelog_begin
changelog_end
2022-02-23 15:42:48 +01:00
mziolekda
a235a66f38
Remove unsafe from the buffered-ledger-api-streams (#13022)
* Remove unsafe from the buffered-ledger-api-streams

CHANGELOG_BEGIN
CHANGELOG_END

* and a bazel file
2022-02-22 19:02:05 +01:00
pbatko-da
a4f9dd79c6
[User management] Add race conditions test-tool tests for CreateUser and GrantUserRights [DPP-847] (#12983)
changelog_begin
changelog_end
2022-02-22 17:36:06 +01:00
pbatko-da
98d5bd5f53
[User management] Add submission-id to the logs for mutating user management calls [DPP-887] (#12955)
changelog_begin
changelog_end
2022-02-17 14:29:58 +01:00
tudor-da
4e0cb1080e
Add index DB backend to Sandboxes startup message (#12967)
changelog_begin
changelog_end
2022-02-16 13:34:15 +00:00