daml/ledger/sandbox-on-x
Marton Nagy f742a4334e
Dpp 336 sandbox classic on append only (#9561)
This change adds support of append-only schema in sandbox-classic and daml-on-sql ledgers: this is available with feature flag.
The support is PoC grade, it will be stabilized/productionized in the upcoming epic.
Currently enabled CI tests in the respective projects guarding this implementation.

* Introduce SequentialWriteDao for simplified indexing in sandbox-classic
* Use this in appendonly.JdbcLedgerDao to implement necessary methods
* Add support for ledgerEnd query to StorageBackend
* Fix JdbcLedgerDao creation (supporting append-only)
* Add feature flag and wiring for sandbox-classic
* Activate conformance tests with append-only on sandbox-classic
* Add support/ci coverage for daml-on-sql

changelog_begin
changelog_end
2021-05-06 19:32:08 +02:00
..
src Dpp 336 sandbox classic on append only (#9561) 2021-05-06 19:32:08 +02:00
BUILD.bazel Race condition test suite for the ledger-api-test-tool [DPP-274] (#9138) 2021-03-25 23:07:01 +01:00
README.md Adding first draw of sandbox-on-x concept (#9074) 2021-03-25 08:35:43 +01:00

Overview

Sandbox on X - Proof of Concept

This is a proof-of-concept of the sandbox-on-x architecture, which is a Daml ledger with persistency that uses the on-X architecture while being backed by an IndexDB only. This architecture is DB compatible with the sandbox-classic, while using the very same participant.state.api.v1.ReadService and .WriteService interfaces that all Daml ledger other than sandbox-classic use.

We pursue several goals with the implementation of the sandbox-on-x architecture:

  1. Use it as a drop-in-replacement of the implementation of daml-on-sql and sandbox-classic; and thereby enable a massive code cleanup due to removing the direct DB-access code used in daml-on-sql and sandbox-classic.
  2. Use it as the regression test for both functional and non-functional properties of the Ledger API server components built in the daml repo. We expect this implementation to satisfy the 1k CHESS+ trade/s throughput requirement.
  3. Lower Spider's CI times by providing them with a high-throughput single-process Daml ledger.

The proof-of-concept should have the same throughput as any other Daml ledger, and can be used for testing the throughput of Ledger API server components. Its main limitation is that it does not do conflict-checking. We plan to resolve that in the future using a two-stage approach, which first checks conflicts against a fixed ledger end and then against in-flight transactions. We expect this approach to scale to very large active contracts sets.