* Switch from sandbox to sandbox-classic in daml test-script
changelog_begin
changelog_end
* apparently sadbonx next also has ce and ee
changelog_begin
changelog_end
* Migrate daml script tests to Sandbox next
This does not yet drop all dependencies from daml script. In
particular `daml test-script` still depends on Sandbox classic. Will
tackle that in a separate PR.
changelog_begin
changelog_end
* Speedup maxInboundMessageSize tests
changelog_begin
changelog_end
@akshayshirahatti-da is taking care of 1.18.0-snapshot.20211026.8179.0.e474b2d1 (#11421), so they get pushed back to the end of the line.
Please do not merge this before #11421.
CHANGELOG_BEGIN
CHANGELOG_END
Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
Problem: default keep alive is inherited for the OS for postgres which takes 2h
until the server releases held locks in corner cases. This can cause the indexer
being unable to start up due to HA exclusion.
Solution: setting reasonably small settings for connections, which hold locks.
changelog_begin
changelog_end
* interfaces: precondition, scala ast, decoder/encoder
This adds the interface precondition to the scala Daml LF AST, plus
decoder/encoder and the typechecker.
CHANGELOG_BEGIN
CHANGELOG_END
* Update daml-lf/archive/src/main/scala/com/digitalasset/daml/lf/archive/DecodeV1.scala
Co-authored-by: Remy <remy.haemmerle@daml.com>
* format
Co-authored-by: Remy <remy.haemmerle@daml.com>
Let me provide some justification:
1. We used to have a bug around this in the assistant. This got fixed
in https://github.com/digital-asset/daml/pull/7142 together with unit
tests. https://github.com/digital-asset/daml/pull/7150 then added an
integration test. Finally
https://github.com/digital-asset/daml/pull/8032 as part of refactoring
also added a test for absolute paths.
2. As shown in https://github.com/digital-asset/daml/issues/11218
those tests together currently take more than 50s (locally without
load).
3. On the other hand, they don’t really seem to add any meaningful
coverage over the unit tests.
So overall, those tests don’t seem to test anything particularly
useful that isn’t tested elsewhere while they are very slow so
deleting them seems like the best strategy.
changelog_begin
changelog_end
* Initial work-in-progress
changelog_begin
[TS bindings] When using daml-react and daml-ledger, all streaming request to the query endpoint will be multiplexed through a single web socket.
changelog_end
* Minor touches, renaming
* Handle offsets received from the JSON API
* Create state array once per downstream consumer
* Handle reconnections as streamSubmit does
* Don't share mutable state between events
* Fix compilation errors
* Remove language-support/ts/package-lock.json
* Remove --downlevelIteration option, materialize iterators, fix one test
* I will refrain from commenting on the meaning of `this` in JavaScript
* WebSocket does not have a removeAllListeners method
* Remove unnecessary docstring from `handleQueriesChange`
* Address https://github.com/digital-asset/daml/pull/10221#discussion_r670441680
* Address https://github.com/digital-asset/daml/pull/10221#discussion_r670427941
* Address https://github.com/digital-asset/daml/pull/10221#discussion_r670448474
* Address https://github.com/digital-asset/daml/pull/10221#discussion_r670473307
* Fix some failing tests and linting fixes
* fix reconnect on server close test
* fix failing tests in test.ts and create-daml-app tests
* Update language-support/ts/daml-ledger/index.ts
Co-authored-by: Stefano Baghino <43749967+stefanobaghino-da@users.noreply.github.com>
* Update language-support/ts/daml-ledger/index.ts
Co-authored-by: Stefano Baghino <43749967+stefanobaghino-da@users.noreply.github.com>
* Update language-support/ts/daml-ledger/index.test.ts
Co-authored-by: Stefano Baghino <43749967+stefanobaghino-da@users.noreply.github.com>
* Update language-support/ts/daml-ledger/index.test.ts
Co-authored-by: Stefano Baghino <43749967+stefanobaghino-da@users.noreply.github.com>
* changes based on code review comments
Co-authored-by: Akshay <akshay.shirahatti@digitalasset.com>
Co-authored-by: akshayshirahatti-da <86774832+akshayshirahatti-da@users.noreply.github.com>
* add PartySet alias for db-backend
* add PartySet alias for fetch-contracts
* add PartySet alias for http-json
* deprecate old apply
* quick builder for NonEmpty collections
* replace PartySet in db-backend
* replace PartySet in fetch-contracts
* lar.Party is also domain.Party
* add incl1 operator
* replace PartySet in http-json
* port tests
* into with Scala 2.12 needs collection-compat
* no changelog
CHANGELOG_BEGIN
CHANGELOG_END
* simplify a couple functions that don't need so much data transformation now
* clean up some OneAnds and HKTs
* deal with Scala 2.12 without having warning suppression
* better, more obscure choice for Scala 2.12
* Make stable packages dependent on supported LF versions
Note that this just introduces an API dependency, we are not yet
filtering the list of packages. For that, I’d really like to
autogenerate StablePackages.scala since I don’t want to make that
manually maintained list even more complex. But review seems easier if
we first change the usage sites and then switch to autogenerating than
trying to do both in one go.
changelog_begin
changelog_end
* Fix script export tests
changelog_begin
changelog_end
* fine grained test evidence for authorization
* fine grained test evidence for privacy
* fine grained test evidence for input-validation (typing)
* fix exit code of security/update.sh script (set -euo pipefail)
* add security evidence test category: Input Validation
* regenerate security-evidence.md
CHANGELOG_BEGIN
CHANGELOG_END
* fix bug in securoty evidence generation (must sort before group, or else we loose lines)
* evidence for input validation of commands
* address comments
* cleanup: remove backticks from evidence free text
We are seeing lots of OOM issues on Windows after having switched to
the JSON format. They seem to happen after the actual build has
happened while writing out the exec log so trying to revert back to
the binary format seems promising.
changelog_begin
changelog_end
We waste 2 minutes on most CI runs with the conformance test for no
good reason. Uploading the package & sending a command should be
sufficient as an integration test.
changelog_begin
changelog_end
* Bump bazel memory limit to 3gb
We keep getting oom’s on Windows from Bazel itself afaict. I suspect
our build has just gotten too big. Having to increase the memory is a
bit worrying but it also doesn’t seem reasonable to expect the memory
size to stay indepenent of the build size.
changelog_begin
changelog_end
* copypasta
changelog_begin
changelog_end
This fixes an issue where we try to upload a single JSON blob that is
bigger than the limit of 500MB. We could also raise the limit, I guess,
but that seems more error-prone.
CHANGELOG_BEGIN
CHANGELOG_END
* Make Oracle tests exclusive
This attempts to solve connection timeouts we often see in tests.
changelog_begin
changelog_end
* Revert "Make Oracle tests exclusive"
This reverts commit 7804c433b3476542fc156cad9d4da4755740b123.
* Run all Oracle tests sequentially
* ifaces: update ghc-parser
This updates the ghc-parser, including the `ifaceTypeRep` method
generation for interfaces.
CHANGELOG_BEGIN
CHANGELOG_END
* pin stack snapshot on unix
* add tests
* update ghc-lib hash
* pin stackage dependencies on unix
* pinned stackage windows
Reading explicitly from ledger.begin causes the test to fail on a pruned
participant. The test framework automatically selects a ledger offset
observed at the start of the test anyway, so there's no need to
explicitly put ledger.begin as the starting offset for the checkpoints.
CHANGELOG_BEGIN
CHANGELOG_END
This PR has been created by a script, which is not very smart
and does not have all the context. Please do double-check that
the version prefix is correct before merging.
@akshayshirahatti-da is in charge of this release.
Commit log:
```
e474b2d15a [JSON-API] Websockets fix for matchedQueries (#11361)
4a34b68500 KV: port V2 errors to self-service errors framework [KVL-1143] (#11326)
811a6d3ed6 Fixed AuthorizationInterceptorSpec again (#11418)
c8006b866a ScenarioRunner: enrich incomplete transactions (#11384)
d9c7031fc3 ACS testing - payload support [DPP-661] (#11308)
d87d3d490d deal with deadlocks while fetching contracts in json-api Oracle (#11391)
8212c0b2a5 Make submission ID optional [KVL-1107] (#11011)
3587eb84a2 Use Timestamp instead of Instant (#11356)
ea5f09e524 sandbox: Deprecate the `--eager-package-loading` flag. (#11404)
9f882f2161 remove search index on json fields that harm insert and pruning performance (#11041)
70b90f47c1 optimize max event_sequential_id query for oracle (#11297)
b1fed31ca4 Fix missing script results (#11395)
03db0aa9f3 Auto run/check security evidence generation in ./fmt.sh (#11407)
c928f0e560 [Short] Typo (#11400)
ba6c2be1b5 Add missing TransactionId to com.daml.error.ErrorResource (#11396)
a2a15716b4 Generate security evidence by documenting security testcases (#11306)
8d17882951 Allocate parties sequentially in script export tests (#11389)
1309c2f819 DPP-587 Use Timestamp instead of Instant (#11183)
82f987390e Rotate release rotation (#11394)
b14077a607 Fix AuthorizationInterceptorSpec flake (#11387)
7090f2df9a update NOTICES file (#11367)
ad42dfa915 Update gRPC to the latest (1.41.0) and Protobuf (#11380)
54c400a341 Update wording in Deploying to a generic Daml ledger (#11327)
4461ed1561 Fix log output (#11374)
613aac3e47 Add support for non-star-kinded type synonyms in data-dependencies (#11293)
f89ecc6b95 interfaces: add an experimental `toTypeRep` builtin. (#11378)
5654d5cb48 fix es ingest for missing files (#11375)
03cfd1237c Configurable assertions in Ledger API test tool by feature descriptors (#11328)
96b7b5812f [DPP-648][Self-service error codes] Adopt ApiPartyManagementService (#11338)
9e94ae0f46 LF: move repl exception-auth test from dev to stable (#11369)
5365d68a38 LF: Remove PartialTransaction out from ScenarioRunner/IdeLedgerClient (#11368)
79037c8855 [DPP-646][Self-service error codes] Adopt ApiPackageManagementService (#11314)
0ee59f57c9 Command submission in the ledger-api-bench-tool. (#11296)
8d5cab5f16 LF: Simplify seeds generation in scenario runnner (#11353)
9e5b78804e Speedup daml repl integration tests (#11335)
3bc0db3316 fix contract_tpid_fkey-related race condition (#11330)
ab8a863734 [docs] Add Daml Driver for VMBC to the commercial integrations section (#11360)
c95db72e6c Fix Bazel cache download retry (#11238)
e8d0ccbdb8 [DPP-611][Self-service error codes] Adapt ApiCommandService (#11325)
a89079b4a5 [DPP-647][Self-service error codes] Adopt ApiParticipantPruningService (#11324)
cc8ec28481 [Self-service error codes] Adapt GrpcHealthService (#11354)
c60c94b13f [DPP-645][Self-service error codes] Adapt ApiConfigManagementService (#11312)
e6da1f7b52 Add step in ghc-lib guide for getting submodules to work (#11351)
f3057ea03b Increase timeout for non-repudation tests on Postgres (#11340)
176f470b25 interface: adding interfaces to the TS codegen (#11280)
355352f2d1 DPP-650 Remove the mutating schema (#11211)
443b64dffc [DPP-621][Self-service error codes] Adopt error codes in ApiVersionService (#11302)
ed9dbed100 interfaces: Add fixed choice collision check in typechecker (Haskell) (#11337)
c37ecd1a42 [Short] Pass correct loggingContext to withValidatedPackageId (#11307)
0d305cf212 [Short] Move field before logging statement (ApiTimeService) (#11313)
73c94b5b38 Increase timeout for non-repudation test (#11281)
88c607b781 [Self-service error codes] Adapt ApiTransactionService [DPP-613] (#11094)
07ad3e0d9a Suport multi-party readAs in triggers (#11299)
76eb1657d2 Interface fixed choices: ghc parser (#11275)
da27a1e812 [DPP-619][Self-service error codes] Adopt error codes in ApiVersionService (#11303)
5f5af30ce0 [DPP-628][Self-service error codes] Adapt error codes in ApiTimeService (#11295)
f9e67adafc [Self-service error codes] Adapt error responses in ledger-api-auth [DPP-617] (#11223)
728296575b Fix component status for triggers (#11311)
17776f3496 Factor out npm install step of create-daml-app tests (#11294)
3a8b685346 [Short] Fix docs for Dispatcher#startingAt (#11304)
f315a9003b release 1.18.0-snapshot.20211019.8113.0.8ff347d8 (#11300)
8a3abce47b [DPP-618][Self-service error codes] Adapt error codes in ApiPackageService (#11284)
50ea92f7b3 Use ApiTypes.Party instead of String in the trigger runner (#11298)
2267429ae1 [DPP-656] Assert on self-service error code details in ErrorFactoriesSpec (#11289)
c06faf2764 LF: remove imperative environment from Speedy compiler (#11285)
d3dad75d00 [DPP-592] Generate docs for self-service error codes. (#11129)
```
Changelog:
```
[JSON-API] fixes a bug related to the matchedQueries value returned for websocket multiqueries,
this only happens for patterns where the multiqueries contain a mixture of queries with and without
offsets.
- [Integration Kit] - ledger-api-bench-tool can generate test contracts with configurable payload size.
- [Integration Kit] - Added multi-template support for command submission in the ledger-api-bench-tool
- [Sandbox] The ``--eager-package-loading`` flag has been deprecated. It
hasn't actually done anything for many releases; packages are always
loaded eagerly. This does not affect Daml on SQL, which does support
lazy package loading.
- [Daml Studio] Fix a bug where script results in Daml Studio
sometimes do not show up.
- [Integration Kit] - The ledger-api-bench-tool is now capable of generating test contracts for testing purposes.
- [JSON API] Fixed a rare error that manifested as
‘violates foreign key constraint "contract_tpid_fkey"
Detail: Key (tpid)=(...) is not present in table’
when attempting to run queries and goes away on JSON API restart.
See `issue #11330 <https://github.com/digital-asset/daml/pull/11330>`__.
- [Participant] All participants now use the new append-only schema. Existing databases will
automatically upgrade to the new schema the first time a participant/ledger is started.
- [Daml Triggers] Triggers now support readAs parties. They can be
specified via `--ledger-readas a,b,c`. As part of this change
``testRule`` gained an extra argument to specify the `readAs`
parties. If you previously used
```
testRule trigger party acsBuilder commandsInFlight s
```
you now need to use
```
testRule trigger party [] acsBuilder commandsInFlight s
```
```
CHANGELOG_BEGIN
CHANGELOG_END
Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
