Commit Graph

11163 Commits

Author SHA1 Message Date
Simon Maxen
d76603d137
Metering clarifications for Daml Hub [DPP-1314] (#15898)
* Add metering report JSON schema

* Add metering report JSON schema
* Remove metering-report-schema from proto exclusion list
* Add header to metering report validator
* Rename struct-json to struct-spray-json
* Add struct-circe-json

* Update with release comments
2022-12-16 10:46:32 +00:00
Bernhard Elsner
1f30da1f23
Remove "Module" from daml-doc H1 headers (#15862)
* Remove "Module" from daml-doc H1 headers

CHANGELOG_BEING
- Remove the word "Module" from the H1 page header of
- module pages and stop overriding the ToC headers to make
- the generated pages easier to use.
CHANGELOG_END

* Reinstate links in daml-docs rst TOC

* Update render tests

* Update golden tests

Co-authored-by: Moisés Ackerman <6054733+akrmn@users.noreply.github.com>
2022-12-16 10:19:08 +00:00
Remy
f1aca5e11c
[Speedy] create Scenario Machine (#15588) 2022-12-16 08:20:42 +00:00
azure-pipelines[bot]
6c25c7c8be
bump canton to 20221215 (#15910)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2022-12-16 08:46:09 +01:00
Chun Lok Ling
5f01588417
Conversion between javaapi.data.Value and lf.value.Value (#15885)
* init

* make it able to sync first

* deps

* adt cases

* reorder

* toLfValue

* revert

* toLfValue

* fromLfValue

* bazel

* scala check generator round trip test

* fix test

* Apply suggestions from code review

Co-authored-by: Stephen Compall <stephen.compall@daml.com>

* address comments

* address comments

* address comments

* address comments

* address comments

* address comments

* address comments

* address comments

* fix CI

* fix CI

* na

Co-authored-by: Stephen Compall <stephen.compall@daml.com>
2022-12-15 19:27:55 +00:00
pbatko-da
566b564f0b
[DPP-1022] ACS active_at_offset (#15764)
changelog_begin
Ledger API: Add active_at_offset to the GetActiveContractsRequest request
changelog_end
2022-12-15 18:10:33 +00:00
Stephen Compall
7472684625
ignore build-and-lint-test yarn.lock inconsistency on release (#15907)
With the below command, with or without the entry for
@types/prettier@2.6.0 removed, this command passes.

DAML_SDK_RELEASE_VERSION=0.0.0-head bazel test --test_output=streamed //language-support/ts/codegen/tests:build-and-lint-test

With the below command with the entry for @types/prettier@2.6.0 removed,
this command fails with the expected error about a missing entry.  With
the entry restored, it passes.

bazel test --test_output=streamed //language-support/ts/codegen/tests:build-and-lint-test
2022-12-15 17:46:53 +00:00
Gary Verhaegen
895a6bf11d
start 2.3.8 process (#15892)
As requested by @rgugliel-da on behalf of the Canton team.
2022-12-15 16:49:18 +01:00
Nicu Reut
c8c5eaa11f
Add metrics to execution services [PLEN-64] (#15861) 2022-12-15 15:34:25 +00:00
Remy
4135041a38
[Engine] compute agreement as part of contract caching (#15901) 2022-12-15 11:29:06 +00:00
katmurp
e47bca3569
Docs: Resource management - Latency/throughput, ACS size (#15854)
* resource management - ACS size

* adding throughput and latency section
2022-12-15 12:00:28 +01:00
azure-pipelines[bot]
564c8f09c0
bump canton to 20221214 (#15904)
Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2022-12-15 10:44:06 +00:00
azure-pipelines[bot]
4becc947a7
bump canton to 20221213 (#15886)
Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
Co-authored-by: Rafael Guglielmetti <rafael.guglielmetti@digitalasset.com>
Co-authored-by: Remy Haemmerle <Remy.Haemmerle@daml.com>
2022-12-15 09:25:54 +00:00
pbatko-da
3429cb543e
[DPP-1327] ETQ: Use transaction_meta table for pointwise tx retrieval and drop tx_id based indexes (#15877) 2022-12-14 20:12:24 +00:00
Stephen Compall
0dcd635eb8
enforced lockfile for build-and-lint-test (#14873)
* pin dependencies without #13876

* --frozen-lockfile does not work

* hide @daml.js local paths from yarn.lock comparison

This version on failure outputs something like

--- /dev/fd/63	2022-12-12 17:31:06
+++ /dev/fd/62	2022-12-12 17:31:06
@@ -708,6 +708,11 @@
   resolved "https://registry.yarnpkg.com/@types/node/-/node-12.20.55.tgz#c329cbd434c42164f846b909bd6f85b5537f6240"
   integrity sha512-J8xLz7q2OFulZ2cyGTLE1TbbZcjpno7FaN6zdJNrgAdrJ+DZzh/uFR6YrTb4C+nXakvud8Q4+rbhoIWlYQbUFQ==

+"@types/prettier@2.6.0":
+  version "2.6.0"
+  resolved "https://registry.yarnpkg.com/@types/prettier/-/prettier-2.6.0.tgz#efcbd41937f9ae7434c714ab698604822d890759"
+  integrity sha512-G/AdOadiZhnJp0jXCaBQU449W2h716OW/EoXeYkCytxKL06X1WCXB4DZpp8TpZ8eyIJVS1cw4lrlkkSYU21cDw==
+
 "@types/prettier@^2.1.5":
   version "2.7.0"
   resolved "https://registry.yarnpkg.com/@types/prettier/-/prettier-2.7.0.tgz#ea03e9f0376a4446f44797ca19d9c46c36e352dc"
FAIL: /.../build-and-lint-test.runfiles/com_github_digital_asset_daml/language-support/ts/codegen/tests/ts/yarn.lock could not satisfy /.../build-and-lint-test.runfiles/com_github_digital_asset_daml/language-support/ts/codegen/tests/ts/build-and-lint-test/package.json
FAIL: yarn.lock requires all of the above changes
FAIL: //language-support/ts/codegen/tests:build-and-lint-test ...

Applying this diff to yarn.lock causes the test to pass.

* apply yarn.lock update reported by diff

* add changelog

CHANGELOG_BEGIN
CHANGELOG_END

* don't hard-code diff location

- suggested by @garyverhaegen-da; thanks
2022-12-14 18:31:14 +00:00
Nicu Reut
fc5b0ebc96
Add platform enablement team as code owner to observability (#15893) 2022-12-14 18:03:48 +00:00
Gary Verhaegen
d6f762a49c
start 2.5.0 process (#15896) 2022-12-14 17:40:14 +01:00
azure-pipelines[bot]
51ef2913fc
update NOTICES file (#15888)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2022-12-14 17:29:59 +01:00
nickchapman-da
2df734e1ce
[engine] consortium primitives in LF (#15864) 2022-12-14 15:06:15 +00:00
azure-pipelines[bot]
0b4feb1bf4
rotate release duty after 2022-12-14 (#15887) 2022-12-14 14:22:41 +00:00
Remy
311f419842
LF: get rid of agreement text in ContractInst (#15818) 2022-12-14 10:39:29 +00:00
Sergey Kisel
a7a958a337
Simplification of errors within JWT, unit test (#15881) 2022-12-14 11:05:18 +01:00
Sergey Kisel
db7f629c9e
Add todos to support IdentityProviderAdmin in the Daml-Script (#15858)
* Add todos to support IdentityProviderAdmin in the Daml-Script

* update todo
2022-12-14 10:00:57 +00:00
Luc Bourlier
9279f610ca
Use counters for non-monotonic metric values (#15870)
Meters should never decrease. Counter can increase and decrease [PLEN-49]

CHANGELOG_BEGIN
CHANGELOG_END
2022-12-14 09:31:05 +01:00
Stefano Baghino
5ab3fd7cbe
Fix typos in methods (#15884) 2022-12-13 18:36:54 +00:00
dylant-da
445104a41b
Custom error / fix error for wrong expected return type of a choice. (#15855)
* Point to updated GHC

* add test for choice result mismatch

* add test for interface

* point to updated ghc

* point to merged ghc
2022-12-13 18:08:32 +00:00
Sergey Kisel
212955cc31
Add "iss" claim support for JWT tokens. (#15880) 2022-12-13 15:26:36 +01:00
dylant-da
f9d7301024
Fix erroneous code action/lens suggestions in Daml Studio (#15731)
* point to updated ghc

* point to updated GHC

* point to updated GHCIDE

* point to updated ghc

* Make _requires_ non-writable by inserting dollar - amend detectors

* Make _choice_ declarations non-writable (add dollar)

* Add checks for dollar-gen'd code require/view/interface_instance/method

* point to updated GHC

* point to updated ghc

* satisfy changelog

CHANGELOG_BEGIN
CHANGELOG_END

* point to updated GHC

* Point to updated ghcide

* update desugar tests

* point to revised daml-ghcide

* point to updated ghc

* point to updated ghc

* replace with isDamlGenerated

* point to merged ghc and merged ghcide
2022-12-13 12:06:40 +00:00
Claudio Bley
2acf719338
Refine "component" of asset field (#15833)
* Add "component" to `SecurityTest` entry for AbstractWebsocketServiceIntegrationTest

* Add README to test-evidence explaining the convention for components
2022-12-13 10:15:00 +01:00
Stephen Compall
1ac4199538
update qs, express for security (#15874)
- fixes for CVE-2022-24999

* upgrade qs, express in root

* upgrade qs in daml-extension

* upgrade qs, express in navigator
2022-12-12 15:52:19 -05:00
Sergey Kisel
a598171160
Expose non-local parties from within Default Identity Provider (#15872)
* Expose non-local parties from within Default Identity Provider
2022-12-12 19:54:19 +00:00
katmurp
b3efb02f32
removing no-context content (#15873) 2022-12-12 19:16:16 +01:00
tudor-da
98c22cf705
Adapt explicit disclosure conformance tests for Canton [DPP-1346] (#15809)
* Adapt conformance tests
* Multi-participant tests
* remove ledger-backend specific error code assertions

* Address Martino's review comments

* Use relative createdAt shift
2022-12-12 19:08:51 +01:00
Stefano Baghino
a0d520d3f7
Bump Protobuf (#15866)
Addresses CVE-2022-3171

Only an uptick in the patch version to minimize the impact
2022-12-12 18:02:21 +00:00
pbatko-da
263b579b32
[DPP-1327] Improve performance of transaction streaming by replacing the backend implementation (#15770)
The old queries for building the transactions streams based on querying event tables directly are replaced with a two step process where we first fetch event sequential ids that match the input constraints from multiple id filter tables, and then fetch events by those fetched ids.
This approach is analogous to we have been already streaming ACS.

changelog_begin
Ledger API Server: This change introduces new db metrics and retires some of the old ones. The exact breakdown should be provided in a follow-up PR.
changelog_end
2022-12-12 16:35:16 +01:00
Stefano Baghino
0c79f73019
Bump Jackson (#15863)
Address CVE-2022-42003 and CVE-2022-42004
2022-12-12 14:42:15 +00:00
Chun Lok Ling
f23f5d02af
13355 removed proxy* methods from RouteSetup (#15458)
* WIP

* do it on getuesr first

* remove old getUesr

* createUser

* createUser

* user post paths

* user post paths

* WIP

* removed routesetup from UserManagement

* refactor parties and allocateParty

* remove proxyWithCommand

* refactor PackagesAndDars

* remove proxyWithoutCommand

* refactor  PackagesAndDars

* merge from main

* move UploadDarFile implementation back to package and dars
2022-12-12 14:38:24 +00:00
Sergey Kisel
9875fd0ef9
Identity Provider Management: wording update (#15853) 2022-12-12 13:55:20 +01:00
Claudio Bley
c7aaa19c6e
Add attack/happyPath and asset information (#15732) 2022-12-12 09:43:30 +00:00
Nicu Reut
25f1254120
Move the metrics API to the observability module [PLEN-35] (#15831) 2022-12-12 09:35:55 +00:00
Marton Nagy
6d27505010
Drop gRPC server side custom codegen (#15763)
* Drop gRPC server side custom codegen

[CHANGELOG_BEGIN]
[CHANGELOG_END]

* Do not generate maven jar for ledger-api-akka and more cleanup

* Extract by-name source evaluation outside synchronized

* Addressed Martino's review comment

Co-authored-by: Tudor Voicu <tudor.voicu@digitalasset.com>
2022-12-12 08:35:56 +01:00
Miklos
393dda5578
Documented metrics for oauth2-middleware [PLEN-57] (#15838) 2022-12-09 14:31:19 +01:00
Raymond Roestenburg (Actually RayRoestenburg)
4db604cc6f
custom views inline examples update. (#15847) 2022-12-09 14:17:28 +01:00
azure-pipelines[bot]
fb8c4f5e7c
bump canton to 20221208 (#15845)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2022-12-09 12:22:01 +01:00
pbatko-da
fe92e52da7
[DPP-1327] Efficient Oracle ETQ data migration (#15843)
Previous version of etq_array_diff function proved to be vastly inefficient on a synthetic data set
resulting in "SQL Error: ORA-04036: PGA memory used by the instance exceeds PGA_AGGREGATE_LIMIT" error
after many minutes of processing. PGA_AGGREGATE_LIMIT was set to 2GB in that testing setup.

This new implementation of etq_array_diff completed the migration successfully in 03min 34s
which is comparable with the data migration for PostgreSQL. No evidence for excessive consumption
of memory was found ('select * from V$PGASTAT;').
2022-12-09 11:03:06 +00:00
Sergey Kisel
e880f26b36
Identity Provider Management exposed via API [DPP-1334] (#15774) 2022-12-09 10:25:14 +01:00
Gary Verhaegen
5748cd0b78
2.5.0-rc2 (#15841) 2022-12-09 02:22:01 +00:00
carrielaben-da
c16ab91a17
Adding H2 to high-level-intro.rst (#15842)
Adds an H2 immediately following the H1, which should hopefully correct the formatting issue with this page in the TOC

[CHANGELOG_BEGIN]
[CHANGELOG_END]

Co-authored-by: carrie-laben <91496516+carrie-laben@users.noreply.github.com>
2022-12-08 15:24:38 -05:00
Stefano Baghino
18ed316827
Accept uppercase English alphabet letters in user IDs (#15832)
* Accept uppercase English alphabet letters in user IDs

changelog_begin
Accept uppercase English alphabet letters in user IDs
changelog_end

* Fix title case in docs change

Co-authored-by: Sergey Kisel <98825453+skisel-da@users.noreply.github.com>

Co-authored-by: Sergey Kisel <98825453+skisel-da@users.noreply.github.com>
2022-12-08 16:44:54 +00:00
pbatko-da
89d571a87b
[DPP-1327] Data migration and ingestion for new transactions related tables (#15703) 2022-12-08 13:56:26 +00:00