Commit Graph

11095 Commits

Author SHA1 Message Date
Gary Verhaegen
8782207d1a
docs: improve wording of Numeric n description (#15805) 2022-12-06 13:14:16 +00:00
azure-pipelines[bot]
c9708cb320
update NOTICES file (#15802)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2022-12-06 13:06:19 +01:00
Nicu Reut
644009feac
Fix async gauges usages by returning only the value [PLEN-61] (#15793) 2022-12-06 09:26:05 +01:00
azure-pipelines[bot]
dd87d74d21
bump canton to 20221205 (#15801)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2022-12-06 07:58:45 +00:00
Stephen Compall
c24c17d595
Javascript library security updates (#15798)
Incorporates fixes for

- CVE-2022-3517
- CVE-2022-37599
- CVE-2022-37601

* update minimatch in root
* update minimatch in daml-extension
* update minimatch in typescript libraries
* update minimatch and loader-utils in navigator
2022-12-05 12:40:46 -05:00
Luc Bourlier
becbd8d02d
Adds metrics support to the OAuth2 middleware [PLEN-58] (#15742)
* Adds metrics support to the OAuth2 middleware

Basic metrics + HTTP endpoint metrics

CHANGELOG_BEGIN

* OAuth2 middleware Service - basic and HTTP endpoint metrics

CHANGELOG_END

* Expose oauth2-middleware metrics with the right component name.

* Moved TriggerServiceMetrics to under right source dir.

Co-authored-by: Miklos Erdelyi <miklos.erdelyi@digitalasset.com>
2022-12-05 14:56:06 +01:00
pbatko-da
a2e9901c38
[DPP-1356] Fix not logging some exceptions from streaming endpoints (B) (#15765)
changelog_begin:
Ledger API:
Previously non-error-code exceptions coming from streaming endpoints but thrown outside of Akka streams were not logged, and reported to clients with gRPC status UNKNOWN. Now they are logged on the server side and reported to clients as errors with LEDGER_API_INTERNAL_ERROR error code
changelog_end
2022-12-05 12:27:37 +00:00
pbatko-da
d2ca14e972
[DPP-1327] Restore transaction_id indexes on PG that were accidentally removed (#15769) 2022-12-05 11:50:13 +01:00
Claudio Bley
48b9bb0aa8
Replace duplicate Security properties (#15777)
- `Authenticity` instead `Authentication`
- `Privacy` instead `Confidentiality`
2022-12-05 10:44:11 +00:00
azure-pipelines[bot]
40362a6dad
update NOTICES file (#15776)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2022-12-05 11:26:17 +01:00
azure-pipelines[bot]
f18355a434
bump canton to 20221202 (#15771)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2022-12-05 08:20:17 +01:00
tudor-da
b4b1f6c7d9
Engine outputs interpreted disclosed contract metadata [DPP-1323] (#15751)
* Engine outputs interpreted disclosed contract metadata

* Addressed Remy's review comments
2022-12-04 20:11:53 +01:00
Sergey Kisel
1c6f6a748b
IdentityProviderId support for the persistence layer of user/party management [DPP-1332] (#15716) 2022-12-02 16:12:04 +01:00
Ratko Veprek
e9c2c92676
Updated cheat sheet dependency, fixing a minor typo (#15726) 2022-12-01 19:11:27 +00:00
Gary Verhaegen
e56964b589
2.5.0-rc1 take 2 (#15762) 2022-12-01 16:28:09 +00:00
pbatko-da
695d680bd0
Temporary fix for a flaky benchtool test (#15761) 2022-12-01 16:28:11 +01:00
pbatko-da
a3985d697c
[DPP-1327] Add new tables for efficient transaction queries (without data migration) (#15701) 2022-12-01 16:18:27 +01:00
Matthias Schmalz
44dc483387
Revised test cases for authorization and added security annotations. (#15759)
CHANGELOG_BEGIN
CHANGELOG_END
2022-12-01 15:14:54 +00:00
Moisés Ackerman
6bafad6b20
Fix dlint hints for DA.{Action=>Functor}.void (#15746) 2022-12-01 16:06:33 +01:00
Matthias Schmalz
eb59830a7b
Added a flag checkAuthorization to EngineConfig that allows clients to disable the authorization checks (for security testing). (#15748)
Generalized `object CheckAuthorization` to `trait AuthorizationChecker` which now gets injected into `PartialTransaction`.
2022-12-01 12:05:10 +00:00
azure-pipelines[bot]
fbf3cc9bfa
bump canton to 20221130 (#15753)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2022-12-01 10:43:13 +01:00
azure-pipelines[bot]
2890ba0c99
update NOTICES file (#15754)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2022-12-01 10:42:11 +01:00
carrielaben-da
0c80d346df
Delete tools.rst (#15752)
Removing the "Developer Tools" TOC, which is not used in the new 2.5 TOC
2022-12-01 10:41:23 +01:00
Johan Sjödin
ae0d08b3cd
daml-finance: update quickstarter (#15755) 2022-12-01 09:39:09 +00:00
Moisés Ackerman
ccb1df08a7
Use daml-base-anchors.json when '--input-anchor' unspecified (#15715)
* Use default anchors for daml-prim and daml-stdlib when building docs

This PR introduces two flags for subcommand 'daml docs':

* '--default-input-anchor' to use the default anchors defined by //compiler/damlc:daml-base-anchors.json. This is the default if neither '--input-anchor=PATH' nor '--no-input-anchor' are passed.
* '--no-input-anchor' to use an empty anchor map. This is used to build //compiler/damlc:daml-base-anchors.json, since it cannot depend on itself.

* break cyclic dependency
2022-12-01 10:08:07 +01:00
Moisés Ackerman
badfb9dcea
Improve error message for attempted use of '..' in record update (#15712)
* Update GHC_REV

* Add test case
2022-12-01 10:07:29 +01:00
Claudio Bley
1cb6bc63f9
Only warn about errors loading test suites by default (#15743)
It turned out that throwing an exception is too strict for the downstream Canton project
which currently fails on CI caused by errors in a number of test suites.

Until they have adapted (see https://github.com/DACH-NY/canton/issues/11083) we only warn about
the errors by default.

For this project we ensure that warnings are fatal.
2022-12-01 09:28:56 +01:00
Gary Verhaegen
69eb85ae62
hackfix compatibility tests (#15747) 2022-11-30 22:10:56 +01:00
Lois Kilberg
989142a0db
fix numbered lists (#15730)
Added blank lines in two places before numbered lists so that they will be recognized as lists.

[CHANGELOG_BEGIN]
[CHANGELOG_END]
2022-11-30 14:21:13 -05:00
katmurp
9522017c98
fixing a few 404s (#15684)
* fixing a few 404s

* redoing links to be relative

* Update command-deduplication.rst

Removing broken link.

* removing the line
2022-11-30 18:51:44 +01:00
Gary Verhaegen
5c8ae8c089
starting 2.5.0-rc1 process (#15740) 2022-11-30 15:50:11 +00:00
Gary Verhaegen
3a46ad860b
bump nightly (#15741) 2022-11-30 16:00:12 +01:00
Luc Bourlier
2e98f29189
Adds description to the HTTP and gRPC endpoint metrics [PLEN-40] (#15711)
* Adds description to the HTTP and gRPC endpoint metrics

CHANGELOG_BEGIN
CHANGELOG_END

* Apply suggestions from code review

* added missing descriptions for gRPC metrics

Co-authored-by: Miklos <57664299+miklos-da@users.noreply.github.com>
2022-11-30 14:04:53 +01:00
Gary Verhaegen
2a796c412c
remove dead code (#15739)
Follow-up on #15373.
2022-11-30 12:06:46 +00:00
azure-pipelines[bot]
3daa60f9d1
bump canton to 20221129 (#15735)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2022-11-30 11:46:56 +01:00
Miklos
d867747b57
Document HTTP-JSON APIs [PLEN-57] (#15660) 2022-11-30 10:37:04 +00:00
Gary Verhaegen
5d693d88e1
remove toc in writing-daml (#15723) 2022-11-30 10:33:57 +00:00
pbatko-da
78d44246ac
[DPP-1327] Speeding up completions streaming (#15696)
Changes:
1. Swap the DB index order to facilitate filtration by application ids
2. Filter parties in JVM
3. Fetch results from the DB in a paged fashion
2022-11-30 10:30:04 +00:00
Gary Verhaegen
f3363c312e
fix blackduck (#15728) 2022-11-30 10:09:47 +00:00
Raymond Roestenburg (Actually RayRoestenburg)
4a554ac28e
Fixes from review in #15721. (#15729) 2022-11-29 20:55:28 +01:00
Chun Lok Ling
936513119c
Add yarn lock file for build-and-lint-test (#15727)
* add yarn lock file

* file--frozen-lockfile

* add change log

CHANGELOG_BEGIN
CHANGELOG_END

* pure-lockfile

* remove pure lock-file
2022-11-29 17:31:48 +00:00
dylant-da
05d9ee89f3
Improve interpretation error consistency (#15680)
* Add custom viewtype mismatch error

* Modify error message on EViewTypeMismatch to be like GHC error

* Make EUnknownMethodInInterfaceInstance error consistent w/ GHC

* Add MethodTypeMismatch error, sync with GHC error

* Prefix fields in new errors

* Intercept type mismatch in method to throw EMethodTypeMismatch

* Synchronize EUnknownField with GHC-side message

* Complete synchronizing EUnknownField with GHC-side error message

* satisfy lint and changelog check

CHANGELOG_BEGIN
CHANGELOG_END

* lint

* Fix TypingSpec for new EMethodTypeMismatch

* lint

* lint again

* EFieldTypeMismatch error for ERecUpd/ERecProj mismatch, like in GHC

* lint
2022-11-29 13:02:46 +00:00
Chun Lok Ling
60e5aaa259
Apply package prefix only on main package of the Dar and unique package. (#15448)
* add ambiguous prefix check on package which is used to generate code.

* add test case

* Update test description

Co-authored-by: Raymond Roestenburg <98821776+ray-roestenburg-da@users.noreply.github.com>

* pre prefix

* per prefix

* modify test

* lower case

* rollback per prefix code gen

* rollback per prefix code gen

* apply prefixes on unique and main package only

* fix

* move

* rename

* test same main package with different prefixes

* added test case for 2 dar files with same main package but different prefixes

* added test case for dar files with data dependencies

* add a unique package

* fixed CI

* address comment

Co-authored-by: fayi-da <112705750+fayi-da@users.noreply.github.com>
Co-authored-by: Raymond Roestenburg <98821776+ray-roestenburg-da@users.noreply.github.com>
2022-11-29 11:44:59 +00:00
Claudio Bley
e766f91338
Generate CSV file from all test evidences for ledger client components (#15372)
* Add new security categories

* Use test-security framework for OAuth2 middleware

* Regenerate `security-evidence.md`

* Explicitely exit the test-evidence generator

* Use test-security framework for HTTP JSON

* Regenerate `security-evidence.md`

* Add //ledger-service/http-json:integration-tests-lib to evidence generator

* Skip maven artefacts on the classpath

The checker framework artefact (`checker-2.5.4.jar`) causes an `IllegalAccessError` when included in the runpath:
```
Exception in thread "main" java.lang.IllegalAccessError: class com.sun.tools.javac.code.Scope$ImportScope$ImportEntry cannot access its superclass com.sun.tools.javac.code.Scope$Entry (com.sun.tools.javac.code.Scope$ImportScope$ImportEntry is in unnamed module of loader java.net.URLClassLoader @31000e60; com.sun.tools.javac.code.Scope$Entry is in module jdk.compiler of loader app)
	at java.base/java.lang.ClassLoader.defineClass1(Native Method)
	at java.base/java.lang.ClassLoader.defineClass(ClassLoader.java:1017)
	at java.base/java.security.SecureClassLoader.defineClass(SecureClassLoader.java:174)
	at java.base/java.net.URLClassLoader.defineClass(URLClassLoader.java:550)
	at java.base/java.net.URLClassLoader$1.run(URLClassLoader.java:458)
	at java.base/java.net.URLClassLoader$1.run(URLClassLoader.java:452)
	at java.base/java.security.AccessController.doPrivileged(Native Method)
	at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:451)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
	at org.scalatest.tools.SuiteDiscoveryHelper$.isDiscoverableSuite(SuiteDiscoveryHelper.scala:204)
	at org.scalatest.tools.SuiteDiscoveryHelper$.processClassName(SuiteDiscoveryHelper.scala:243)
	at org.scalatest.tools.SuiteDiscoveryHelper$.$anonfun$processFileNames$1(SuiteDiscoveryHelper.scala:279)
	at scala.collection.Iterator$$anon$9.next(Iterator.scala:577)
	at scala.collection.Iterator$$anon$6.hasNext(Iterator.scala:474)
	at scala.collection.Iterator$$anon$9.hasNext(Iterator.scala:576)
	at scala.collection.immutable.List.prependedAll(List.scala:152)
	at scala.collection.immutable.List$.from(List.scala:684)
	at scala.collection.immutable.List$.from(List.scala:681)
	at scala.collection.IterableFactory$Delegate.from(Factory.scala:288)
	at scala.collection.immutable.Iterable$.from(Iterable.scala:35)
	at scala.collection.immutable.Iterable$.from(Iterable.scala:32)
	at scala.collection.IterableFactory$Delegate.from(Factory.scala:288)
	at scala.collection.IterableOnceExtensionMethods$.toIterable$extension(IterableOnce.scala:178)
	at org.scalatest.tools.SuiteDiscoveryHelper$.processFileNames(SuiteDiscoveryHelper.scala:285)
	at org.scalatest.tools.SuiteDiscoveryHelper$.$anonfun$discoverSuiteNames$1(SuiteDiscoveryHelper.scala:132)
	at scala.collection.immutable.List.map(List.scala:250)
```

* Regenerate `security-evidence.md`

* Convert remaining TEST_EVIDENCE stanzas of HTTP JSON

* Regenerate `security-evidence.md`

* Use test-security framework for HTTP JSON

* Regenerate `security-evidence.md`

* Print warning when a test suite could not be loaded

* Fix typo

* Use test-security framework for HTTP JSON

* Read files in tests lazily

The test-evidence generator tool needs to instantiate scalatest test suites in order
to access the tagged tests and collect relavant test entries.

* Use test-security framework for HTTP JSON

* Regenerate `security-evidence.md`

* Regenerate `security-evidence.md`

* Use test-security framework for HTTP JSON

* Regenerate `security-evidence.md`

* Use test-security framework for HTTP JSON

* Regenerate `security-evidence.md`

* Use test-security framework for HTTP JSON

* Regenerate `security-evidence.md`

* Use test-security framework for trigger service

* Use structural type to call `in` and `ignore` for different classes

* Remove Authentication category from EvidenceSecurity tool

There are no TEST_EVIDENCE annotations anymore.

* Add required trigger-runner-lib


* Import `scala.language.reflectiveCalls` where it is needed

* Remove left-over comments

* Add `test_evidence_binary` scala binary rule

This rule is a customized `scala_binary` rule which also accepts a `tests` attr and
generates a runpath file which is later consumed by scalatest to detect the relevant
scalatest test suites.

* Process test suites, add transitive deps

* Support nested tests_suites in `test_evidence_binary`

* Remove debug print's

* Add missing dependencies to test-evidence:generator

* Abort if test suites cannot be loaded

* Cleanup

* Reinstate scalacopts in http-json

* Reword the test description to not drop information

* Fix typo

* Explicitly exit the JVM on exceptions

This is required since non-daemon threads also prevent JVM shutdown when an exception was thrown.

* Format test-evidence/BUILD.bazel

* Resolve file paths lazily

This avoids a `NullPointerException` on Windows where Runfiles.rlocation returns `null`.

* Document new Security properties

* Print target directory and file name

* Clarify test descriptions

* Replace duplicate Security properties

Co-authored-by: Stephen Compall <stephen.compall@daml.com>Co-authored-by: Stephen Compall <stephen.compall@daml.com>
2022-11-29 12:35:22 +01:00
azure-pipelines[bot]
bd09bc08db
bump canton to 20221128 (#15722)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2022-11-29 11:19:34 +01:00
Raymond Roestenburg (Actually RayRoestenburg)
272e50acdd
Initial custom views documentation. (#15721)
* Initial custom views documentation.

* Update docs/source/app-dev/custom-views/index.rst

Co-authored-by: Stephen Compall <stephen.compall@daml.com>

* Update docs/source/app-dev/custom-views/index.rst

Co-authored-by: Stephen Compall <stephen.compall@daml.com>

* Minor change for closer rendering of ``Batch``es.

Co-authored-by: Stephen Compall <stephen.compall@daml.com>
2022-11-28 21:23:55 +00:00
Gary Verhaegen
f6a5838039
docs: remove redundant toc (#15718) 2022-11-28 20:08:29 +01:00
Gary Verhaegen
76d65f51ea
fix node 18 again (other issue) (#15717)
It looks like, at least on some machnes, recent Node versions will not
resove localhost to 127.0.0.1 anymore.

There wasn't really a good reason for us going through DNS resolution
for these anyway, so here's a simple fix. Hopefully.
2022-11-28 20:04:33 +01:00
mziolekda
4c1600a6e6
bump ledger api version to 2.2 (#15713)
* bump ledger api version to 2.2

* Update document link
2022-11-28 17:20:45 +01:00
tudor-da
5bef9d81c6
Update missing Optional/Required proto docs for Commands/CreatedEvent (#15710)
changelog_begin
changelog_end
2022-11-28 14:03:27 +01:00