Commit Graph

8759 Commits

Author SHA1 Message Date
Gary Verhaegen
d2e2c21684
update copyright headers (#12240)
New year, new copyright, new expected unknown issues with various files
that won't be covered by the script and/or will be but shouldn't change.

I'll do the details on Jan 1, but would appreciate this being
preapproved so I can actually get it merged by then.

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-03 16:36:51 +00:00
azure-pipelines[bot]
2546af359c
rotate release duty after 2.0.0-snapshot.20211214.8692.0.63940872 (#12148)
@cocreature is taking care of 2.0.0-snapshot.20211214.8692.0.63940872 (#12147), so they get pushed back to the end of the line.

Please do not merge this before #12147.

CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines Daml Build <support@digitalasset.com>
2022-01-03 16:16:11 +01:00
Gary Verhaegen
0e30d468f9
expand CI cluster back (#12239)
To be done / merged on Jan 3.

CHANGELOG_BEGIN
CHANGELOG_END
2022-01-03 14:50:08 +00:00
azure-pipelines[bot]
d6d473db67
update NOTICES file (#12247)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2022-01-01 14:21:16 +01:00
Gary Verhaegen
a51f75d193
give a break to CI (#12238)
I can't think of a good reason to keep 30+ machines running over the
Winter break. I'll bump this back up on Jan 3.

CHANGELOG_BEGIN
CHANGELOG_END
2021-12-26 10:53:08 +01:00
azure-pipelines[bot]
4cc4b3baf4
update compat versions for 1.18.0 (#12068)
CHANGELOG_BEGIN
CHANGELOG_END

run-full-compat: true
2021-12-24 18:06:04 +01:00
Robert Autenrieth
2141bfbea5
DPP-769 cap internal state (#12135)
* Limit max queue size

changelog_begin
changelog_end

* fix typo

* Make id queue limit configurable
2021-12-23 21:00:44 +01:00
Hubert Slojewski
e1b4c30132
daml-lf / kvutils: Move Daml-LF proto conversions into kv-support [KVL-1168] (#12216)
CHANGELOG_BEGIN
CHANGELOG_END
2021-12-22 15:11:22 +01:00
azure-pipelines[bot]
51a1f47b43
update NOTICES file (#12232)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-12-22 07:08:21 +00:00
Simon Maxen
8f43c034ec
Add transaction statistics to completion info (#12224)
* Add transaction statistics to completion info

changelog_begin
changelog_end

* reformat
2021-12-21 23:27:30 +00:00
Brian Healey
dc6fdaaca9
revert back to running latest blackduck detect 6.9.0 (#12177)
* revert back to running latest blackduck detect 6.9.0

CHANGELOG_BEGIN
CHANGELOG_END

run-full-compat: true

* revert back to running latest blackduck detect 6.9.0

CHANGELOG_BEGIN
CHANGELOG_END

run-full-compat: true

* try increasing heap

10gb heap for blackduck scan

run-full-compat: true

* exclude bazel-out

run-full-compat: true

* separate blackduck scan stages
no signature or binary scan

run-full-compat: true

* exclude result- directories

run-full-compat: true

* do not follow symbolic links

run-full-compat: true

* exclude node rules

run-full-compat: true

* exclude node rules

    run-full-compat: true

* do not follow symbolic links for detector runs

run-full-compat: true

* yarn install language-support

run-full-compat: true

* exclude ts dirs

run-full-compat: true

* exclusions

run-full-compat: true

* all dirs

run-full-compat: true

* add go executable

run-full-compat: true

* no need for sig scan properties in go detector scan

run-full-compat: true

* Fixes # 6419 remove not-main for testing

* Update ci/cron/daily-compat.yml

Co-authored-by: Moritz Kiefer <moritz.kiefer@purelyfunctional.org>

* Update ci/cron/daily-compat.yml

Co-authored-by: Moritz Kiefer <moritz.kiefer@purelyfunctional.org>

Co-authored-by: Moritz Kiefer <moritz.kiefer@purelyfunctional.org>
2021-12-21 18:08:42 +00:00
Sofia Faro
994b2317a1
Add a test for daml start --sandbox-canton (#12223)
Part of #11831

changelog_begin
changelog_end
2021-12-21 17:14:32 +00:00
nicu-da
9102b0919a
[ledger-api-test-tool] - add participant deduplication feature descriptor [kvl-1218] (#12213) 2021-12-21 15:56:41 +00:00
Moritz Kiefer
f847767e36
Avoid nix result-* symlinks on CI (#12220)
We really don’t want those anywhere and they currently trip up
blackduck which starts scanning our nix store.

changelog_begin
changelog_end
2021-12-21 07:59:02 -05:00
Sofia Faro
830497ae34
Add --sandbox-canton option in daml start (#12192)
* --sandbox-canton option for daml start

changelog_begin
changelog_end

* hlint

* Move getFreePort to da-hs-base

* Use flag' not switch
2021-12-21 12:39:11 +00:00
Robert Autenrieth
d922a562a8
DPP-752 refactor event strategy (#12008)
* Reset string interning between tests

* Add StorageBackendEvents tests

* Extend LedgerDao ACS tests

* Remove dead code

changelog_begin
changelog_end

* Refactor EventStrategy

changelog_begin
changelog_end

* Remove dead code

* Refactor filterPartiesClause

* Avoid materializing a collection

* remove interning from arrayIntersectionNonEmptyClause

* Fix internedAllParties

* Add test for filtering witnesses

* Handle empty readers

* Add note about resetting string interning state

* Throw exceptions on unexpected empty input
2021-12-21 09:32:26 +01:00
Moisés Ackerman
ba0c6c9841
Set --enable-scenarios to False by default (#12156)
* Set --enable-scenarios to False by default

changelog_begin
changelog_end

* Enable scenarios for shake test

* Add --enable-scenarios=yes for //compiler/lsp-tests

* Add enable_scenarios arg to rules_daml/daml.bzl helpers

* daml_compile
* daml_build_test
* daml_test

* Add enable_scenarios to ledger/test-common helper da_scala_dar_resources_library

* Add --enable-scenarios=yes for //ledger/test-common

* Remove unused scenario in //ledger/test-common PingPong test

* Add --enable-scenarios=yes for //daml-lf/tests

* Add --enable-scenarios=yes for //language-support/java tests

* Add --enable-scenarios=yes for group-chat example

* Add --enable-scenarios for //ledger/sandbox-perf LargeTransaction test

* Add --enable-scenarios=yes for //docs tests

* Add --enable-scenarios=yes for //daml-lf/scenario-interpreter tests

* format bazel

* Add --enable-scenario=yes for 'daml_doc_test's

* Add --enable-scenarios=yes for DamlDocTestIntegration

* Add --enable-scenarios=yes for DamlcTest

* Add --enable-scenarios=yes for Test/DataDependencies

* Add --enable-scenarios=yes for daml-ghc-deterministic.sh

* Add --enable-scenarios=yes for Test.IncrementalBuilds

* Add --enable-scenarios=yes for tests:memory-bond-trading and tests:memory-examples

* Add --enable-scenarios=yes for daml-assistant/integratio-tests
2021-12-20 19:31:06 +01:00
Hubert Slojewski
56baf036b7
Rename kv-transaction-support library [KVL-1168] (#12212)
CHANGELOG_BEGIN
CHANGELOG_END
2021-12-20 16:33:36 +01:00
nicu-da
5b142eba63
[ledger-api-test-tool] - use offset support feature descriptor [kvl-1218] (#12211) 2021-12-20 06:53:39 -08:00
Moritz Kiefer
0142c6a34e
Add forM_ compat definition (#12209)
I keep confusing myself because of this and I expect I’m not the only
one. We have this for forM already so this only seems natural.

The definition is in DA.Foldable rather than DA.Internal.Compatible
since it doesn’t make sense to have it imported when you don’t import forA_.

changelog_begin
changelog_end
2021-12-20 13:45:28 +00:00
Moritz Kiefer
99f9776dd4
New split release for docs tests (#12186)
Release using the split release process so I can test the docs changes
I made.

changelog_begin
changelog_end
2021-12-20 13:44:04 +00:00
nicu-da
e182fc5026
[ledger-api] - Move deduplication duration validation into the KV WriteService (#12151)
changelog_begin
ledger-api - Remove validation for duration deduplication periods, which was validating that the deduplication duration is smaller than the max deduplication duration. This is now up to the ledger to enforce.
changelog_end
2021-12-20 05:33:46 -08:00
nicu-da
53d55784a4
[ledger-api] - Add command deduplication features as a feature descriptor [KVL-1218] (#12181)
changelog_begin
changelog_end
2021-12-20 04:33:58 -08:00
Moritz Kiefer
040f1a933f
Release attempt over 9000 (#12206)
https://www.youtube.com/watch?v=dQw4w9WgXcQ

changelog_begin
changelog_end
2021-12-20 11:23:00 +00:00
Moritz Kiefer
606a8ef08e
Drop code to upload to com.digitalasset (#12203)
We didn’t have any artifacts there since SDK 1.0 and we’re not
planning to add any. We suspect that the permission denied errors
might come from the fact that we need a different profile id for that
and while we don’t use the repo to upload anything we still create the
staging repo so this might fix that issue.

changelog_begin
changelog_end
2021-12-20 10:16:53 +01:00
Moritz Kiefer
6d6a91189a
Fix target name of non-sphinx tarball (#12205)
We reference that in copy-unix-release-artifacts.sh so the name
actually matters.

changelog_begin
changelog_end
2021-12-20 08:50:38 +00:00
Moritz Kiefer
f057765cd2
Snapshot release attempt (#12201)
I don’t even know which attempt this is anymore.

changelog_begin
changelog_end
2021-12-18 13:29:48 +00:00
Victor Peter Rouven Müller
c5de61ae9e
[JSON-API] Also accept user tokens as auth source (#12075)
* WIP

* Remove the dummy implementation and replace it with an actual working implementation

* Make it compile!

* Add working tests for the user management support in the json api

CHANGELOG_BEGIN

- [JSON-API] Added basic support for the new user management feature of the ledger such that user tokens are now accepted instead of the legacy tokens

CHANGELOG_END

* Simplify the create iou test case and adjust the test case name to be correct

* Add additional test that covers that the overwrite of actAs&readAs still works via the meta object

* Make it work with unauthenticated ledgers too

* Fix compile error & wrong behaviour & add test coverage for non auth ledgers

* Clean up the diff

* Address 66312e9940 (r770782884)

* Address 66312e9940 (r770750653)

* Addressing 66312e9940 (r770751958)

* Address 66312e9940 (r770736671)

* Address 66312e9940 (r770734395) and 66312e9940 (r770783237)

Co-authored-by: Stefano Baghino <stefano.baghino@digitalasset.com>
2021-12-18 12:54:12 +00:00
azure-pipelines[bot]
9b3645fb26
update NOTICES file (#12199)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-12-18 13:09:00 +01:00
Moritz Kiefer
5de5eb06d8
Update Maven profile id (#12200)
Apparently the profile id changed with the switch to the new host.

changelog_begin
changelog_end
2021-12-18 12:18:12 +01:00
nicu-da
453fd64d05
[ledger-api-test-tool] - Add ability to disable tests based on ledger features [kvl-1218] (#12185)
changelog_begin
changelog_end
2021-12-17 12:15:38 -08:00
Stefano Baghino
2a71b69cef
Minor fixes to issue templates (#12195)
1. Using Markdown headers for sections instead of bold font
2. Removing myself as a default assignee -- I am already subscribed to the firehose and there is nothing to gain for anyone from this

changelog_begin
changelog_end
2021-12-17 17:07:32 +00:00
Moritz Kiefer
0c9683183c
Support user management in standalone trigger runner (#12190)
* Support user management in standalone trigger runner

This PR adds a `--ledger-user` option to the trigger runner which runs
the trigger as the primary party of the user and with all readAs
claims available to the user.

fixes #12025

changelog_begin

- [Daml Trigger] `daml trigger` now accepts a `--ledger-user` option
  which can be used instead of specifying the primary party and all
  other parties the user has claims to as ``-ledger-party` and
  ``-ledger-readas`.

changelog_end

* .

changelog_begin
changelog_end
2021-12-17 16:45:16 +00:00
Simon Maxen
51b9405f5c
TransactionNodesStatistics.stats to return case class of same name (#12159)
* TransactionNodesStatistics.stats now returns case class of same name

changelog_begin
changelog_end

* Rename TransactionNodesStats to Detail and make inner class

* Rename TransactionNodesStatistics.stats to apply

* Rename TransactionNodesStatistics to TransactionNodeStatistics

* Reformat

* Remove rollback from statistic action count

* Update with review comments

* Update with review comments
2021-12-17 15:27:53 +00:00
Hubert Slojewski
0a2c207e93
kvutils: Create our Identifier message and remove references to Daml-LF one [KVL-1167] (#12189)
CHANGELOG_BEGIN
CHANGELOG_END
2021-12-17 15:54:56 +01:00
Stefano Baghino
52110e31a3
Remove Extractor (#12188)
* Remove Extractor

Extractor is being removed after a long time being in Labs status.

This should improve the flakiness on CI.

🔥

changelog_begin
Extractor has been removed from the SDK
changelog_end

* Remove Extractor documentation

* Remove Extractor from CODEOWNERS

* Remove Extractor references in Daml-LF build files

* Remove Extractor references in the Daml SDK assistant

* Remove Extractor from the SDK

* Remove Extractor reference from CONTRIBUTING.md
2021-12-17 13:43:23 +00:00
Hubert Slojewski
c4b5de609a
kvutils: Remove references to Daml-LF Archive from kvutils protos [KVL-1167] (#12168)
CHANGELOG_BEGIN
CHANGELOG_END
2021-12-17 13:24:46 +01:00
Moritz Kiefer
1329fde631
Release another 2.0 snapshot (#12182)
This time with the new maven host.

changelog_begin
changelog_end
2021-12-17 11:42:25 +00:00
Moritz Kiefer
5f688dd704
Cache localContract calls in contractKeyInputs (#12183)
changelog_begin
changelog_end
2021-12-17 11:37:24 +00:00
Moritz Kiefer
adb1f0e716
Split up docs postprocessing & release in split-release (#12176)
* Split up docs postprocessing & release in split-release

Follow up to #12172

The buld in the separate assembly should now only have to run the
sphinx-build step and then merge it with the non sphinx sources and
run lualatex on the pdf sources with the pdf fonts which is hopefully
simple enough that we can easily replicate it.

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end
2021-12-17 11:22:16 +01:00
nicu-da
2ba3d60947
Add conversions for CompletionStage to Future which unwraps failures (#12165)
changelog_begin
changelog_end
2021-12-17 09:34:20 +00:00
Moritz Kiefer
d230cc88f6
Switch to new sonatype host (#12179)
They migrated our account so hopefully this should work without any
other changes and fix our publishing issues.

I’m keeping the long timeout for now since I don’t know what an
appropriate timeout is.

changelog_begin
changelog_end
2021-12-17 09:19:02 +01:00
tudor-da
ea7d49d4d9
Implement Sandbox-on-X runner [DPP-823] (#12150)
* Implement Sandbox-on-X runner

CHANGELOG_BEGIN
CHANGELOG_END

* Address Marton's comments

* Extracted AkkaSubmissionsBridge

* Addressed second round of review comments
2021-12-17 07:38:16 +00:00
Sergey Kisel
4c8be783b2
use domain.Offset instead of String in ContractsFetch functions (#12160)
* Initial commit

CHANGELOG_BEGIN
CHANGELOG_END

* formatting fix

* fix up graph DSL whitespace

Co-authored-by: Stephen Compall <stephen.compall@daml.com>
2021-12-16 18:14:39 +00:00
Stefano Baghino
42adfdc857
Get rid of deprecated components (#12167)
* Get rid of deprecated components

Removes:
- mentions of the Node.js bindings
- mentions of the Scala bindings
- usage of the Scala codegen as an SDK tool
- Java bindings "reactive components"

changelog_begin
The Node.js bindings are no longer supported as part of the Daml SDK
The Scala bindings are no longer supported as part of the Daml SDK
The Java bindings reactive components are no longer supported as part of the Daml SDK
The `daml codegen` command has dropped support for Scala
changelog_end

* Fix typo noticed by @cocreature

Co-authored-by: Moritz Kiefer <moritz.kiefer@purelyfunctional.org>

* Address https://github.com/digital-asset/daml/pull/12167#issuecomment-995714093

* Remove quickstart-scala from the SDK tarballs

* Fix failing codegen test

* Address https://github.com/digital-asset/daml/pull/12167#pullrequestreview-833991243

Co-authored-by: Moritz Kiefer <moritz.kiefer@purelyfunctional.org>
2021-12-16 16:55:19 +00:00
Remy
7ecc12645e
LF: make Struct lookup logarithmic (#12170)
CHANGELOG_BEGIN
CHANGELOG_END
2021-12-16 16:48:45 +00:00
akshayshirahatti-da
4745768ad4
[Oauth2-Middleware] Changes to introduce HOCON+pureconfig for oauth2-middleware (#12061)
* Changes to introduce HOCON+pureconfig for oauth2-middleware

CHANGELOG_BEGIN
CHANGELOG_END

* remove Cli arg parsing code + cleanup based on code review

* addition of a minimal config and changes to README.md

* keep existing cli args, but load from config file if provided

* fix broken docs build

* make tests OS independent

* Fail/error on supplying both config file and cli opts for startup, address code review comments
2021-12-16 16:36:32 +00:00
Sofia Faro
e52469c1dc
Add a test that mkMethod call causes a type error. (#12175)
Relevant discussion: https://github.com/digital-asset/daml/pull/12171#discussion_r770553009

changelog_begin
changelog_end
2021-12-16 15:52:44 +00:00
Moritz Kiefer
97e3a1a557
Refactor docs build (#12172)
* Refactor docs build

This is in preparation for the split docs build where we publish our
sphinx sources here and then build the final docs combined with the
Canton docs in the assembly repo.

Apologies for the messy diff. The idea here is the following:

1. We bundle together all files used as sphinx inputs in
sphinx-source-tree. This will be what we publish.
2. We factor out the calls to sphinx-build for the pdf and html
build to be as generic as possible and share the code.
3. The existing rules for the html build & pdf docs don’t invoke
sphinx anymore and instead only keep the postprocessing (copying other
html files or calling lualatex).

In a followup PR I’ll also simplify the postprocessing steps and then
finally publish those artifacts as part of our build.

changelog_begin
changelog_end

* fmt

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end

* .

changelog_begin
changelog_end
2021-12-16 15:37:21 +00:00
Sofia Faro
8b05a533ce
Refactor daml start options, add true/false to yes/no/auto flags. (#12169)
* Refactor daml start & add true/false to yesNoAuto.

- Refactor the way we pass arguments to daml start. We were relying on
  positional arguments with newtypes, but this is super cumbersome. I
  changed it to a RecordWildCards-style approach, where we don't need
  quite so many newtypes, and no more positional arguments.

- "--start-navigator" flag had some custom logic to accept "true" and
  "false". I don't see why we can't just accept "true" and "false"
  anywhere we use the "yes/no/auto" flags, so I just changed that and
  got rid of the custom logic.

- The way "auto" was handled for this flag was incorrect, since "auto"
  is supposed to be equivalent the default, i.e. not passing any
  flag. I changed it so auto is equivalent to not passing an argument.
  (I.e. it looks in daml.yaml for the start-navigator option).

changelog_begin
changelog_end

* dont pass in shutdownStdinClose to runStart
2021-12-16 14:40:36 +00:00