Commit Graph

6047 Commits

Author SHA1 Message Date
Gary Verhaegen
9ec54628a2
do not support Eq, Ord, Show for large tuples (#8475)
CHANGELOG_BEGIN
CHANGELOG_END
2021-01-12 17:43:35 +01:00
Gary Verhaegen
58e8b9c40f
remove dade-test-sh (#8479)
Looks like an unfinished attempt at automating the running of inexistent
bats/osht tests.

CHANGELOG_BEGIN
CHANGELOG_END
2021-01-12 17:09:36 +01:00
Gary Verhaegen
28d9cea05e
remove jfrog-cli (#8477)
As far as I can figure out, this has been unused since #5422.

CHANGELOG_BEGIN
CHANGELOG_END
2021-01-12 15:01:01 +00:00
Moritz Kiefer
4ee21f588e
Release 1.9. snapshot (#8474)
Includes the fix for DAML Script against LF 1.11 and a minor docs fix
in the ledger model.

changelog_begin
changelog_end
2021-01-12 14:44:12 +01:00
mziolekda
0ff919f498
Update offset when party/config rejected on a duplicate (#8463)
CHANGELOG_BEGIN
Advance ledger end when the indexer encounters an duplicate party or configuration update. This allows indexer to skip-over the unexpected message and continue processing subsequent updates.
CHANGELOG_END
2021-01-12 13:43:15 +00:00
arne-da
b398a55780
Fixing typos in documentation (#8163)
CHANGELOG_BEGIN
Fixed minor typos in documentation
CHANGELOG_END
2021-01-12 13:11:12 +01:00
Gary Verhaegen
ce96802a6d
only update NOTICES from main daily compats (#8473)
See #8468 for failure mode of current config.

CHANGELOG_BEGIN
CHANGELOG_END
2021-01-12 12:10:27 +00:00
Ognjen Maric
7171cb38fa
Allow multiple requesters for a commit in the ledger model (#8471)
CHANGELOG_BEGIN
- Adjust the ledger model to account for multi-party submissions
CHANGELOG_END
2021-01-12 11:49:52 +00:00
Moritz Kiefer
b32177cb0b
Build DAML Script library for all LF versions (#8472)
The hardcoded list is obviously garbage and didn’t include 1.11 so
this PR changes it to use the one we already have so they are always
in sync.

changelog_begin
changelog_end
2021-01-12 11:23:41 +00:00
Moritz Kiefer
6b2ac0e0c6
Port parts of //ledger/... to Scala 2.13 (#8470)
* Port parts of //ledger/... to Scala 2.13

Fairly random choice of directories, I just went through them in
alphabetical order. The one thing that I had to disable for now are
the conformance tests since the ledger API test tool has a dependency
not compatible with Scala 2.13.

changelog_begin
changelog_end

* Remove accidentally included //ledger/ledger-api-client/...

doesn’t actually work yet

changelog_begin
changelog_end
2021-01-12 10:55:00 +01:00
azure-pipelines[bot]
9141ea22ae
update NOTICES file (#8468)
* update compat versions for 1.9.0-snapshot.20210111.6034.0.7855b023

CHANGELOG_BEGIN
CHANGELOG_END

* update NOTICES file

CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-01-12 09:16:59 +01:00
Moritz Kiefer
cd9aeaf78e
Release 1.9.0 snapshot (#8464)
changelog_begin
changelog_end
2021-01-11 21:51:12 +01:00
Moritz Kiefer
aebde84842
Upgrade scopt to 4.0.0 (#8466)
* Upgrade scopt to 4.0.0

Scopt 3.x has some issues with Scala 2.13 because it expects an
immutable Seq on 2.13 meaning you cannot just pass in an Array. Rather
than fixing our callsites to convert to an immutable Seq everywhere,
this PR bumps to Scopt 4.0 which goes back to collection.Seq.

and leaving that aside, I’m a fan of upgrading dependencies anyway :)

changelog_begin
changelog_end

* Use val instead of def

changelog_begin
changelog_end
2021-01-11 21:23:02 +01:00
Andreas Herrmann
7855b023ac
Oauth template (#8453)
* Use ActorSystem and ExecutionContext from RequestContext

* Factor out middleware server class

To avoid passing around config and state manually.

changelog_begin
changelog_end

* Depend on databricks/sjsonnet

changelog_begin
changelog_end

* Generate request params from jsonnet template

changelog_begin
changelog_end

* Split middleware test suite sources

* Add test suite for request templates

* fmt

* TriggerServiceFixture template arguments

* Use null to indicate missing applicationId claim

Addressing
https://github.com/digital-asset/daml/pull/8453/files#r555025173

* Fix invalid path on Windows

* Close request template source

* Avoid repeated re-reading of Jsonnet files

https://github.com/digital-asset/daml/pull/8453/files#r555044262

* Factor out template argument mappings

* factor out template error handling

Co-authored-by: Andreas Herrmann <andreas.herrmann@tweag.io>
2021-01-11 17:27:46 +00:00
Gerolf Seitz
9d120f5121
Bump Ledger API version to 1.8.0 (#8455)
CHANGELOG_BEGIN
[Ledger API] With the introduction of multi-party submissions, the
Ledger API is now at version 1.8.0
CHANGELOG_END
2021-01-11 16:02:01 +00:00
Moritz Kiefer
1abde753c9
Build and test //ledger-api/... against Scala 2.13 (#8452)
changelog_begin
changelog_end
2021-01-11 16:53:54 +01:00
Robert Autenrieth
57217f33e8
Remove expensive test (#8450)
The test was useful for finding the bug in groupContiguous,
but is not useful in the long term.

CHANGELOG_BEGIN
CHANGELOG_END
2021-01-11 16:16:47 +01:00
Bernhard Elsner
5cfa6d71f8
Add table correlating Connect and Ledger API version (#8456)
* Add table correlating Connect and Ledger API version

CHANGELOG_BEGIN
CHANGELOG_END

* Use a legal character for header underlining

* Flip columns

* Remove empty line
2021-01-11 15:09:53 +00:00
Richard Kapolnai
592e794adf
Doc minor issues (#8451)
* fix typos in docs
CHANGELOG_BEGIN
CHANGELOG_END

* minor corrections

* revert a change

* update structure doc based on comments
2021-01-11 15:52:43 +01:00
Sofia Faro
e604ba1fad
Add LFConversion support for exception primitives. (#8427)
* Add conversion for exception types

* Start adding exception primitives.

changelog_begin
changelog_end

* add more error message primitives

* Comment out the exception primitives for now.

* Dont use runtimeUnsupported

* Organize DA.Internal.Exception a bit.

* Add ActionThrow and ActionCatch.

* import all of DA.Internal.Prleude

* haskell brain
2021-01-11 14:05:24 +00:00
Gary Verhaegen
7ca49bacc7
publish docs bundle as pipeline artifact (#8454)
This make the docs bundle available as a download from any build on
Azure. I mostly thought of this as a workaround for @bame-da because of
the Big Sur thing, but I figure that may occasionally useful to other
people too.

CHANGELOG_BEGIN
CHANGELOG_END
2021-01-11 13:30:51 +00:00
Remy
fef1c70b9b
Sandbox: add early access flag to the sandboxes (#8441)
The flag allows the sandboxes (both classic and next) to use preview
version of the upcoming Daml-LF version (currently LF 1.11).

CHANGELOG_BEGIN
* [Sandbox-classic] add a flag to allow early access to the next
  Daml-LF to be released.
* [Sandbox] add a flag to allow early access to the next Daml-LF
  to be released.
CHANGELOG_END
2021-01-11 14:03:57 +01:00
azure-pipelines[bot]
287d98346d
update compat versions for 1.9.0-snapshot.20210106.5986.0.c6995a9c (#8413)
* update compat versions for 1.9.0-snapshot.20210106.5986.0.c6995a9c

CHANGELOG_BEGIN
CHANGELOG_END

* update generated copyright header

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
Co-authored-by: Gary Verhaegen <gary.verhaegen@digitalasset.com>
2021-01-11 13:46:10 +01:00
Shaul Kfir
7b409b9e87
Typo fix in fmap documentation (#8350)
changelog_begin
changelog_end
2021-01-11 11:01:44 +00:00
Stefano Baghino
8d30cb5f9a
Pin scalafmt version in configuration file (#8447)
* Pin scalafmt version in configuration file

Looks like there is no other way for IntelliJ to pick up an arbitrary version.

See: https://www.jetbrains.com/help/idea/work-with-scala-formatter.html#change_scalafmt

changelog_begin
changelog_end

* Address https://github.com/digital-asset/daml/pull/8447#discussion_r554928850
2021-01-11 10:05:58 +00:00
Bernhard Elsner
64f85ae8f6
Fix docs logo (#8446)
CHANGELOG_BEGIN
CHANGELOG_END
2021-01-11 08:44:02 +00:00
Moritz Kiefer
35a866fdc2
Add Moritz as a codeowner for daml-lf stuff (#8445)
changelog_begin
changelog_end
2021-01-11 09:43:24 +01:00
Moritz Kiefer
b83c4e945d
Bump perf test for scalafmt update (#8444)
changelog_begin
changelog_end
2021-01-09 13:12:54 +01:00
Moritz Kiefer
22ce940954
Upgrade scalafmt and enable trailing commas (#8437)
This PR updates scalafmt and enables trailingCommas =
multiple. Unfortunately, scalafmt broke the version field which means
we cannot fully preserve the rest of the config. I’ve made some
attempts to stay reasonably close to the original config but couldn’t
find an exact equivalent in a lot of cases. I don’t feel strongly
about any of the settings so happy to change them to something else.

As announced, this will be merged on Saturday to avoid too many conflicts.

changelog_begin
changelog_end
2021-01-09 11:37:37 +01:00
Moritz Kiefer
329685a57c
Bump jq on Windows (#8443)
msys seems to have forgotten about the old version for some reason
which now breaks our build due to a 404.

changelog_begin
changelog_end
2021-01-09 10:33:28 +01:00
Moritz Kiefer
3a8f5e8aaa
Port //language-support/scala to Scala 2.13 (#8442)
The one thing that is still missing is making the generated Scala code
from the codegen compatible with Scala 2.13 so the examples are
excluded for now.

changelog_begin
changelog_end
2021-01-08 20:28:15 +01:00
Gerolf Seitz
3f54258a22
Fix rare out of order transaction delivery on the ledger api (#8336)
* Fix out of order transaction delivery on the ledger api

Akka's mergeSubstreams does not guarantee the order of the output.
In rare cases the order of the output doesn't match with the order
of the input, even though we know that the input events are in the
correct order (otherwise groupContiguous would delivery transactions
with random events from other transactions).

This change removes the need for substreams by collecting the events
for a transaction inside statefulMapConcat. The loss of mergeSubstreams'
parallelism is likely no problem, because we anyway need to send out transactions
in the correct order.

Fixes #7521.

CHANGELOG_BEGIN
Ledger API: Fixed an issue that rarely caused transactions to be sent out of order. See #7521
CHANGELOG_END

* Use mergeSubstreamsWithParallelism(1)

* Use concatSubstreams

* Add test that can trigger the error reliably

* Address https://github.com/digital-asset/daml/pull/8336#discussion_r545760676

* Update copyright notice in GroupContiguousHeavySpec.scala

* Remove link to PR

Co-authored-by: Stefano Baghino <stefano.baghino@digitalasset.com>
Co-authored-by: Robert Autenrieth <robert.autenrieth@digitalasset.com>
2021-01-08 20:12:19 +01:00
Robin Krom
859d8f44d9
fix: navigator regression: create empty config file. (#8440)
* fix: navigator regression: create empty config file.

For backwards compatibility, `daml ledger navigator` needs to create an
empty `ui-backend.conf` file when invoced outside a project directory.
Otherwise, navigator will fail to start.

CHANGELOG_BEGIN
CHANGELOG_END

* integration test
2021-01-08 17:56:37 +01:00
Stefano Baghino
c44a62afd0
Add grpc-server-reflection-client (#8438)
* Add grpc-server-reflection-client

Adds a small library designed to return in a simple package (a Future[Set[...]])
a full description of all services available on a gRPC server (if it exposes the
standard reflection endpoint), which is enough to easily generate a full reverse
proxy.

changelog_begin
changelog_end

* Address https://github.com/digital-asset/daml/pull/8438#discussion_r553900804

* Address https://github.com/digital-asset/daml/pull/8438#discussion_r553902902

* Address https://github.com/digital-asset/daml/pull/8438#discussion_r553904143
2021-01-08 16:33:25 +00:00
Gary Verhaegen
da37ef6de7
rxjava: support for multiparty submissions (#8429)
* rxjava: support for multiparty submissions

This (conceptually) small set of changes adds overrides for the `submit`
family of methods that let clients pass lists of `actAs` and `readAs`
parties rather than a single party.

CHANGELOG_BEGIN

- [Java Codegen] The LedgerClient interface in the rxjava bindings has
  been expanded with more overrides to the `submit` family of methods to
  account for the new multiparty submission feature.

  This is a compile-time breaking change for anyone who has a custom
  implementation of the LedgerClient, CommandClient or
  CommandSubmissionClient interfaces. Most Java IDEs will be able to
  geenrate stub implementations that throw some variant of
  UnsupportedOperationException or RuntimeException, which is a viable
  workaround until you start using the new multiparty submission
  feature.

  We expect most users to use the provided implementations of these
  interfaces rather than implement them themselves; for those users,
  this change is purely additive.

CHANGELOG_END

* review comments

* fromProto

* use Arrays.asList
2021-01-08 14:06:37 +00:00
Bernhard Elsner
cda93db944
Daml case and logo (#8433)
* Replace many occurrences of DAML with Daml

* Update docs logo

* A few more CLI occurrences

CHANGELOG_BEGIN
- Change DAML capitalization and docs logo
CHANGELOG_END

* Fix some over-eager replacements

* A few mor occurrences in md files

* Address comments in *.proto files

* Change case in comments and strings in .ts files

* Revert changes to frozen proto files

* Also revert LF 1.11

* Update get-daml.sh

* Update windows installer

* Include .py files

* Include comments in .daml files

* More instances in the assistant CLI

* some more help texts
2021-01-08 12:50:15 +00:00
Moritz Kiefer
0af4f522c7
Port the rest //daml-lf/... to Scala 2.13 (#8436)
* Port the rest //daml-lf/... to Scala 2.13

Draw the rest of the owl

changelog_begin
changelog_end

* Update daml-lf/encoder/src/main/scala/com/digitalasset/daml/lf/archive/testing/DamlLfEncoder.scala

Co-authored-by: Remy <remy.haemmerle@daml.com>

Co-authored-by: Remy <remy.haemmerle@daml.com>
2021-01-08 10:38:17 +01:00
azure-pipelines[bot]
7bae2be354
update NOTICES file (#8435)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-01-08 10:30:50 +01:00
Moritz Kiefer
424faa923a
Port damlc dependencies to Scala 2.13 (#8423)
* Port damlc dependencies to Scala 2.13

I got a bit fed up by the fact that going directory by directory
didn’t really work since there are two many interdependencies in
tests (e.g., client tests depend on sandbox, sandbox tests depend on
clients, engine tests depend on DARs which depend on damlc, …).

So before attempting to continue with the per-directory process, this
is a bruteforce approach to break a lot of those cycles by porting all
dependencies of damlc which includes client bindings (for DAML Script)
and Sandbox Classic (also for DAML Script).

If this is too annoying to review let me know and I’ll try to split it
up into a few chunks.

changelog_begin
changelog_end

* Update daml-lf/data/src/main/2.13/com/daml/lf/data/LawlessTraversals.scala

Co-authored-by: Stephen Compall <stephen.compall@daml.com>

* fixup lawlesstraversal

changelog_begin
changelog_end

* less iterator more view

changelog_begin
changelog_end

* document safety of unsafeWrapArray

changelog_begin
changelog_end

Co-authored-by: Stephen Compall <stephen.compall@daml.com>
2021-01-08 07:22:38 +01:00
Bernhard Elsner
61beb175f3
Improve the docs copyright notice (#8205)
* Improve the docs copyright notice

CHANGELOG_BEGIN
CHANGELOG_END

* Update docs/configs/html/conf.py

Co-authored-by: Gary Verhaegen <gary.verhaegen@digitalasset.com>

Co-authored-by: Gary Verhaegen <gary.verhaegen@digitalasset.com>
2021-01-07 17:22:12 +00:00
Andreas Herrmann
a830dd44ea
Update VC redist to 14.28.29325.2 (#8431)
changelog_begin
changelog_end

Co-authored-by: Andreas Herrmann <andreas.herrmann@tweag.io>
2021-01-07 16:31:25 +00:00
Andreas Herrmann
fa45a58b50
Avoid compiling damlc twice (#8428)
This only compiles `damlc-bootstrap` as a Haskell binary and `damlc` is
a simple symlink with additional runfiles.

We now need to define `damlc@ghci` manually since it is no longer
defined automatically. The manual definition was tested with

```
$ bazel run //:damlc@ghci --define ghci_data=True
> :main ide -d
```

changelog_begin
changelog_end

Co-authored-by: Andreas Herrmann <andreas.herrmann@tweag.io>
2021-01-07 16:58:32 +01:00
Samir Talwar
6d2140072f
kvutils: Wrap raw key and value bytestrings in types. (#8408)
* kvutils: Wrap raw key and value bytestrings in types.

CHANGELOG_BEGIN
CHANGELOG_END

* kvutils: Delete `Bytes`.

* kvutils: Inline LedgerStateOperations.{Key, Value}.

* kvutils: Extract out a `Raw` trait.

* ledger-on-memory: Use state reader type aliases.

* ledger-on-sql: Provide implicit conversions for Raw.*.

* kvutils: Merge raw weights.

* kvutils: Move `Raw` into the kvutils package.

* kvutils: Seal `Raw`.

* kvutils: Delete the `SubmissionEnvelope` alias.

* kvutils: Use Raw#size when computing cache weight.

* kvutils: Improve clarity in a couple of places.

* kvutils: Rename the `Raw` trait to `Raw.Bytes`.

* kvutils: Rename `Raw.Pair` to `Raw.KeyValuePair`.
2021-01-07 15:28:14 +00:00
Gary Verhaegen
cd858d53d5
remove buck-out (#8426)
Hopefully we don't need it anymore. 🤷

CHANGELOG_BEGIN
CHANGELOG_END
2021-01-07 14:53:33 +00:00
Sofia Faro
5234f8a544
Update .vscode/settings.json (#8425)
* Update .vscode/settings.json

The "files.useExperimentalFileWatcher" setting was deprecated at some point. I tried to add "files.watcherExcluded" to see if this will help with the extreme CPU usage issues on macOS. Also removed the "buck" exclusions since we don't use buck anymore as far as I know. And I added node_modules exclusions because that seems like a sensible thing to exclude.

changelog_begin
changelog_end

* make it valid JSON
2021-01-07 14:32:33 +00:00
Remy
440b17af24
LF : Fix/Clean some LF related TODOs (#8387)
CHANGELOG_BEGIN
CHANGELOG_END
2021-01-07 15:13:28 +01:00
Sofia Faro
df5b98425e
Add DA.Maybe to preprocessor exceptions. (#8424)
Don't run the preprocessor on DA.Maybe since it doesn't need it, and the
preprocessor was generating a bunch of warnings due to use of the
PatternSynonyms extension. We can safely ignore these warnings.

Also refactors that part of the preprocessor a little bit.

changelog_begin
changelog_end
2021-01-07 14:09:29 +00:00
Gary Verhaegen
427179ab27
fix (some) copyright headers (#8422)
This commit fixes a few copyright headers that have been missed in the
automatic update on Jan 1, as well as the generation code in the compat
workspace so it generates the right headers.

CHANGELOG_BEGIN
CHANGELOG_END
2021-01-07 11:48:59 +01:00
azure-pipelines[bot]
d38a36ea0f
rotate release duty after 1.9.0-snapshot.20210105.5984.0.c68ba110 (#8404)
@robin-da is taking care of 1.9.0-snapshot.20210105.5984.0.c68ba110 (#8403), so they get pushed back to the end of the line.

Please do not merge this before #8403.

CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-01-07 10:22:24 +00:00
Moritz Kiefer
0549d07bdc
Port //daml-lf/interpreter to Scala 2.13 (#8421)
* Port //daml-lf/interpreter to Scala 2.13

For now the perf tests are left out since they depend on a DAR built
by damlc which depends on daml script which depends on the world
:exploding-head:

changelog_begin
changelog_end

* Scala 2.13-style to for ImmArray and FrontStack

changelog_begin
changelog_end

* Avoid extra conversion

changelog_begin
changelog_end
2021-01-07 10:13:08 +00:00