Commit Graph

255 Commits

Author SHA1 Message Date
Moritz Kiefer
569612ab73
Drop broken symlink config (#10616)
This doesn’t do anything other than produce a warning.

changelog_begin
changelog_end
2021-08-19 08:40:09 +00:00
Samir Talwar
41e60f7302
Upgrade to Scala 2.12.14 and 2.13.6. (#10573)
* Upgrade to Scala 2.12.14.

* Upgrade Scala to 2.13.6.

CHANGELOG_BEGIN
CHANGELOG_END

* compability: Re-pin the Maven dependencies.
2021-08-12 14:25:53 +00:00
Andreas Herrmann
4e1a90dffd
Enable --incompatible_remote_results_ignore_disk (#10571)
* Enable --incompatible_remote_results_ignore_disk

> If set to true, --noremote_upload_local_results and --noremote_accept_cached will not apply to the disk cache. If a combined cache is used: --noremote_upload_local_results will cause results to be written to the disk cache, but not uploaded to the remote cache. --noremote_accept_cached will result in Bazel checking for results in the disk cache, but not in the remote cache. See #8216 for details.

changelog_begin
changelog_end

* Fix compatibility workspace

Co-authored-by: Andreas Herrmann <andreas.herrmann@tweag.io>
2021-08-12 12:35:05 +00:00
azure-pipelines[bot]
76ecb44fbd
update compat versions for 1.17.0-snapshot.20210811.7565.0.f1a55aa4 (#10563)
* update compat versions for 1.17.0-snapshot.20210811.7565.0.f1a55aa4

CHANGELOG_BEGIN
CHANGELOG_END

* fix Scala code

changelog_begin
changelog_end

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
Co-authored-by: Moritz Kiefer <moritz.kiefer@purelyfunctional.org>
2021-08-12 12:33:37 +02:00
Moritz Kiefer
86a03fa7c0
Bump bazel max jvm memory (#10569)
* Bump bazel max jvm memory

I kept the starting memory the same. Happy to bump that as well if you
think it makes sense.

changelog_begin
changelog_end

* Bump xms as well

changelog_begin
changelog_end
2021-08-12 09:31:19 +00:00
Andreas Herrmann
881d0aba91
Upgrade rules_haskell and rules_nixpkgs (#10517)
* Update rules_haskell & rules_nixpkgs

changelog_begin
changelog_end

* remove unused patch

* Remove the strict-source-names patch

This patch was largely motivated by issues with directory outputs on
Windows occasionally producing empty outputs that would poison the
remote cache. However, we have continued seeing this type of issue
despite this patch and have since resorted to a regular fixup job that
cleans such empty items out of the cache.

With that the strongest motivation with this change is no longer valid
and it doesn't seem worth it to maintain it any longer.

changelog_begin
changelog_end

* Remove windows-remove-fake-libs patch

This patch was upstreamed.

* Update windows-extra-libraries patch

The GHC bindist patch is no longer required as it applied to GHC version
8.10.3 but we are using 8.10.4 instead.

* Remove cc-wrapper-windows patch

This was upstreamed.

* Remove protobuf-source patch

This was upstreamed

* Keep patches in sync between daml and compatibility

Co-authored-by: Andreas Herrmann <andreas.herrmann@tweag.io>
2021-08-09 15:19:17 +02:00
azure-pipelines[bot]
2d2579776b
update compat versions for 1.16.0-snapshot.20210805.7501.0.48050ad7 (#10505)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-08-09 08:42:16 +02:00
azure-pipelines[bot]
8c55e011e8
update compat versions for 1.16.0-snapshot.20210802.7499.0.5157ad6d (#10464)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-08-03 15:06:39 +02:00
Remy
a929b25b41
Fix compatibility test (#10446)
* Fix compatibility test

CHANGELOG_BEGIN
CHANGELOG_END

* a bit more fixes
2021-07-29 18:33:53 +02:00
Moritz Kiefer
9cb83100f1
Patch transitive protobuf dependency (#10441)
Part 2 of #10437

changelog_begin
changelog_end
2021-07-28 17:11:10 +00:00
azure-pipelines[bot]
8cf3076486
update compat versions for 1.16.0-snapshot.20210727.7476.0.b5e9d861 (#10431)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-07-28 16:05:07 +02:00
Remy
cf7b1bb8b5
LF: ValueDecoder set recursion limit for values. (#10393)
CHANGELOG_BEGIN
CHANGELOG_END
2021-07-28 12:14:15 +02:00
azure-pipelines[bot]
e8247afc6e
update compat versions for 1.16.0-snapshot.20210720.7404.0.b7cf42d1 (#10354)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-07-22 17:00:52 +02:00
azure-pipelines[bot]
84094e0b6b
update compat versions for 1.15.0 (#10281)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-07-15 08:44:45 +02:00
mziolekda
2271f93b69
Fix crash on duplicate submissionId (#10242)
* CHANGELOG_BEGIN
Fix crash in ConfigManagement- and PackageManagement- services on duplicate submissionsIds from different participants.
Extend ledger-api-test-tool to cover the duplicate submissionId cases.
CHANGELOG_END

* Addressing review comments and fixing failing tests

* format

* address more review comments

* adopt after rebase to main
2021-07-14 14:12:31 +00:00
azure-pipelines[bot]
7f4bc2a472
update compat versions for 1.14.2 (#10233)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-07-12 08:24:55 +02:00
azure-pipelines[bot]
89d87ad17c
update compat versions for 1.14.2-snapshot.20210708.7135.0.aa297840 (#10223)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-07-09 11:21:49 +02:00
Moritz Kiefer
42693452ce
Drop cleanup of node_modules (#10195)
This is months old by now and I think it might be non-deterministic
forcing unnecessary rebuilds.

changelog_begin
changelog_end
2021-07-07 10:15:44 +02:00
azure-pipelines[bot]
e4c8c390f2
update compat versions for 1.14.1-snapshot.20210706.7133.0.8ec16e94 (#10196)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-07-07 08:34:25 +02:00
azure-pipelines[bot]
05a72a3a15
update compat versions for 1.15.0-snapshot.20210705.7286.0.62aabcc4 (#10184)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-07-06 10:25:48 +02:00
Moritz Kiefer
64497f6c10
Only run sandbox(classic)? on postgres tests on Linx (#10178)
They keep causing timeouts on MacOS and nobody seems to consider them
useful enough to investigate. For now I only disabled the postgres
tests because I haven’t seen the others time out but if they do I’ll
add them as well

changelog_begin
changelog_end
2021-07-05 13:41:59 +00:00
azure-pipelines[bot]
b88ad58712
update compat versions for 1.15.0-snapshot.20210630.7261.0.84e1f3a7 (#10151)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-06-30 19:53:51 +02:00
Stefano Baghino
bb4641756f
Daml assistant capitalization (#10140)
changelog_begin
changelog_end

- DAML -> daml
- Assistant -> assistant

The capitalization of the latter fixed one occurrence of a capitalized 'A'
which was inconsistent with the vast majority of uncapitalized 'a's.
2021-06-29 14:32:44 +02:00
Moritz Kiefer
46a66e2f2a
Upgrade jest to the latest version (#10107)
This ends up transitively bumping yargs-parser which has a
vulnerability but more generally I also just like being on the latest version.

changelog_begin
changelog_end
2021-06-24 11:16:29 +00:00
azure-pipelines[bot]
84e329885f
update compat versions for 1.11.2 (#10104)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-06-24 13:07:03 +02:00
Remy
a6b536f3c4
Compiler: Make LF 1.13 the default output (#9907)
* Compiler: Roll LF Version

Fix #8591

CHANGELOG_BEGIN
- [Compiler] Default ouput LF version is now 1.13
CHANGELOG_END
2021-06-24 11:58:50 +02:00
Moritz Kiefer
3d79cbf2b1
Bump compat versions (#10096)
We need to do the same override for the gRPC version we do on main to
resolve conflicts.

changelog_begin
changelog_end
2021-06-23 22:12:04 +02:00
azure-pipelines[bot]
7eb2ce72a9
update compat versions for 1.15.0-snapshot.20210615.7169.0.adeba206 (#10028)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-06-22 17:44:18 +02:00
Gary Verhaegen
e12a449c81
s/DABL/Daml Hub/ (#10062)
It's been long enough.

CHANGELOG_BEGIN
CHANGELOG_END
2021-06-21 16:37:17 +02:00
Moritz Kiefer
997a7d449c
Use symlinks on Windows (#9969)
changelog_begin
changelog_end
2021-06-11 16:06:06 +00:00
azure-pipelines[bot]
15f9dfb963
update compat versions for 1.14.0-snapshot.20210602.7086.0.f36f556b (#9900)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-06-07 12:58:31 +02:00
Remy
7bc925e4d2
LF: Factorize the logic for AST lookup (#9871)
Factorize the logic for AST lookup in
 - compiler 
 - type checker 
 - preprocessor
 - script triggers 
 - some tests

CHANGELOG_BEGIN
CHANGELOG_END
2021-06-03 13:32:56 +02:00
Stefano Baghino
c0fccfc671
Switch Scala version Bazel config (#9848)
* Switch Scala version Bazel config

changelog_begin
changelog_end

This allows to easily test with Scala 2.12.x locally. The `scala_2_13` Bazel
configuration is no longer needed becase now Scala 2.13.x is the default.

* Address https://github.com/digital-asset/daml/pull/9848#discussion_r642381690
2021-05-31 10:50:54 +00:00
azure-pipelines[bot]
6846dbfaf8
update compat versions for 1.14.0-snapshot.20210526.7024.0.aedb9a82 (#9806)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-05-27 09:56:25 +02:00
Robert Autenrieth
d2bce1628e
DPP-335 Implement data migration for the append-only schema (#9481)
* Implement data migration

changelog_begin
changelog_end

* Rename migration

* Update test

* Move the append-only migrations

* Enable data migration test

* Fixup after script rename

* Check append-only migration hashes

* Add missing comments

* Simplify query

* Add vacuum migration

* Rename unknown workflow id

* Only use head migration script

* Rename history table

* Fix comments

* Align previous schema change after rebase

changelog_begin
changelog_end

Co-authored-by: Marton Nagy <marton.nagy@digitalasset.com>
2021-05-20 21:33:18 +02:00
Moritz Kiefer
90180eb87f
Make sure we don’t start leaking directories in compat tests (#9759)
As evidenced by this change, we don’t actually need the safeguard
here. i think this was just copied over from the main workspace where
we did leak installations. I’d like to know when we start leaking
installations here in the future so this PR removes the catch.

changelog_begin
changelog_end
2021-05-20 13:59:11 +00:00
azure-pipelines[bot]
14cfe9916e
update compat versions for 1.14.0-snapshot.20210518.6953.0.a6c7b86a (#9741)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-05-19 14:28:09 +02:00
Moritz Kiefer
b1738c7202
Switch Scala default to 2.13 (#9699)
changelog_begin
changelog_end
2021-05-17 15:04:53 +00:00
azure-pipelines[bot]
e5646a9c73
update compat versions for 1.13.1-snapshot.20210512.6834.1.5f532380 (#9681)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-05-14 12:57:50 +02:00
Moritz Kiefer
9e6d6f7cf0
Support append-only schema in Sandbox migration tests (#9637)
Note that these tests are switched off for now until Robert has
implemented the migration.

To avoid having to stuff too much in one PR the plan is to merge this
one first and then switch the flag once the migrations work.

changelog_begin
changelog_end
2021-05-12 10:03:36 +02:00
Moritz Kiefer
89e46bf90b
Address security vulnerabilities in //compiler/daml-extension (#9615)
changelog_begin
changelog_end
2021-05-07 14:54:54 +02:00
azure-pipelines[bot]
192a77a6d8
update compat versions for 1.13.0-snapshot.20210504.6833.0.9ae787d0 (#9575)
* update compat versions for 1.13.0-snapshot.20210504.6833.0.9ae787d0

CHANGELOG_BEGIN
CHANGELOG_END

* fix exclusion

changelog_begin
changelog_end

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
Co-authored-by: Moritz Kiefer <moritz.kiefer@purelyfunctional.org>
2021-05-05 15:40:12 +02:00
Moritz Kiefer
800989145b
Disable migration tests on macos on PRs (#9571)
We are a bit short on macos nodes and these tests run > 500s so this
should hopefully make things a bit faster. Not necessarily the full
solution, I think we also want to limit the versions here but this is
at least a start.

changelog_begin
changelog_end
2021-05-04 15:17:36 +00:00
Kamil Bożek
39afcc4857
Fix index size limit issues [DPP-347] (#9477)
* Added a new test suite for testing limit API values - ValueLimitsIT

* Change index on participant_command_completions table
This change fixes issues with commands with large submitters number on sandbox-classic

* Added key_hash column to the ledger *state table
The new column is now the primary key of the table. Its values are hashed values of the 'key' column which allows to mitigate limitations on the index row size

* Backfill key_hash for ledger_state table

* Dynamic state table prefix form the backfill migration

* Removed redundant comments

* Backfill migration for all the db types

* Added missing copyright comment

* Fixed migration order after a rebase

* Added missing checksums for sql migrations

* Temporarily removed copyrights from one of sql migrations

* Removed unnecessary NOT NULL constraint

* Removed submitters from the index participant_command_completion_offset_application_idx in the append-only schema

* Disabled the test for old platforms

* CHANGELOG_BEGIN
- [Integration Kit] - a new test suite ValueLimitsIT for testing edge case values
- [Integration Kit] - modified index on the participant_command_completions table to avoid issuess with a large number of submitters
- [Sandbox] - added the key_hash column to the *state table
CHANGELOG_END

* Disabled concurrent testing for the ValueLimitsIT:VLLargeSubmittersNumberCreateContract test case

* Recomputed migrations checksums for the participant-integration-api

* Increase the sandbox-on-x queue size to 500
The motivation is that running conformance tests failed with RESOURCE_EXHAUSTED error due to 200 limit on the queue.

* Minor improvement

* Inlined key hashing for migrations to avoid external dependencies

* Minor improvement

* Fixed migrations hash
2021-05-04 12:23:37 +02:00
azure-pipelines[bot]
d89c8e71af
update compat versions for 1.13.0-snapshot.20210503.6809.0.ca012c3b (#9555)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-05-03 20:05:09 +02:00
Moritz Kiefer
4aca199bbd
Upgrade to Scala 2.13.5 (#9528)
changelog_begin
changelog_end
2021-04-29 13:05:57 +00:00
azure-pipelines[bot]
d028c043bc
update compat versions for 1.13.0-snapshot.20210426.6770.0.ca66061b (#9514)
CHANGELOG_BEGIN
CHANGELOG_END

Co-authored-by: Azure Pipelines DAML Build <support@digitalasset.com>
2021-04-28 11:34:22 +02:00
Stefano Baghino
e1e878a597
Simplify opt-in/out of Oracle when building (#9515)
* Simplify opt-in/out of Oracle when building

- defines Oracle-related environment variables as part of dev-env so that it's the same across CI and dev
- adds a Bazel 'oracle' configuration so that --config=oracle pulls all required environment

changelog_begin
changelog_end

* Address https://github.com/digital-asset/daml/pull/9515#discussion_r621180994

* Also use `$ORACLE_USERNAME` instead of `system` in the `sqlplus` connection string

* Address https://github.com/digital-asset/daml/pull/9515#discussion_r621186459
2021-04-28 06:10:43 +02:00
Samir Talwar
3db928c548
compatibility: Use the same Scala version as the root. (#9502)
* compatibility: Use the same Scala version as the root.

It's confusing to get out of sync. `compatibility` was using Scala
2.12.12 while the root was on 2.12.13.

This brings them in sync to 2.12.13.

CHANGELOG_BEGIN
CHANGELOG_END

* Factor out Scala artifacts into scala_version.bzl.

* Bazel: Explicitly specify artifact hashes for Scala 2.13.

Not strictly necessary, as we _happen_ to depend on the same point
release as the Bazel Scala plugin, but this is incidental and we don't
want to bank on it.
2021-04-26 17:49:43 +00:00
Moritz Kiefer
4e1c5fedb3
Check visibility for by-key operation of local contracts (#9470)
* Check visibility for by-key operation of local contracts

fixes #9454

I tried out two approaches for this:

1. The one here where we add a new callback. This has the advantage
   that the engine remains oblivious to visibility checks. They are all
   done outside and the engine doesn’t even know about the reading
   parties.
2. Make the engine aware of the reading parties. A start of that is in
   #9458.

Both work in principle but I ended up going for 1 in the end. Doing
half of the visibility checks outside the engine and half inside just
seems worse than the current state.

changelog_begin

- [Daml Engine] Fix a bug where it was possible to
  fetch/lookup/exercise a local contract by key even if the reading parties
  are not stakeholders. See #9454 for details.

changelog_end

* Disable new test on Canton

changelog_begin
changelog_end

* Exclude from compat tests

changelog_begin
changelog_end

* s/LocalLookup/LocalFetch/

changelog_begin
changelog_end

* Address review

changelog_begin
changelog_end
2021-04-22 21:39:12 +02:00