The Daml smart contract language
Go to file
Moritz Kiefer 424faa923a
Port damlc dependencies to Scala 2.13 (#8423)
* Port damlc dependencies to Scala 2.13

I got a bit fed up by the fact that going directory by directory
didn’t really work since there are two many interdependencies in
tests (e.g., client tests depend on sandbox, sandbox tests depend on
clients, engine tests depend on DARs which depend on damlc, …).

So before attempting to continue with the per-directory process, this
is a bruteforce approach to break a lot of those cycles by porting all
dependencies of damlc which includes client bindings (for DAML Script)
and Sandbox Classic (also for DAML Script).

If this is too annoying to review let me know and I’ll try to split it
up into a few chunks.

changelog_begin
changelog_end

* Update daml-lf/data/src/main/2.13/com/daml/lf/data/LawlessTraversals.scala

Co-authored-by: Stephen Compall <stephen.compall@daml.com>

* fixup lawlesstraversal

changelog_begin
changelog_end

* less iterator more view

changelog_begin
changelog_end

* document safety of unsafeWrapArray

changelog_begin
changelog_end

Co-authored-by: Stephen Compall <stephen.compall@daml.com>
2021-01-08 07:22:38 +01:00
.github rename master to main (#8245) 2020-12-27 14:19:07 +01:00
.vscode Update .vscode/settings.json (#8425) 2021-01-07 14:32:33 +00:00
3rdparty fix (some) copyright headers (#8422) 2021-01-07 11:48:59 +01:00
bazel_tools Avoid compiling damlc twice (#8428) 2021-01-07 16:58:32 +01:00
build-scripts fix (some) copyright headers (#8422) 2021-01-07 11:48:59 +01:00
ci Port damlc dependencies to Scala 2.13 (#8423) 2021-01-08 07:22:38 +01:00
compatibility fix (some) copyright headers (#8422) 2021-01-07 11:48:59 +01:00
compiler Port damlc dependencies to Scala 2.13 (#8423) 2021-01-08 07:22:38 +01:00
daml-assistant Support DAML_PROJECT in daml codegen java (#8416) 2021-01-06 16:38:47 +01:00
daml-lf Port damlc dependencies to Scala 2.13 (#8423) 2021-01-08 07:22:38 +01:00
daml-script Port damlc dependencies to Scala 2.13 (#8423) 2021-01-08 07:22:38 +01:00
dev-env Update VC redist to 14.28.29325.2 (#8431) 2021-01-07 16:31:25 +00:00
docs Improve the docs copyright notice (#8205) 2021-01-07 17:22:12 +00:00
extractor LF : Fix/Clean some LF related TODOs (#8387) 2021-01-07 15:13:28 +01:00
ghc-lib Update instructions for working with ghc-lib (#8158) 2020-12-03 17:52:16 +00:00
infra Include new Nix signing key in static nix config on CI nodes (#8407) 2021-01-06 13:24:34 +01:00
language-support Port damlc dependencies to Scala 2.13 (#8423) 2021-01-08 07:22:38 +01:00
ledger Port damlc dependencies to Scala 2.13 (#8423) 2021-01-08 07:22:38 +01:00
ledger-api update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
ledger-service Port damlc dependencies to Scala 2.13 (#8423) 2021-01-08 07:22:38 +01:00
libs-haskell update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
libs-scala update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
navigator LF : Fix/Clean some LF related TODOs (#8387) 2021-01-07 15:13:28 +01:00
nix update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
release rotate release duty after 1.9.0-snapshot.20210105.5984.0.c68ba110 (#8404) 2021-01-07 10:22:24 +00:00
replacements update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
rules_daml update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
scala-protoc-plugins Port damlc dependencies to Scala 2.13 (#8423) 2021-01-08 07:22:38 +01:00
templates fix (some) copyright headers (#8422) 2021-01-07 11:48:59 +01:00
triggers Make auth callback state bounded (#8351) 2021-01-06 16:02:05 +00:00
.bazelignore Remove redundant clean --expunge (#6890) 2020-07-28 09:49:36 +02:00
.bazelrc Add a Scala 2.13 build pipeline (#8271) 2020-12-14 12:42:26 +01:00
.dadew Update VC redist to 14.28.29325.2 (#8431) 2021-01-07 16:31:25 +00:00
.envrc open-sourcing daml 2019-04-04 09:33:38 +01:00
.gitattributes Remove unreleased.rst (#3547) 2019-11-20 15:16:57 +00:00
.gitignore dev-env: Add a symlink, dev-env/jdk, to the current JDK. (#7745) 2020-10-20 11:03:23 +00:00
.hie-bios Update rules_haskell (#4751) 2020-03-13 16:49:34 +01:00
.hlint.yaml update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
.mergify.yml update mergify config for ci split (#8390) 2021-01-05 11:31:48 +01:00
.scalafmt.conf Revert "Adopt trailingCommas option in scalafmt (#4214)" (#4257) 2020-01-29 11:43:35 +00:00
azure-cron.yml update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
azure-pipelines.yml fix Artifactory hashes (#8414) 2021-01-06 15:36:16 +01:00
BAZEL-bash.md add Bazel bash help (#2223) 2019-07-19 15:31:45 +00:00
bazel-haskell-deps.bzl update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
BAZEL-haskell.md rename master to main (#8245) 2020-12-27 14:19:07 +01:00
bazel-java-deps.bzl Remove Navigator console (#8392) 2021-01-05 13:20:48 +01:00
BAZEL-JVM.md Add a Scala 2.13 build pipeline (#8271) 2020-12-14 12:42:26 +01:00
BAZEL.md rename master to main (#8245) 2020-12-27 14:19:07 +01:00
BUILD Write proper SDK version in DAR manifest for snapshots (#7546) 2020-10-02 12:59:18 +02:00
build.ps1 reenable Windows cache (#8329) 2020-12-17 15:58:01 +01:00
build.sh update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
CHANGELOG Move unreleased user-facing features to its own file (#1762) 2019-06-19 16:32:03 +02:00
CODE_OF_CONDUCT.md open-sourcing daml 2019-04-04 09:33:38 +01:00
CODEOWNERS Adjust CODEOWNERS for @stefanobaghino-da (#8377) 2021-01-04 18:55:11 +01:00
CONTRIBUTING.md rename master to main (#8245) 2020-12-27 14:19:07 +01:00
COPY update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
daml-logo.png #2785 add daml_logo.png for README (#2787) 2019-09-06 09:35:32 +02:00
deps.bzl Upgrade rules_haskell (#8370) 2021-01-04 16:57:35 +01:00
dotfiles open-sourcing daml 2019-04-04 09:33:38 +01:00
fmt.sh update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
ghcide_snapshot_windows.json stack_snapshot_json on Windows (#7468) 2020-09-24 12:03:15 +00:00
ghcide_snapshot.json Update ghcide 0.1.0 --> 0.2.0 (#6745) 2020-07-16 16:30:09 +00:00
ghcide-snapshot.yaml update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
LATEST release 1.9.0-snapshot.20210105.5984.0.c68ba110 (#8403) 2021-01-06 13:36:59 +01:00
LICENSE update copyright notices to 2020 (#3939) 2020-01-02 21:21:13 +01:00
maven_install_2.12.json Remove Navigator console (#8392) 2021-01-05 13:20:48 +01:00
maven_install_2.13.json Port //daml-lf/data to Scala 2.13 (#8321) 2020-12-18 13:20:15 +01:00
NOTICES update NOTICES file (#8405) 2021-01-06 08:47:51 +01:00
NOTICES.md cleanup oss-compliance & NOTICES.md (#8242) 2020-12-10 16:45:56 +01:00
package.json Upgrade bl to address security vulnerability (#7312) 2020-09-03 09:49:06 +00:00
Pipfile add blackduck scan to run on master (#6130) (#8161) 2020-12-07 19:59:39 +00:00
README.md rename master to main (#8245) 2020-12-27 14:19:07 +01:00
release.sh update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
SECURITY.md Update links in the SECURITY file. (#6327) 2020-06-15 08:24:45 +00:00
stack-snapshot.yaml update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
stackage_snapshot_windows.json Avoid duplicating template let bindings (#8259) 2020-12-18 14:33:28 +00:00
stackage_snapshot.json Avoid duplicating template let bindings (#8259) 2020-12-18 14:33:28 +00:00
tsconfig.json open-sourcing daml 2019-04-04 09:33:38 +01:00
unreleased.sh update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
Upgrading.md Upgrade rules_haskell and pin stack_snapshot (#6548) 2020-07-02 18:55:09 +02:00
WORKSPACE Add a Scala 2.13 build pipeline (#8271) 2020-12-14 12:42:26 +01:00
workspace_status.sh update copyright notices for 2021 (#8257) 2021-01-01 19:49:51 +01:00
yarn.lock Bump ini from 1.3.5 to 1.3.7 (#8253) 2020-12-11 10:02:07 +01:00

DAML logo

Download License Build

Copyright 2020 Digital Asset (Switzerland) GmbH and/or its affiliates. All Rights Reserved. SPDX-License-Identifier: Apache-2.0

Welcome to the DAML repository!

This repository hosts all code for the DAML smart contract language and SDK, originally created by Digital Asset. DAML is an open-source smart contract language for building future-proof distributed applications on a safe, privacy-aware runtime. The SDK is a set of tools to help you develop applications based on DAML.

Using DAML

To download DAML, follow the installation instructions. Once installed, to try it out, follow the quickstart guide.

If you have questions about how to use DAML or how to build DAML-based solutions, please ask them on StackOverflow using the daml tag.

Contributing to DAML

We warmly welcome contributions. If you are looking for ideas on how to contribute, please browse our issues. To build and test DAML:

1. Clone this repository

git clone git@github.com:digital-asset/daml.git
cd daml

2. Set up the development dependencies

Our builds require various development dependencies (e.g. Java, Bazel, Python), provided by a tool called dev-env.

Linux and Mac

On Linux and Mac dev-env can be installed with:

  1. Install Nix by running: bash <(curl -sSfL https://nixos.org/nix/install)
  2. Enter dev-env by running: eval "$(dev-env/bin/dade assist)"

If you don't want to enter dev-env manually each time using eval "$(dev-env/bin/dade assist)", you can also install direnv. This repo already provides a .envrc file, with an option to add more in a .envrc.private file.

Windows

On Windows you need to enable long file paths by running the following command in an admin powershell:

Set-ItemProperty -Path 'HKLM:\SYSTEM\CurrentControlSet\Control\FileSystem' -Name LongPathsEnabled -Type DWord -Value 1

Then start dev-env from PowerShell with:

.\dev-env\windows\bin\dadew.ps1 install
.\dev-env\windows\bin\dadew.ps1 sync
.\dev-env\windows\bin\dadew.ps1 enable

In all new PowerShell processes started, you need to repeat the enable step.

3. First build and test

We have a single script to build most targets and run the tests. On Linux and Mac run ./build.sh. On Windows run .\build.ps1. Note that these scripts may take over an hour the first time.

To just build do bazel build //..., and to just test do bazel test //.... To read more about Bazel and how to use it, see the Bazel site.

On Mac if building is causing trouble complaining about missing nix packages, you can try first running nix-build -A tools -A cached nix repeatedly until it completes without error.

4. Installing a local copy

On Linux and Mac run daml-sdk-head which installs a version of the SDK with version number 0.0.0. Set the version: field in any DAML project to 0.0.0 and it will use the locally installed one.

On Windows:

bazel build //release:sdk-release-tarball
tar -vxf .\bazel-bin\release\sdk-release-tarball.tar.gz
cd sdk-*
daml\daml.exe install . --activate

That should tell you what to put in the path, something along the lines of C:\Users\admin\AppData\Roaming\daml\bin. Note that the Windows build is not yet fully functional.

Caching: build speed and disk space considerations

Bazel has a lot of nice properties, but they come at the cost of frequently rebuilding "the world". To make that bearable, we make extensive use of caching. Most artifacts should be cached in our CDN, which is configured in .bazelrc in this project.

However, even then, you may end up spending a lot of time (and bandwidth!) downloading artifacts from the CDN. To alleviate that, by default, our build will create a subfolder .bazel-cache in this project and keep an on-disk cache. This can take about 10GB at the time of writing.

To disable the disk cache, remove the following lines:

build:linux --disk_cache=.bazel-cache
build:darwin --disk_cache=.bazel-cache

from the .bazelrc file.

If you work with multiple copies of this repository, you can point all of them to the same disk cache by overwriting these configs in either a .bazelrc.local file in each copy, or a ~/.bazelrc file in your home directory.

Shared memory segment issues

On macOS at least, it looks like our setup does not always properly close the resources PostgreSQL uses. After a number of test runs, you may encounter an error message along the lines of:

FATAL:  could not create shared memory segment: No space left on device
DETAIL:  Failed system call was shmget(key=5432001, size=56, 03600).
HINT:  This error does *not* mean that you have run out of disk space. It occurs either if all available shared memory IDs have been taken, in which case you need to raise the SHMMNI parameter in your kernel, or because the system's overall limit for shared memory has been reached.
        The PostgreSQL documentation contains more information about shared memory configuration.
child process exited with exit code 1

In this case, this is a memory leak, so increasing SHMNI (or SHMALL etc.) as suggested will only delay the issue. You can look at the existing shared memory segments on your system by running ipcs -mcopt; this will print a line per segment, indicating the process ID of the last process to connect to the segment as well as the last access time and the number of currently connected processes.

If you identify segments with no connected processes, and you are confident you can remove them, you can do so with ipcrm $sid, where $sid is the process ID displayed (as the second column) by ipcs. Not many macOS applications use shared memory segments; if you have verified that all the existing memory segments on your machine need to be deleted, e.g. because they have all been created by PostgreSQL instances that are no longer running, here is a Bash invocation you can use to remove all shared memory segments from your system.

This is a dangerous command. Make sure you understand what it does before running it.

for shmid in $(ipcs -m | sed 1,3d | awk '{print $2}' | sed '$d'); do ipcrm -m $shmid; done

Haskell profiling builds

To build Haskell executables with profiling enabled, pass -c dbg to Bazel, e.g. bazel build -c dbg damlc. If you want to build the whole SDK with profiling enabled use daml-sdk-head --profiling.