The Daml smart contract language
Go to file
Martin Huschenbett 68e4453324 Intern all strings and dotted names in the DAML-LF protobuf encoding (#3067)
* Intern all strings and dotted names in the DAML-LF protobuf encoding

On one of our huge DAML code bases this has brought down the size of the
DALF by 60% and cut the memory usage during decoding by 50%.

The `@QUERY-LF` tests in the damlc integration tests check that the
interning actually works.

* Add scala decoder support for interned strings

* Memoize versionisOlderThan. Speeds up decoding by 6x.

* Properly fix the performance problem with version ordering

LanguageVersion.ordering was a `def` and not `val` causing us to
recreate the ordering tables every time.

* Clean up //daml-lf/archive:decode-test

* Use int32 for interning indices

* Adapt QUERY-LF tests

* Strip a few useless field_ prefixes

* Add test for uniqueness in interning tables

* Drop field_ prefix from jq queries

* Fix Scala encoder

* Fix bond-trading tests

* Rename decode-test to decode-tester

* Address @cocreature's comments

* daml-lf: proper versioning for reading internedStrings

* daml-lf repl: revert change
2019-10-04 11:26:31 +00:00
.github Include change management checkbox in PR template (#2318) 2019-07-31 17:36:00 +02:00
.vscode open-sourcing daml 2019-04-04 09:33:38 +01:00
3rdparty Multi participant node named logging (#2647) (#3080) 2019-10-03 18:20:57 +02:00
bazel_tools Remove duplicate hie-bios patch (#2948) 2019-09-18 11:58:37 +02:00
build-scripts update copyright notices (#2499) 2019-08-13 17:23:03 +01:00
ci update copyright notices (#2499) 2019-08-13 17:23:03 +01:00
compiler Intern all strings and dotted names in the DAML-LF protobuf encoding (#3067) 2019-10-04 11:26:31 +00:00
daml-assistant Bundle packages with SDK releases (#3056) 2019-09-30 09:15:11 +00:00
daml-lf Intern all strings and dotted names in the DAML-LF protobuf encoding (#3067) 2019-10-04 11:26:31 +00:00
dev-env dev-env: remove gradle (#2738) 2019-09-04 17:44:51 +01:00
docs Release 0.13.28 (#3109) 2019-10-04 10:03:09 +00:00
extractor extractor: enable numeric for multi table data format (#2977) 2019-09-24 11:42:15 +02:00
ghc-lib Desugar template instances to type synonyms instead of newtypes (#3013) 2019-09-26 14:05:47 -04:00
hazel Bump stackage (#2588) 2019-08-19 13:31:10 +02:00
infra fix hoogle; revert cache buckets ACL changes (#3062) 2019-09-27 15:42:31 +01:00
language-support Multi participant node named logging (#2647) (#3080) 2019-10-03 18:20:57 +02:00
ledger Ledger api server fixes to persist divulged, otherwise unknown contracts #2946 (#3101) 2019-10-04 11:25:50 +02:00
ledger-api Improve docs on uniqueness constraint for command_ids (#3078) 2019-10-01 16:14:11 +02:00
ledger-service Renaming "active" -> "created" (#3064) 2019-09-27 19:07:24 +00:00
libs-haskell Fix getSrcRoot for A/B.daml (#2989) 2019-09-24 00:31:52 +00:00
navigator Daml-LF: make Numeric scale type safe (#2958) 2019-09-18 19:33:52 +00:00
nix dev-env: remove gradle (#2738) 2019-09-04 17:44:51 +01:00
notices-gen Rename hazel_deps to hackage_deps (#2789) 2019-09-06 09:01:09 +00:00
oss-compliance update copyright notices (#2499) 2019-08-13 17:23:03 +01:00
release Bundle trigger runner in SDK (#3069) 2019-09-30 11:52:20 +02:00
replacements update copyright notices (#2499) 2019-08-13 17:23:03 +01:00
rules_daml Implement AnyTemplate in DAML (#2947) 2019-09-19 08:42:55 +00:00
scala-protoc-plugins update copyright notices (#2499) 2019-08-13 17:23:03 +01:00
templates Fixing quickstart-scala example and doc (#2901) 2019-09-16 12:44:04 +00:00
triggers Make the DAML trigger tests more generic (#3096) 2019-10-04 10:59:02 +02:00
.bazelignore open-sourcing daml 2019-04-04 09:33:38 +01:00
.bazelrc Default to -c opt in Bazel (#2592) 2019-08-19 17:10:30 +02:00
.dadew Fix curl on Windows (#2643) 2019-08-23 07:48:48 +00:00
.dockerignore open-sourcing daml 2019-04-04 09:33:38 +01:00
.envrc open-sourcing daml 2019-04-04 09:33:38 +01:00
.gitattributes Follow up with .gitattributes on #1762 (#1770) 2019-06-19 15:29:13 +00:00
.gitignore Hlb update and document external build steps (#2769) 2019-09-09 14:37:03 +01:00
.hie-bios hie-bios: Don't hard-code import-dirs (#2562) 2019-08-15 16:08:35 +00:00
.hlint.yaml #2326, GHC 8.4 compatibility (#2796) 2019-09-07 16:23:14 +02:00
.mergify.yml Rename automerge-dangerous-but-faster to automerge (#1605) 2019-06-12 08:37:07 -04:00
.scalafmt.conf open-sourcing daml 2019-04-04 09:33:38 +01:00
.watchmanconfig open-sourcing daml 2019-04-04 09:33:38 +01:00
azure-cron.yml sign releases (#2968) 2019-09-24 12:02:29 +01:00
azure-pipelines.yml restore full has_release check (#2967) 2019-09-26 15:10:25 +01:00
BAZEL-bash.md add Bazel bash help (#2223) 2019-07-19 15:31:45 +00:00
BAZEL-haskell.md bazel-docs: Replace references to DACH-NY repo (#2655) 2019-08-26 08:50:11 +00:00
BAZEL-JVM.md bazel-docs: Replace references to DACH-NY repo (#2655) 2019-08-26 08:50:11 +00:00
BAZEL.md Document how to avoid using Bazel remote cache (#2955) 2019-09-18 12:25:00 +00:00
BUILD Get ghcide from the new upstream repo (#2867) 2019-09-11 08:57:48 +02:00
build.ps1 windows: root build (#1894) 2019-06-28 12:55:31 +02:00
build.sh Bump ghcide (#3083) 2019-10-02 13:08:07 +00:00
CHANGELOG Move unreleased user-facing features to its own file (#1762) 2019-06-19 16:32:03 +02:00
CODE_OF_CONDUCT.md open-sourcing daml 2019-04-04 09:33:38 +01:00
CODEOWNERS New Ledger API test tool (#2282) 2019-08-09 17:00:37 +02:00
CONTRIBUTING.md Minor Docs fixes (#2277) 2019-07-25 16:02:42 +02:00
COPY update copyright notices (#2499) 2019-08-13 17:23:03 +01:00
daml-logo.png #2785 add daml_logo.png for README (#2787) 2019-09-06 09:35:32 +02:00
dependencies.yaml Multi participant node named logging (#2647) (#3080) 2019-10-03 18:20:57 +02:00
deps.bzl Use cc_wrapper to shorten library and include paths and rpaths (#2791) 2019-09-09 15:50:51 +00:00
dotfiles open-sourcing daml 2019-04-04 09:33:38 +01:00
fmt.sh update copyright notices (#2499) 2019-08-13 17:23:03 +01:00
LICENSE Include Digital Asset Copyright in LICENSE file (#1022) 2019-05-08 14:35:21 -04:00
NOTICES open-sourcing daml 2019-04-04 09:33:38 +01:00
package.json Rename dummy package to prevent wrong interpretation (#2920) 2019-09-16 15:53:23 +00:00
README.md Minor Docs fixes (#2277) 2019-07-25 16:02:42 +02:00
scalafmt.sh update copyright notices (#2499) 2019-08-13 17:23:03 +01:00
SECURITY.md Create SECURITY.md (#1357) 2019-05-31 08:58:21 +01:00
tsconfig.json open-sourcing daml 2019-04-04 09:33:38 +01:00
unreleased.rst Release 0.13.28 (#3109) 2019-10-04 10:03:09 +00:00
Upgrading.md Switch to nixpkgs-unstable (#1921) 2019-06-27 18:47:42 +02:00
util.bzl Update ghc-lib (v8.8.1.20190830) (#2716) 2019-08-30 21:58:23 +00:00
VERSION Release 0.13.28 (#3109) 2019-10-04 10:03:09 +00:00
WORKSPACE Avoid normalizing include dirs (#3103) 2019-10-04 10:41:44 +02:00
yarn.lock Bump mixin-deep from 1.3.1 to 1.3.2 (#2822) 2019-09-09 18:02:54 +00:00

DAML logo

Download License Build

Copyright 2019 Digital Asset (Switzerland) GmbH and/or its affiliates. All Rights Reserved. SPDX-License-Identifier: Apache-2.0

Welcome to the DAML repository!

This repository hosts all code for the DAML smart contract language and SDK, originally created by Digital Asset. DAML is an open-source smart contract language for building future-proof distributed applications on a safe, privacy-aware runtime. The DAML SDK is a set of tools to help you develop applications based on DAML.

Using DAML

To download DAML, follow the installation instructions. Once installed, to try it out, follow the quickstart guide.

If you have questions about how to use DAML or how to build DAML-based solutions, please ask them on StackOverflow using the daml tag.

Contributing to DAML

We warmly welcome contributions. If you are looking for ideas on how to contribute, please browse our issues. To build and test DAML:

1. Clone this repository

git clone git@github.com:digital-asset/daml.git
cd daml

2. Set up the development dependencies

Our builds require various development dependencies (e.g. Java, Bazel, Python), provided by a tool called dev-env.

Linux and Mac

On Linux and Mac dev-env can be installed with:

  1. Install Nix by running: bash <(curl https://nixos.org/nix/install)
  2. Enter dev-env by running: eval "$(dev-env/bin/dade assist)"

If you don't want to enter dev-env manually each time using eval "$(dev-env/bin/dade assist)", you can also install direnv. This repo already provides a .envrc file, with an option to add more in a .envrc.private file.

Windows

On Windows you need to enable long file paths by running the following command in an admin powershell:

Set-ItemProperty -Path 'HKLM:\SYSTEM\CurrentControlSet\Control\FileSystem' -Name LongPathsEnabled -Type DWord -Value 1

Then start dev-env from PowerShell with:

.\dev-env\windows\bin\dadew.ps1 install
.\dev-env\windows\bin\dadew.ps1 sync
.\dev-env\windows\bin\dadew.ps1 enable

In all new PowerShell processes started, you need to repeat the enable step.

3. First build and test

We have a single script to build most targets and run the tests. On Linux and Mac run ./build.sh. On Windows run .\build.ps1. Note that these scripts may take over an hour the first time.

To just build do bazel build //..., and to just test do bazel test //.... To read more about Bazel and how to use it, see the Bazel site.

On Mac if building is causing trouble complaining about missing nix packages, you can try first running nix-build -A tools -A cached nix repeatedly until it completes without error.

4. Installing a local copy

On Linux and Mac run daml-sdk-head which installs a version of the SDK with version number 0.0.0. Set the version: field in any DAML project to 0.0.0 and it will use the locally installed one.

On Windows:

bazel build //release:sdk-release-tarball
tar -vxf .\bazel-genfiles\release\sdk-release-tarball.tar.gz
cd sdk-*
daml\daml.exe install . --activate

That should tell you what to put in the path, something along the lines of C:\Users\admin\AppData\Roaming\daml\bin. Note that the Windows build is not yet fully functional.

Caching: build speed and disk space considerations

Bazel has a lot of nice properties, but they come at the cost of frequently rebuilding "the world". To make that bearable, we make extensive use of caching. Most artifacts should be cached in our CDN, which is configured in .bazelrc in this project.

However, even then, you may end up spending a lot of time (and bandwidth!) downloading artifacts from the CDN. To alleviate that, by default, our build will create a subfolder .bazel-cache in this project and keep an on-disk cache. This can take about 10GB at the time of writing.

To disable the disk cache, remove the following lines:

build:linux --disk_cache=.bazel-cache
build:darwin --disk_cache=.bazel-cache

from the .bazelrc file.

If you work with multiple copies of this repository, you can point all of them to the same disk cache by overwriting these configs in either a .bazelrc.local file in each copy, or a ~/.bazelrc file in your home directory.

Haskell profiling builds

To build Haskell executables with profiling enabled, pass -c dbg to Bazel, e.g. bazel build -c dbg damlc. If you want to build the whole SDK with profiling enabled use daml-sdk-head --profiling.