enso/docs/distribution/distribution.md
Radosław Waśko e8e44f68ad
[Feat, Tool] Add CLI Parser for the Launcher
1.  This commit adds an extensive library for parsing commandline
    arguments and formatting output.
2.  It implements the expected CLI for the launcher.
3.  It turns off parallel execution on the CI in hopes of making it
    more stable.
4.  It implements plugin support in the launcher.
2020-07-22 19:28:03 +02:00

10 KiB
Raw Blame History

layout title category tags order
developer-doc The Enso Distribution distribution
distribution
layout
1

The Enso Distribution

This document provides a specification of how the Enso distribution should be structured and how it should behave.

Universal Launcher

The universal launcher should be able to launch the proper version of Enso executable based on the version specified in the project being run, or use the default version if none specified. It should also be able to launch other Enso components, provided as plugins.

This launcher is under development. Until it is in a ready-to-use state, the Enso version packages provide simple launcher scripts in the bin directory of that package. They are a temporary replacement for the launcher functionality, so once the universal launcher matures, they will be removed. The universal launcher will not call the components through these scripts, as it must have full control over which JVM is chosen and its parameters.

Enso Distribution Layout

Enso is distributed as a portable package that can be extracted anywhere on the system and run. It can also be installed for the local user into system-defined directories, as explained below.

Portable Enso Distribution Layout

All files in the directory structure, except for configuration, can be safely removed and the launcher will re-download them if needed.

The directory structure is as follows:

extraction-location
├── bin
│   └── enso                # The universal launcher, responsible for choosing the appropriate compiler version (TODO [RW] it may be stored in a different place).
├── config
│   └── global-config.yaml  # Global user configuration.
├── dist                    # Per-compiler-version distribution directories.
│   ├── 1.0.0               # A full distribution of given Enso version, described below.
│   │   └── <truncated>
│   └── 1.2.0               # A full distribution of given Enso version, described below.
│       └── <truncated>
├── runtime                 # A directory storing distributions of the JVM used by the Enso distributions.
│   └── graalvm-ce-27.1.1
├── lib
│   └── src                 # Contains sources of downloaded libraries.
│       └── Dataframe       # Each library may be stored in multiple version.
│           └── 1.7.0       # Each version contains a standard Enso package.
│               ├── package.yaml
│               └── src
│                   ├── List.enso
│                   ├── Number.enso
│                   └── Text.enso
├── resolvers               # Contains resolver specifications, described below.
│   ├── lts-1.56.7.yaml
│   └── lts-2.0.8.yaml
├── README.md               # Information on layout and usage of the Enso distribution.
├── .enso.portable          # A file that allows the universal launcher to detect that if it is run from this directory, it should run in portable distribution mode.
├── NOTICE                  # A copyright notice regarding components that are included in the distribution of the universal launcher.
└── components-licences     # Contains licences of distributed components, as described in the NOTICE.

Installed Enso Distribution Layout

After installation, the directory structure is following:

ENSO_DATA_DIRECTORY
├── dist                    # Per-compiler-version distribution directories.
│   ├── 1.0.0               # A full distribution of given Enso version, described below.
│   │   └── <truncated>
│   └── 1.2.0               # A full distribution of given Enso version, described below.
│       └── <truncated>
├── runtime                 # A directory storing (optional) distributions of the JVM used by the Enso distributions.
│   └── graalvm-ce-27.1.1
├── lib
│   └── src                 # Contains sources of downloaded libraries.
│       └── Dataframe       # Each library may be stored in multiple version.
│           └── 1.7.0       # Each version contains a standard Enso package.
│               ├── package.yaml
│               └── src
│                   ├── List.enso
│                   ├── Number.enso
│                   └── Text.enso
└── resolvers               # Contains resolver specifications, described below.
    ├── lts-1.56.7.yaml
    └── lts-2.0.8.yaml

ENSO_CONFIG_DIRECTORY
└── global-config.yaml      # Global user configuration.

ENSO_BIN_DIRECTORY
└── enso                    # The universal launcher, responsible for choosing the appropriate compiler version (TODO [RW] it may be stored in a different place).

Where ENSO_DATA_DIRECTORY, ENSO_CONFIG_DIRECTORY and ENSO_BIN_DIRECTORY are environment variables that define the directory structure. They can be used to override placement of the components listed above. However, most of the time they do not have to be set, as they use system-specific defaults.

If not set, each of these three environment variables defaults to the following value, depending on the system:

Linux macOS Windows
ENSO_DATA_DIRECTORY $XDG_DATA_HOME/enso/ which defaults to $HOME/.local/share/enso $HOME/Library/Application Support/org.enso/ %LocalAppData%/enso
ENSO_CONFIG_DIRECTORY $XDG_CONFIG_HOME/enso/ which defaults to $HOME/.config/enso $HOME/Library/Preferences/org.enso/ %LocalAppData%/enso/config
ENSO_BIN_DIRECTORY $XDG_BIN_HOME which defaults to $HOME/.local/bin $HOME/.local/bin %LocalAppData%/enso/bin

Installing from a Portable Distribution

After downloading and extracting the portable distribution, the user can run extraction-location/bin/enso install distribution to install it locally. This will copy the files from the portable distribution into the installed locations which are described above and then remove the original files.

On Linux and macOS, if ENSO_BIN_DIRECTORY (~/.local/bin by default) is not on system PATH, the installer will issue a warning, telling the user how they can add it. On Windows, the installer automatically adds ENSO_BIN_DIRECTORY to the user's PATH.

The installed distribution can be removed by running enso uninstall distribution.

Layout of an Enso Version Package

This section describes the structure of a single version distribution. This system is intended to be implemented first and used e.g. for the Enso nightly builds / releases.

Such a distribution can be used as a standalone version, assuming the required version of the JVM is installed and used.

The layout of such a distribution is as follows:

enso-1.0.0
├── manifest.yaml    # A manifest file defining metadata about this Enso version.
├── component        # Contains all the executable tools and their dependencies.
│   ├── runner.jar   # The main executable of the distribution. CLI entry point.
│   └── runtime.jar  # The language runtime. It is loaded by other JVM components, like the runner.
└── std-lib          # Contains all the libraries that are pre-installed within that compiler version.
    ├── Http         # Every version sub-directory is just an Enso package containing the library.
    │     ├── package.yaml
    │     ├── polyglot
    │     └── src
    │         ├── Http.enso
    │         └── Socket.enso
    └── Base
          ├── package.yaml
          └── src
              ├── List.enso
              ├── Number.enso
              └── Text.enso

Implementation Note: This structure makes use of deep nesting, which may give some with knowledge of Windows' path-name limits pause (windows paths are historically limited to 256 characters). However, there is no special action required to handle this limit as long as we are building on top of the JVM. The JVM automatically inserts the \\?\ prefix required to bypass the windows path length limit.

Standard Library

The standard library is a set of libraries shipped with the compiler. Whether a given package belongs to standard library can be a bit of an arbitrary choice, but the following are some guidelines:

  1. Fundamental packages basic collections and utilities should be a part of standard library.
  2. Packages relying on the compiler internals (e.g. the internal object representation). An example of such a package would be Generic, exposing reflective access to Enso objects.
  3. Packages that the compiler relies on, e.g. compile error definitions, stack traces etc.

Resolvers

Note This system is not implemented yet.

A resolver is a manifest containing library versions that are automatically available for import in any project using the resolver.

Example contents of a resolver file are as follows:

enso-version: 1.0.7
libraries:
  - name: Base
    version: 1.0.0
  - name: Http
    version: 5.3.5