1
1
mirror of https://github.com/tweag/nickel.git synced 2024-11-09 15:54:52 +03:00
Better configuration for less
Go to file
2021-08-31 17:16:26 +02:00
.github Restore CI builds 2021-08-30 15:49:45 +02:00
examples unkown -> unknown 2021-07-05 17:27:54 +02:00
makam-spec nixify circleci jobs and run them with github actions 2021-01-24 11:18:00 +01:00
notes Save the review of the error reporting libs 2020-07-16 17:27:42 +02:00
scripts Update nightly Rust channel [ci skip] 2021-08-31 01:39:35 +00:00
src change MergeContract to a 3-ary strict op 2021-08-31 17:16:26 +02:00
stdlib Change documentation style for some functions 2021-08-30 13:51:05 +02:00
tests Check closedness of record contracts 2021-08-31 17:16:26 +02:00
website Upgrade the WASM repl 2021-07-13 10:40:47 +02:00
.gitignore add the npm package to gitignore 2021-08-30 15:27:51 +02:00
build.rs Implement clippy recommandations 2021-02-05 17:47:48 +01:00
Cargo.lock Update LALRPOP version 2021-08-31 17:05:25 +02:00
Cargo.toml Update LALRPOP version 2021-08-31 17:05:25 +02:00
default.nix use nixpkgs-mozilla and provide a way to build on different channels 2021-01-15 14:16:59 +01:00
flake.lock nixify circleci jobs and run them with github actions 2021-01-24 11:18:00 +01:00
flake.nix Fix macOS build (missing libiconv) 2021-08-26 10:30:02 +02:00
LICENSE Set the license to Tweag's MIT 2020-08-10 09:54:03 +02:00
RATIONALE.md Update RATIONALE.md 2020-11-13 16:02:36 +00:00
README.md shell -> console 2021-08-23 13:56:25 +02:00
shell.nix Add flake.nix 2020-07-03 14:22:21 +02:00

Nickel

Continuous integration

Nickel is the cheap configuration language.

Its purpose is to automate the generation of static configuration files - think JSON, YAML, XML, or your favorite data representation language - that are then fed to another system. It is designed to have a simple, well-understood core: it is in essence JSON with functions.

Nickel's salient traits are:

  • Lightweight: Nickel is easy to embed. An interpreter should be simple to implement. The reference interpreter can be called from many programming languages.
  • Composable code: the basic building blocks for computing are functions. They are first-class citizens, which can be passed around, called and composed.
  • Composable data: the basic building blocks for data are records (called objects in JSON). In Nickel, records can be merged at will, including associated metadata (documentation, default values, type contracts, etc).
  • Typed, but only when it helps: static types improve code quality, serve as documentation and eliminate bugs early. But application-specific self-contained code will always evaluate to the same value, so type errors will show up at runtime anyway. Some JSON is hard to type. There, types are only a burden. Whereas reusable code - that is, functions - is evaluated on potentially infinitely many different inputs, and is impossible to test exhaustively. There, types are precious. Nickel has types, but you get to chose when you want it or not, and it handles safely the interaction between the typed and the untyped world.
  • Design by contract: complementary to the type system, contracts are a principled approach to checking assertions. The interpreter automatically inserts assertions at the boundary between typed and untyped code. Nickel lets users add arbitrary assertions of their own and easily understand why when assertions fail.

The motto guiding Nickel's design is:

Great defaults, design for extensibility

There should be a standard, clear path for common things. There should be no arbitrary restrictions that limit what you can do you the one day you need to go beyond.

Use cases

Nickel is a good fit is any situation where you need to generate a complex configuration, be it for a single app, a machine, whole infrastructure, or a build system.

The motivating use cases are in particular:

  • The Nix package manager: Nix is a declarative package manager using its own language for specifying packages. Nickel is an evolution of the Nix language, while trying to overcome some of its limitations.
  • Infrastructure as code: infrastructure is becoming increasingly complex, requiring a rigorous approach to deployment, modification and configuration. This is where a declarative approach also shines, as adopted by Terraform, NixOps or Kubernetes, all requiring potentially complex generation of configuration.
  • Build systems: build systems (like Bazel) need a specification of the dependency graph.

Most aforementioned projects have their own bespoke configuration language. See Related projects and inspirations. In general, application-specific languages might suffer from feature creep, lack of abstractions or just feel ad hoc. Nickel buys you more for less.

Getting started

Run

  1. Start Nickel

    • with flake-enabled Nix directly with nix run nickel (which pulls it from the global flakes registry), or with nix run github:tweag/nickel (which pulls it from the repo). You pass in arguments with an extra -- as in nix run nickel -- repl,
    • with ./nickel, after building this repo, depending on the location of the executable and passing in arguments directly,
    • or with cargo run after building, passing in arguments with and extra -- as in cargo run -- -f program.ncl.
  2. Run your first program:

$ ./nickel <<< 'let x = 2 in x + x'
Typechecked: Ok(Types(Dyn))
Done: Num(4.0)

Or load it from a file:

$ echo 'let s = "world" in "Hello, " ++ s' > program.ncl
$ ./nickel -f program.ncl
Typechecked: Ok(Types(Dyn))
Done: Str("Hello, world")
  1. Start a REPL:
$ ./nickel repl
nickel> let x = 2 in x + x
nickel> x
4

nickel>

Use :help for a list of available commands.

  1. Export your configuration to JSON, YAML or TOML:
$ ./nickel export --format json <<< '{foo = "Hello, world!"}'
{
  "foo": "Hello, world!"
}

Use nickel help for a list of subcommands, and nickel help <subcommand> for help about a specific subcommand.

Build

  1. Download build dependencies:

    • With Nix: If you have Nix installed:
      $ nix-shell shell.nix
      
      to be dropped in a shell, ready to build.
    • Without Nix: otherwise, follow this guide to install Rust and Cargo first.
  2. Build Nickel:

    $ cargo build
    

    And voilà! Generated files are placed in target/debug.

  3. (optional) make a symbolic link to the executable:

$ ln -S nickel target/debug/nickel

Tests

$ cargo test

Documentation

  1. Build the doc:
$ cargo doc --no-deps
  1. Open the file target/doc/nickel/index.html in your browser.

Examples

You can find examples in the ./examples directory. Note that as the syntax is not yet fixed, and some basic helpers are missing, they may seem a bit alien currently.

Roadmap

The design is settled and implemented for the most part, but the final syntax and other important practical aspects are still being debated. We aim to transition from an experimental stage to a minimum viable product stage. The next points to deal with are:

  • Cue is a configuration language with a focus on data validation. It introduces a new constraint system backed by a solid theory which ensures strong guarantees about your code. It allows for very elegant schema specifications. In return, the cost to pay is to abandon functions and Turing-completeness. Nickel's merge system is inspired by the one of CUE, even if since Nickel does have general functions and is Turing-complete, they are necessarily different.
  • Nix: The Nix language, or Nix expressions, is one of the main inspirations for Nickel. It is a very simple yet powerful lazy functional language. We strive to retain this simplicity, while adding typing capabilities, modularity, and detaching the language from the Nix package manager.
  • Dhall is a statically typed configuration language. It is also inspired by Nix, to which it adds a powerful static type system. However, this forces the programmer to annotate all of their code with types.
  • Jsonnet is another language which could be dubbed as "JSON with functions" (and others things as well). It is a lazy functional language with object oriented features, among which inheritance is similar to Nickel's merge system. One big difference with Nickel is the absence of typing.
  • Pulumi is not a language in itself, but a cloud tool (like Terraform) where you can use your preferred language for describing your infrastructure. This is a different approach to the problem, with different trade-offs.
  • Starlark is the language of Bazel, which is a dialect of Python. It does not have types and recursion is forbidden, making it not Turing-complete.

See RATIONALE.md for the design rationale and a more detailed comparison with a selection of these languages.