1
1
mirror of https://github.com/kanaka/mal.git synced 2024-11-13 11:23:59 +03:00
mal - Make a Lisp
Go to file
2015-08-06 15:47:39 -05:00
bash All: move metadata, atoms, readline, conj to stepA. 2015-03-14 17:17:14 -05:00
c C: fix history function with libedit-2 2015-07-23 14:01:34 -05:00
clojure Tests: add testing Dockerfile. Impl fixes. 2015-03-11 22:22:35 -05:00
coffee Require correct node_readline file 2015-04-08 20:27:45 -05:00
cpp C++: add Makefile stats targets. 2015-03-28 11:53:30 -05:00
crystal Crystal: fix full stats. 2015-06-03 12:59:50 -05:00
cs C#: fix arguments handling 2015-07-22 03:37:53 +09:00
docs FAQ: clarify about competing/overlapping implementations. 2015-03-28 12:11:44 -05:00
erlang Step A: mutation, interop, self hosting 2015-04-04 09:15:20 -07:00
es6 README.md count to 38. JS and ES6 build fixes. 2015-08-06 15:47:39 -05:00
factor/src factor: add time-ms, perf tests work 2015-04-02 15:55:47 -04:00
forth All: rename stepA_interop to stepA_mal 2015-02-28 11:09:54 -06:00
fsharp fsharp: stepA: All self host tests now pass. 2015-07-05 21:13:38 -05:00
go All: move metadata, atoms, readline, conj to stepA. 2015-03-14 17:17:14 -05:00
groovy Add groovy implementation. 2015-05-18 19:54:18 -07:00
guile guile: perf tests OK 2015-04-07 05:13:11 +08:00
haskell All: move metadata, atoms, readline, conj to stepA. 2015-03-14 17:17:14 -05:00
java runtest: set pty size to fix readline of long lines. 2015-03-18 13:08:08 -05:00
js README.md count to 38. JS and ES6 build fixes. 2015-08-06 15:47:39 -05:00
julia Julia: missed Makefile for stats. 2015-03-31 23:12:25 -05:00
lua Merge pull request #79 from kariya-mitsuru/lua-improve-metasupport 2015-07-22 11:56:55 -05:00
make All: move metadata, atoms, readline, conj to stepA. 2015-03-14 17:17:14 -05:00
mal RPython: step1 basics 2015-06-11 09:33:07 -05:00
matlab RPython: step1 basics 2015-06-11 09:33:07 -05:00
miniMAL All step0: add test, fix bugs, remove step0 eval. 2015-03-07 09:04:07 -06:00
nim Make Nim implementation a bit nicer 2015-04-09 19:09:55 +02:00
ocaml ocaml: fix empty? on vectors. 2015-03-02 13:41:27 -06:00
perl perl: add meta support for builtin function 2015-07-21 17:35:17 +09:00
php All: move metadata, atoms, readline, conj to stepA. 2015-03-14 17:17:14 -05:00
process guide: fix missing escape and typo 2015-06-04 14:02:26 +09:00
ps runtest: set pty size to fix readline of long lines. 2015-03-18 13:08:08 -05:00
python ES6: step0 and step1 basics. 2015-07-30 21:15:55 -05:00
r All: move metadata, atoms, readline, conj to stepA. 2015-03-14 17:17:14 -05:00
racket racket: fix apply/vector 2015-03-22 14:43:26 -05:00
rpython RPython: replace asserts with conditionals. 2015-06-11 09:33:12 -05:00
ruby Tests: add testing Dockerfile. Impl fixes. 2015-03-11 22:22:35 -05:00
rust Revert "Revert "Replace pcre with Rust-implemented regex crate (based on RE2)."" 2015-03-05 23:22:56 -06:00
scala All: move metadata, atoms, readline, conj to stepA. 2015-03-14 17:17:14 -05:00
swift Convert to Swift 1.2: 2015-04-08 14:38:22 -07:00
tests Add groovy implementation. 2015-05-18 19:54:18 -07:00
vb Correct typo 2015-03-10 08:15:33 -04:00
.gitignore ES6: step0 and step1 basics. 2015-07-30 21:15:55 -05:00
.gitmodules JS: switch from josh.js console to jqconsole. 2014-04-26 14:19:49 -05:00
core.mal rust: add step8_macros 2015-01-06 21:58:59 -06:00
LICENSE Rename LICENSE file so it's picked up by github. 2015-03-09 14:20:30 -05:00
Makefile ES6: step0 and step1 basics. 2015-07-30 21:15:55 -05:00
mal.html JS: add localStorage history load/save. Slurp using sync XHR. 2014-04-27 16:55:31 -05:00
perf.mal Add long running perf test. 2015-02-28 10:38:17 -06:00
README.md README.md count to 38. JS and ES6 build fixes. 2015-08-06 15:47:39 -05:00
runtest-old.py runtest.py: order of magnitude faster. 2015-02-28 15:41:18 -06:00
runtest.py runtest.py: allow repeated form in output. 2015-03-20 08:40:46 -05:00

mal - Make a Lisp

Description

Mal is a Clojure inspired Lisp interpreter.

Mal is implemented in 38 different languages:

  • Bash shell
  • C
  • C++
  • C#
  • Clojure
  • CoffeeScript
  • Crystal
  • ES6 (ECMAScript 6 / ECMAScript 2015)
  • Erlang
  • F#
  • Factor
  • Forth
  • Go
  • Groovy
  • GNU Guile
  • Haskell
  • Java
  • JavaScript (Online Demo)
  • Julia
  • Lua
  • GNU Make
  • mal itself
  • MATLAB
  • miniMAL
  • Nim
  • OCaml
  • Perl
  • PHP
  • Postscript
  • Python
  • RPython
  • R
  • Racket
  • Ruby
  • Rust
  • Scala
  • Swift
  • Visual Basic.NET

Mal is a learning tool. See the make-a-lisp process guide. Each implementation of mal is separated into 11 incremental, self-contained (and testable) steps that demonstrate core concepts of Lisp. The last step is capable of self-hosting (running the mal implementation of mal).

The mal (make a lisp) steps are:

Mal was presented publicly for the first time in a lightning talk at Clojure West 2014 (unfortunately there is no video). See mal/clojurewest2014.mal for the presentation that was given at the conference (yes the presentation is a mal program).

If you are interesting in creating a mal implementation (or just interested in using mal for something), please drop by the #mal channel on freenode. In addition to the make-a-lisp process guide there is also a mal/make-a-lisp FAQ where I attempt to answer some common questions.

Building/running implementations

Bash 4

cd bash
bash stepX_YYY.sh

C

The C implementation of mal requires the following libraries (lib and header packages): glib, libffi6 and either the libedit or GNU readline library.

cd c
make
./stepX_YYY

C++

The C++ implementation was created by Stephen Thirlwall (sdt)

The C++ implementation of mal requires g++-4.9 or clang++-3.5 and a readline compatible library to build. See the cpp/README.md for more details:

cd cpp
make
    # OR
make CXX=clang++-3.5
./stepX_YYY

C#

The C# implementation of mal has been tested on Linux using the Mono C# compiler (mcs) and the Mono runtime (version 2.10.8.1). Both are required to build and run the C# implementation.

cd cs
make
mono ./stepX_YYY.exe

Clojure

cd clojure
lein with-profile +stepX trampoline run

CoffeeScript

sudo npm install -g coffee-script
cd coffee
coffee ./stepX_YYY

Crystal

The Crystal implementation of mal was created by Linda_pp

The Crystal implemenation of mal has been tested with Crystal 0.7.2.

cd crystal
crystal run ./stepX_YYY.cr
    # OR
make   # needed to run tests
./stepX_YYY

ES6 (ECMAScript 6 / ECMAScript 2015)

The ES6 implementation uses the babel compiler to generate ES5 compatible JavaScript. The generated code has been tested with Node 0.12.4.

cd es6
make
node build/stepX_YYY.js

Erlang

The Erlang implementation was created by Nathan Fiedler (nlfiedler)

The Erlang implementation of mal requires Erlang/OTP R17 and rebar to build.

cd erlang
make
    # OR
MAL_STEP=stepX_YYY rebar compile escriptize # build individual step
./stepX_YYY

F#

The F# implementation was created by Peter Stephens (pstephens)

The F# implementation of mal has been tested on Linux using the Mono F# compiler (fsharpc) and the Mono runtime (version 3.12.1). The mono C# compiler (mcs) is also necessary to compile the readline dependency. All are required to build and run the F# implementation.

cd fsharp
make
mono ./stepX_YYY.exe

Factor

The Factor implementation was created by Jordan Lewis (jordanlewis)

The Factor implementation of mal has been tested with Factor 0.97 (factorcode.org).

cd factor
FACTOR_ROOTS=src factor -run=stepX_YYY

Forth

The Forth implementation was created by Chris Houser (chouser)

cd forth
gforth stepX_YYY.fs

Go

The Go implementation of mal requires that go is installed on on the path. The implementation has been tested with Go 1.3.1.

cd go
make
./stepX_YYY

Groovy

The Groovy implementation of mal requires Groovy to run and has been tested with Groovy 1.8.6.

cd groovy
make
groovy ./stepX_YYY.groovy

GNU Guile 2.1+

The Guile implementation was created by Mu Lei (NalaGinrut).

cd guile
guile -L ./ stepX_YYY.scm

Haskell

Install the Haskell compiler (ghc/ghci), the Haskell platform and either the editline package (BSD) or the readline package (GPL). On Ubuntu these packages are: ghc, haskell-platform, libghc-readline-dev/libghc-editline-dev

cd haskell
make
./stepX_YYY

Java 1.7

The Java implementation of mal requires maven2 to build.

cd java
mvn compile
mvn -quiet exec:java -Dexec.mainClass=mal.stepX_YYY
    # OR
mvn -quiet exec:java -Dexec.mainClass=mal.stepX_YYY -Dexec.args="CMDLINE_ARGS"

JavaScript/Node

cd js
npm update
node stepX_YYY.js

Julia

The Julia implementation of mal has been tested with Julia 0.3.7.

cd julia
julia stepX_YYY.jl

Lua

Running the Lua implementation of mal requires lua 5.1 or later, luarocks and the lua-rex-pcre library installed.

cd lua
make  # to build and link linenoise.so
./stepX_YYY.lua

Mal

Running the mal implementation of mal involves running stepA of one of the other implementations and passing the mal step to run as a command line argument.

cd IMPL
IMPL_STEPA_CMD ../mal/stepX_YYY.mal

GNU Make 3.81

cd make
make -f stepX_YYY.mk

Nim 0.11.0

The Nim implementation was created by Dennis Felsing (def-)

Running the Nim implementation of mal requires Nim 0.11.0 or later.

cd nim
make
  # OR
nimble build
./stepX_YYY

OCaml 4.01.0

The OCaml implementation was created by Chris Houser (chouser)

cd ocaml
make
./stepX_YYY

MATLAB

The MATLAB implementation of mal has been tested with MATLAB version R2014a on Linux. Note that MATLAB is a commercial product. It should be fairly simple to support GNU Octave once it support classdef object syntax.

cd matlab
./stepX_YYY
matlab -nodisplay -nosplash -nodesktop -nojvm -r "stepX_YYY();quit;"
    # OR with command line arguments
matlab -nodisplay -nosplash -nodesktop -nojvm -r "stepX_YYY('arg1','arg2');quit;"

miniMAL

miniMAL is small Lisp interpreter implemented in less than 1024 bytes of JavaScript. To run the miniMAL implementation of mal you need to download/install the miniMAL interpreter (which requires Node.js).

cd miniMAL
# Download miniMAL and dependencies
npm install
export PATH=`pwd`/node_modules/minimal-lisp/:$PATH
# Now run mal implementation in miniMAL
miniMAL ./stepX_YYY

Perl 5.8

For readline line editing support, install Term::ReadLine::Perl or Term::ReadLine::Gnu from CPAN.

cd perl
perl stepX_YYY.pl

PHP 5.3

The PHP implementation of mal requires the php command line interface to run.

cd php
php stepX_YYY.php

Postscript Level 2/3

The Postscript implementation of mal requires ghostscript to run. It has been tested with ghostscript 9.10.

cd ps
gs -q -dNODISPLAY -I./ stepX_YYY.ps

Python (2.X or 3.X)

cd python
python stepX_YYY.py

RPython

You must have rpython on your path (included with pypy).

cd rpython
make        # this takes a long time
./stepX_YYY

R

The R implementation of mal requires R (r-base-core) to run.

cd r
make libs  # to download and build rdyncall
Rscript stepX_YYY.r

Racket (5.3)

The Racket implementation of mal requires the Racket compiler/interpreter to run.

cd racket
./stepX_YYY.rkt

Ruby (1.9+)

cd ruby
ruby stepX_YYY.rb

Rust (1.0.0 nightly)

The rust implementation of mal requires the rust compiler and build tool (cargo) to build.

cd rust
cargo run --release --bin stepX_YYY

Scala

Install scala and sbt (http://www.scala-sbt.org/0.13/tutorial/Installing-sbt-on-Linux.html):

cd scala
sbt 'run-main stepX_YYY'
    # OR
sbt compile
scala -classpath target/scala*/classes stepX_YYY

Swift

The Swift implementation was created by Keith Rollin

The Swift implemenation of mal requires the Swift 1.2 compiler (XCode 6.3) to build.

cd swift
make
./stepX_YYY

Visual Basic.NET

The VB.NET implementation of mal has been tested on Linux using the Mono VB compiler (vbnc) and the Mono runtime (version 2.10.8.1). Both are required to build and run the VB.NET implementation.

cd vb
make
mono ./stepX_YYY.exe

Running tests

Functional tests

The are nearly 500 generic functional tests (for all implementations) in the tests/ directory. Each step has a corresponding test file containing tests specific to that step. The runtest.py test harness launches a Mal step implementation and then feeds the tests one at a time to the implementation and compares the output/return value to the expected output/return value.

To simplify the process of running tests, a top level Makefile is provided with convenient test targets.

  • To run all the tests across all implementations (be prepared to wait):
make test
  • To run all tests against a single implementation:
make test^IMPL

# e.g.
make test^clojure
make test^js
  • To run tests for a single step against all implementations:
make test^stepX

# e.g.
make test^step2
make test^step7
  • To run tests for a specifc step against a single implementation:
make test^IMPL^stepX

# e.g
make test^ruby^step3
make test^ps^step4

Self-hosted functional tests

  • To run the functional tests in self-hosted mode, you specify mal as the test implementation and use the MAL_IMPL make variable to change the underlying host language (default is JavaScript):
make MAL_IMPL=IMPL test^mal^step2

# e.g.
make test^mal^step2   # js is default
make MAL_IMPL=ruby test^mal^step2
make MAL_IMPL=python test^mal^step2

Performance tests

Warning: These performance tests are neither statistically valid nor comprehensive; runtime performance is a not a primary goal of mal. If you draw any serious conclusions from these performance tests, then please contact me about some amazing oceanfront property in Kansas that I'm willing to sell you for cheap.

  • To run performance tests against a single implementation:
make perf^IMPL

# e.g.
make perf^js
  • To run performance tests against all implementations:
make perf

Generating language statistics

  • To report line and byte stastics for a single implementation:
make stats^IMPL

# e.g.
make stats^js
  • To report line and bytes stastics for general Lisp code (env, core and stepA):
make stats-lisp^IMPL

# e.g.
make stats-lisp^js

Docker test environment

There is a Dockerfile included in the tests/docker directory that builds a docker image based on Ubuntu Utopic that contains everything needed to run tests against all the implementations (except for MATLAB which is proprietary/licensed).

Build the the docker image using a provided script. WARNING: this will likely take over an hour to build from scratch and use more 3 GB of disk:

./tests/docker-build.sh

Launch a docker container from that image built above. This will volume mount the mal directory to /mal and then give you a bash prompt in the container. You can then run individual mal implementations and tests:

./tests/docker-run.sh

You can also specify a command to run within the container. For example, to run step2 tests for every implementation (except MATLAB):

./tests/docker-run.sh make SKIP_IMPLS="matlab" test^step2

Notes:

  • JVM-based language implementations (Java, Clojure, Scala): you will need to run these implementations once manually first before you can run tests because runtime dependencies need to be downloaded to avoid the tests timing out. These dependencies are download to dot-files in the /mal directory so they will persist between runs.
  • Compiled languages: if your host system is different enough from Ubuntu Utopic then you may need to re-compile your compiled languages from within the container to avoid linker version mismatches.

License

Mal (make-a-lisp) is licensed under the MPL 2.0 (Mozilla Public License 2.0). See LICENSE.txt for more details.