Hybrid visual and textual functional programming.
Go to file
Jaroslav Tulach 2b9352d2fc
Lazy scatterplot for Vector & Table (#3655)
First of all this PR demonstrates how to implement _lazy visualization_:
- one needs to write/enhance Enso visualization libraries - this PR adds two optional parameters (`bounds` and `limit`) to `process_to_json_text` function.
- the `process_to_json_text` can be tested by standard Enso test harness which this PR also does
- then one has to modify JavaScript on the IDE side to construct `setPreprocessor` expression using the optional parameters

The idea of _scatter plot lazy visualization_ is to limit the amount of points the IDE requests. Initially the limit is set to `limit=1024`. The `Scatter_Plot.enso` then processes the data and selects/generates the `limit` subset. Right now it includes `min`, `max` in both `x`, `y` axis plus randomly chosen points up to the `limit`.

![Zooming In](https://user-images.githubusercontent.com/26887752/185336126-f4fbd914-7fd8-4f0b-8377-178095401f46.png)

The D3 visualization widget is capable of _zooming in_. When that happens the JavaScript widget composes new expression with `bounds` set to the newly visible area. By calling `setPreprocessor` the engine recomputes the visualization data, filters out any data outside of the `bounds` and selects another `limit` points from the new data. The IDE visualization then updates itself to display these more detailed data. Users can zoom-in to see the smallest detail where the number of points gets bellow `limit` or they can select _Fit all_ to see all the data without any `bounds`.

# Important Notes
Randomly selecting `limit` samples from the dataset may be misleading. Probably implementing _k-means clustering_ (where `k=limit`) would generate more representative approximation.
2022-08-23 12:12:22 +00:00
.cargo New IDE build script (#3466) 2022-05-23 04:16:04 +02:00
.github Code Signing on Windows (#3654) 2022-08-23 00:49:23 +02:00
actions/setup-build Bumped the build script (#3489) 2022-06-01 13:44:40 +02:00
app Lazy scatterplot for Vector & Table (#3655) 2022-08-23 12:12:22 +00:00
build Replace webpack with esbuild (#3592) 2022-08-10 03:41:44 +02:00
distribution Lazy scatterplot for Vector & Table (#3655) 2022-08-23 12:12:22 +00:00
docs Add type system documentation (#3376) 2022-08-15 18:36:03 +03:00
engine Increase library upload timeout in tests (#3649) 2022-08-15 12:40:46 +03:00
integration-test Hierarchical Action List vel Component List. (#3501) 2022-06-03 15:06:31 +00:00
lib Left align component browser to the edited node (#3636) 2022-08-09 23:03:54 +00:00
project Update Scala to 2.13.8 (#3631) 2022-08-08 19:32:55 +00:00
std-bits Add Vector.take and Vector.drop functions (#3629) 2022-08-10 16:02:02 +00:00
test Lazy scatterplot for Vector & Table (#3655) 2022-08-23 12:12:22 +00:00
tools Update apply-edit benchmark to use lazy visualization (#3642) 2022-08-15 07:11:51 +00:00
.gitignore Add Language Server benchmarking tool (#3578) 2022-07-22 14:12:52 +00:00
.ignore Refactoring: merge utils into prelude; merge workspaces. (#3151) 2021-11-10 14:36:08 +01:00
.jvmopts Bump scalac to 2.13.5 (#1531) 2021-03-01 16:35:57 +00:00
.prettierignore Grid View with Scrolling (#3588) 2022-07-19 08:39:23 +00:00
.prettierrc.yaml Bumped the build script (#3489) 2022-06-01 13:44:40 +02:00
.scalafmt.conf Bump SBT and Scalafmt (#1203) 2020-10-22 16:12:28 +02:00
build-config.yaml Virtual Entries in Component Browser (#3621) 2022-08-17 13:28:07 +00:00
build.sbt Support pattern matching on constants (#3641) 2022-08-12 13:18:58 +00:00
Cargo.lock Code Signing on Windows (#3654) 2022-08-23 00:49:23 +02:00
Cargo.toml JNI bindings for enso-parser (#3599) 2022-07-25 14:24:21 +00:00
CHANGELOG.md Lazy scatterplot for Vector & Table (#3655) 2022-08-23 12:12:22 +00:00
LICENSE Set up the repository (#1) 2019-06-11 17:07:54 +01:00
package.json Apply unified prettier style to engine codebase (#3145) 2021-11-08 16:45:29 +01:00
README.md Fix links to gui folder (#3190) 2021-12-12 23:43:25 +01:00
RELEASES.md Add API for component groups (#3286) 2022-02-24 15:41:14 +03:00
run Bumped the build script (#3489) 2022-06-01 13:44:40 +02:00
run.cmd Replace webpack with esbuild (#3592) 2022-08-10 03:41:44 +02:00
rust-toolchain.toml New IDE build script (#3466) 2022-05-23 04:16:04 +02:00
rustfmt.toml Profiling workflows (#3475) 2022-06-01 18:01:16 +00:00

Chat Actions Status Actions Status License License


Enso.org. Get insights you can rely on. In real time.

Enso is an award-winning interactive programming language with dual visual and textual representations. It is a tool that spans the entire stack, going from high-level visualisation and communication to the nitty-gritty of backend services, all in a single language. Watch the following introduction video to learn what Enso is, and how it helps companies build data workflows in minutes instead of weeks.


Screenshot 2021-04-15 at 12 16 32

Enso's Features

Turning your data into knowledge is slow and error-prone. You cant trust tools that dont embrace best practices and provide quality assurance. Enso redefines the way you can work with your data: it is interactive, provides intelligent assistance, and was designed on a strong mathematical foundation, so you can always trust the results you get.

      Intelligent suggestions of possible next steps. Build workflows in minutes instead of weeks.
      Enso analyses the data, suggests possible next steps, and displays related help and examples. It lets you build dashboards, RPA workflows, and apps, with no coding required. Enso ships with a robust set of libraries, allowing you to work with local files, databases, HTTP services and other applications in a seamless fashion.
      Learn more →
      Reproducible, trustworthy results.
      Versioning and visual data quality management allow you to trust the results that you get.
      Learn more →
      A powerful, purely functional language. Both visual and textual.
      Enso incorporates many recent innovations in data processing and programming language design to allow you to work interactively and trust the results that you get. It is a purely functional programming language with higher-order functions, user-defined algebraic datatypes, pattern-matching, and two equivalent representations that you can switch between on-demand.
      Learn more →
      Mix languages with close-to-zero interop overhead.
      Import any library from Enso, Java, JavaScript, R, or Python, and use functions, callbacks, and data types without any wrappers. Enso uses GraalVM to compile them to the same instruction set with a unified memory model.
      Learn more →
      A cutting-edge visualization engine.
      Enso is equipped with a highly-tailored WebGL visualization engine capable of displaying many millions of data points at 60 frames per second in a web browser. Currently, Enso includes a set of core data visualizations out of the box, and you can easily extend it with libraries such as D3.js, Three.js, Babylon.js, deck.gl, VTK.js, Potree, and many more.
      Learn more →
      Runs everywhere.
      Enso is available on MacOS, Windows, and Linux, and the Enso IDE runs on web-native technologies. In time, you'll be able to run it in the web-browser, giving even your tablet and phone access to your data.
      Learn more →

Getting Started

An example Enso graph



Enso Source Code

If you want to start using Enso, please see the download links in the getting started section above. Alternatively you can get the IDE here and the language itself here. This section is intended for people interested in contributing to the development of Enso.

Enso is a community-driven open source project which is, and will always be, open and free to use. Join us, help us to build it, and spread the word!


Project Components

Enso consists of several sub projects:

  • Enso Engine: The Enso Engine is the set of tools that implement the Enso language and its associated services. These include the Enso interpreter, a just-in-time compiler and runtime (both powered by GraalVM), and a language server that lets you inspect Enso code as it runs. These components can be used on their own as command line tools.

  • Enso IDE: The Enso IDE is the desktop application that allows working with the visual form of Enso. It consists of an Electron application, a high performance WebGL UI framework, and the searcher which provides contextual search, hints, and documentation for all of Enso's functionality.


License

The Enso Engine is licensed under the Apache 2.0, as specified in the LICENSE file. The Enso IDE is licensed under the AGPL 3.0, as specified in the LICENSE file.

This license set was choosen to both provide you with a complete freedom to use Enso, create libraries, and release them under any license of your choice, while also allowing us to release commercial products on top of the platform, including Enso Cloud and Enso Enterprise server managers.


Contributing to Enso

Enso is a community-driven open source project which is and will always be open and free to use. We are committed to a fully transparent development process and highly appreciate every contribution. If you love the vision behind Enso and you want to redefine the data processing world, join us and help us track down bugs, implement new features, improve the documentation or spread the word!

If you'd like to help us make this vision a reality, please feel free to join our chat, and take a look at our development and contribution guidelines. The latter describes all the ways in which you can help out with the project, as well as provides detailed instructions for building and hacking on Enso.

If you believe that you have found a security vulnerability in Enso, or that you have a bug report that poses a security risk to Enso's users, please take a look at our security guidelines for a course of action.


Enso's Design

If you would like to gain a better understanding of the principles on which Enso is based, or just delve into the why's and what's of Enso's design, please take a look in the docs/ folder. It is split up into subfolders for each component of Enso. You can view this same documentation in a rendered form at the developer docs website.

This folder also contains a document on Enso's design philosophy, that details the thought process that we use when contemplating changes or additions to the language.

This documentation will evolve as Enso does, both to help newcomers to the project understand the reasoning behind the code, but also to act as a record of the decisions that have been made through Enso's evolution.