1009 Commits

Author	SHA1	Message	Date
Radosław Waśko	3a4784c226	Initial separation of Snowflake_Dialect from Postgres_Dialect (#10266) ... - Part of #9486 - Building on top of initial work by @jdunkerley and finishing it - Reverted the changes to the Postgres_Dialect from last Snowflake work and split the Snowflake_Dialect into a separate module. - Moved from `rounding_decimal_places_not_allowed_for_floats` to `supports_float_round_decimal_places` (as too confusing). - Added Snowflake_Dialect type. - Extracted `Snowflake_Spec` into separate `Snowflake_Tests` - It imports the common tests from `Table_Tests`. - Some initial adaptations to make the snowflake dialect not-crash. - Adding `Internals_Access` proxy to allow external implementations to access our internal data structures without directly exposing them to users. Users should not use these. - Adding profiling of SQL to check performance.	2024-06-13 16:12:20 +00:00
AdRiley	fadb81abe6	Fix Text_Cleanse tests (#10263) ... I hadn't connected the Text_Cleanse tests up properly and as a result they weren't running or working. This fixes that.	2024-06-13 08:25:32 +00:00
Hubert Plociniczak	d6d370925a	Removing dependencies to speed up startup (#10249) ... Reducing the number of dependencies. Explicit `cats` are almost gone (present in `cli`). `enumeration` is completely gone. `cats` is also still included implicitly via `io.circe` but that's a different kind of beast. Also, really removed `jackson` from dependencies by fixing the dependency on `http-test-helper`. # Important Notes In a number of places importing all cats implicits could be simply replaced with a single or two method calls. Not to mention that this will reduce compilation times due to reduced implicit search space. One example of how the changes affect performance (not only startup): Before:  Now:  (frequently executed)  Also appears to be gone. This PR is by no means finished. The purge will continue in follow up PRs.	2024-06-12 18:15:36 +00:00
marthasharkey	55af1b9ffd	Add icon to indicate value type in table (#10225) ... closes #10018 Sends the value type within the json for table visualisation Header uses a html template to show it's value type to the right of the title Displays the value type also in a tooltip, this displays the types "display_text" <img width="392" alt="image" src="https://github.com/enso-org/enso/assets/170310417/0828e6a2-b30f-4ac7-9a8f-46b4a9cfac91"> tooltip: <img width="498" alt="image" src="https://github.com/enso-org/enso/assets/170310417/f9964f90-9337-42d3-a0ef-3c58f6d74621">	2024-06-12 09:06:55 +00:00
AdRiley	783276ca34	Make test framework list out failed tests to use in filter (#10241) ... * List out failed tests * Code review changes	2024-06-11 21:15:28 +01:00
Radosław Waśko	c4b0ca8f69	Ensure type ascriptions are correctly transformed to facilitate checking of more complex return types (#10229) ... - Fixes #9980 - Adds some tests to ensure types like `|` or `&` (in addition to `!` from the ticket) correctly work in return type check. - Fixes a weird behaviour where we used to avoid processing type related IR transformations inside of type ascriptions. - Adds parentheses to type representations if they are more complex: `A | B & C` is unclear as it can either mean `A | (B & C)` or `(A | B) & C` which have different meanings. If we now have an operation with such nesting, the sub expressions are wrapped in parentheses to disambiguate.	2024-06-11 17:11:03 +00:00
Hubert Plociniczak	4da5e611c9	Replace Jackson serde (#10035) ... JSON serialization setup between Language Server and Runtime is a major contributor to startup time. This PR experiments with an alternative implementation that remedies the problem. The new serializer uses [jsoniter-scala](https://github.com/plokhotnyuk/jsoniter-scala) which by some accounts claims to be really fast. In our case, more importantly, we pay negligible cost of startup setup compared to Jackson which was horribly slow. # Important Notes Before:  After:  Yes. About 0.8sec.	2024-06-11 15:03:12 +00:00
Pavel Marek	5fa29c51b5	Fix Meta.enso_project (#10192) ... Fixes `Standard.Base.Meta.Enso_Project.enso_project` to return a project descriptor for the *main* project, i.e., the one configured as a *root* for the engine. # Important Notes `enso_project` builtin no longer iterates the stack frames to infer the project descriptor. It derives it from the default package repository.	2024-06-11 08:31:40 +00:00
Radosław Waśko	41d02e95ef	Implement Windows-1252 fallback logic for Encoding.Default (#10190) ... - Closes #10148 - [x] Tests for `Restartable_Input_Stream`, `peek_bytes` and `skip_n_bytes`. - [x] Report `Managed_Resource` stack overflow bug: #10211 - [x] Followup possible optimization: #10220 - [x] Test use-case from blog.	2024-06-10 10:49:26 +00:00
James Dunkerley	d938c96c55	Adding type annotations and enabling auto-scoping (#10173) ... - Renamed `Missing_Required_Argument` to `Missing_Argument`, and added `throw` method. - Add default widget to `Case_Sensitivity.Insensitive locale`. - Switch to auto scoping for `parse_type_selector`. - Add type annotation to various simple typed arguments in `Table` and `DB_Table`. - Altered `Filter_Condition` to have `Missing_Argument` for all non-defaulted arguments. - Added resolution of `Column_Ref` passed as auto-scoped to `Table_Ref`. - Altered `Simple_Calculation` to have `Missing_Argument` for all non-defaulted arguments. - Altered `Join_Condition` to have `Missing_Argument` for all non-defaulted arguments. - Altered `Sort_Column` to have `Missing_Argument` for all non-defaulted arguments. - Altered `Aggregate_Column` to have `Missing_Argument` for all non-defaulted arguments. **rename_columns:**  **aggregate:**  **join:**  **set:** 	2024-06-10 07:52:32 +00:00
GregoryTravis	4aa3d52b60	Implement conversions for Decimal column (#10206) ... * treat scale nothing as unspecifed * cast to decimal * float int biginteger * conversion failure ints * loss of decimal precision * precision loss for mixed column to float * mixed columns * loss of precision on inexact float conversion * cleanup, reuse * changelog * review * no fits bd * no warning on 0.1 conversion * fmt	2024-06-07 15:37:32 -04:00
AdRiley	fe6eafd06e	Add By_Type option to more components (#10183) ... * reorder_columns * format * cast * auto_value_types * replace * fill_nothing * fill_empty * text_replace * text_cleanse * Add By_Type * Fix cast * Fix more tests * Fix the table helper * Bug fix * Remove check	2024-06-07 16:26:23 +01:00
Hubert Plociniczak	1bc14252df	Extract mutable builder from ModuleScope (#9914) ... Refactored mutable parts of `ModuleScope` into builder to make it easier to reduce unnecessary locks. # Important Notes Elements of ModuleScope (types, imports etc) are used while _building_ of it may still be in progress. In order to make static typing happy, every `ModuleScope.Builder` can be exposed as (unmodifiable) `ModuleScope`.	2024-06-05 16:57:08 +00:00
Radosław Waśko	698f4b5640	Remove workaround for #8937 after it has been fixed (#10149) ... - Since #8937 was fixed by #10104 the workaround is no longer needed	2024-06-05 14:23:12 +00:00
Jaroslav Tulach	8332118ff4	What's the name of my method? (#10164) ... While working on #10056 I realized the names of method and closure nodes are incomprehensible to anyone. This PR replaces the infamous `<anonymous>` with a name hinting where the method actually is. # Important Notes I assume this change will be visible not only in IGV, but also in _stacktraces_ and we may need to adjust few tests.	2024-06-05 07:49:53 +00:00
GregoryTravis	5fad3558a6	BigDecimalBuilder and arithmetic operations. (#9950) ... * hack * make a column * add * no scale=0 on BD type * a test * wip * 3 arithmetic ops * / * wip * BigDecimalPowerOp * wip * mod test * NumericBinaryOpReturningBigDecimal * with scalar * misc arithmetic tests * fix integralBigDecimalToInteger * mixed columns * bigdecimal pow via double * cleanup * j2e on get * arithmetic exception * mod 0 * cleanup * fmt * changelog * check type first * merge * mc error message * add BD case to Builder.java * fmt * changelog * add BD case to StorageConverter.java * fmt * fix test	2024-06-04 13:59:31 -04:00
AdRiley	7c35781a14	Add select/remove column by type (#10159) ... * stash * Working first pass * Tests * remove columns * more tests * More tests * DB_Table * In DB * Deprecate * Update documentation * More docs * Remove strict * Remove tests * Fix widgets * Add doc * Spaces * Fix In-DB	2024-06-04 16:23:46 +01:00
marthasharkey	24d209abf9	Add Columns_To_Add type to move away from Integer | Nothing (#10152) ... Adds new type "Coulmns_To_Add" that replaces the Integer | Nothing type And adds new widget to split_to_columns and tokenise_to_columns <img width="397" alt="image" src="https://github.com/enso-org/enso/assets/170310417/1b155682-0992-4cc0-8964-62b389ee7072"> Closes #10041	2024-06-04 15:06:08 +00:00
Radosław Waśko	7cf80f3196	Handle UTF BOM when decoding text (#10130) ... - Improve BOM handling: detect and skip the BOM character, Default encoding that detects encoding based on BOM if present, warnings if unexpected BOM is encountered. - Closes #9849 - Windows-1252 fallback will be done as a separate PR as it has additional complexity. Tracked in ticket #10148.	2024-06-04 13:22:19 +00:00
GregoryTravis	1c2955655c	Add no_warning_propagation flag to Vector.build and Builder.new (#10079) ... * no_warning_propagation flag * doc * benchmarks * change to propagate_warnings, test * fix java benchmark * add benchmark to main	2024-06-04 09:06:09 -04:00
James Dunkerley	f1a1901058	Bug fix for read by line. (#10161) ... Needs to pass -1 not Nothing to JSON.	2024-06-03 21:33:45 +00:00
Jaroslav Tulach	9632f04e9b	Directly allocate warnings asVectorEnsoObjects (#10143)	2024-06-01 06:23:49 +02:00
AdRiley	af4177e61f	Make table default visualisation (#10128) ... Makes table the default vis type. Before:  After:  Closes #10093	2024-05-31 15:02:02 +00:00
James Dunkerley	ffdfc7195e	Linter and small widget change (#10136) ... Linter issues to allow doc site generation. Small change in order for aggregate column.	2024-05-31 12:30:38 +00:00
AdRiley	06327f8fde	Add statistic product (#10122) ... Add Statistic.Product 	2024-05-31 09:29:52 +00:00
Radosław Waśko	233f28235a	Small fixes to Postgres integration (#10105) ... - Better message when saving datalink in disabled Output context:  Before it was:  - Hack to get Postgres widget to display connection options:  Before the `Postgres` constructor was created without any parameters and it was not showing any parameters for modification.	2024-05-28 14:34:44 +00:00
Dmitry Bushev	858e646328	Start Ydoc with the language server (#9862) ... - related #7954 Changelog: - update: Ydoc starts with the language server on the `localhost:1234` by default. The hostname and ports can be configured by setting environment variables `LANGUAGE_SERVER_YDOC_HOSTNAME` and `LANGUAGE_SERVER_YDOC_PORT` - update: by default `npm dev run` uses the node Ydoc server. You can control it with `POLYGLOT_YDOC_SERVER` env variable. For example, ``` env POLYGLOT_YDOC_SERVER='true' npm --workspace=enso-gui2 run dev ``` To connect to the Ydoc server running on the 1234 port (the one started with the language server) ⠀ ``` env POLYGLOT_YDOC_SERVER='ws://127.0.0.1:1235' npm --workspace=enso-gui2 run dev ``` To connect to the provided URL. Can be useful for debugging when you start a separate Ydoc process. - update: run `npm install` before the engine build. It is required to create the Ydoc JS bundle.	2024-05-28 13:51:42 +00:00
AdRiley	28bd5c522b	Add named_pattern and make it usable in Text_Replace (#10040) ... Creates a new type Named_Expression and allows it to be used in text_replace    	2024-05-27 13:01:26 +00:00
James Dunkerley	ab4b1f0f35	Add day_of_week and day_of_year to Column and DB_Column (#10081) ... - Adds support for getting the weekday as an integer (1 Monday - 7 Sunday - ISO standard). - Add support for getting the day of year.	2024-05-27 11:29:25 +00:00
James Dunkerley	200da1ad50	Remove old GUI1 ICONs and mapping function (#10086) ... * Remove old GUI1 ICONs and mapping: ``` dataframe_clean: 'table_clean', dataframe_map_row: 'map_row', dataframe_map_column: 'column_add', dataframes_join: 'join2-1', dataframes_union: 'union', sigma: 'transform4', io: 'in_out', date_and_time: 'time', spatial: 'location', predictive: 'predict', machine_learning: 'robot', split_text: 'split', ``` * Linter. * Linter (2). * Sort out some Returns: * Sort out some ? Example	2024-05-27 11:17:21 +01:00
James Dunkerley	d8059fd22c	Some tweaks following Steve's testings (#10042) ... - Add ranged number widget to `at` and `get`. - Add defaults to `at` and `get` picking the first item. - PRIVATE on various Excel_Workbook methods. It still works like a connection but not shown in CB.	2024-05-27 09:04:29 +00:00
AdRiley	adfe2dbab4	Add expression alias (#10067) ... We call formulas expressions so having expression as well as formula makes sense as an alias.	2024-05-24 14:13:00 +00:00
AdRiley	084be279c5	Fix input_number icons (#10066) ... icon is called input_number not number_input 	2024-05-24 11:30:06 +00:00
Adam Obuchowicz	8ac0ee41c6	Allow picking non-existing files in write component (#10047) ... Fixes #9984 Added a flag to `File_Browse` widget configuration specifying if we require an existing file. Also, the FileBrowserWidget will match against all "Writable_File", also displaying Save dialog.	2024-05-24 09:21:32 +00:00
Radosław Waśko	9d75f79ff9	Cloud Integration updates: renames in file metadata structure, remove path resolver workaround, partial fix for datalink resolver issue (#10050) ... - Supersedes #9966 as I wanted to test these changes in one go. - Fixes #10037 caused by lack of CI check and my oversight (forgot to run full tests after a minor change). - Fixes a regression after [file metadata fields were renamed](c09d856ac8 (diff-9f59b6a0ee3155efecdc70c1ea0c90ab5cde00b5623d84363118b1793f941c46R2037)). - Fixes handling of creating new datalinks and using them after cache was cleared (e.g. workflow restart). - This was caused by troubles with path resolver. - The fix addresses the most common issue and adds a test for it (test flushes the caches to ensure path resolver is used instead of the cached value). - Some related issues were discovered on the cloud side, tracked by https://github.com/enso-org/cloud-v2/issues/1252	2024-05-23 16:05:48 +00:00
Jaroslav Tulach	16c1b74218	Enso Library Feature to execute (a bit of) Base_Tests (#9997)	2024-05-23 08:20:19 +02:00
Radosław Waśko	1e0649fda1	Improvements to Table.union (#9968) ... - Closes #9952	2024-05-22 09:38:10 +00:00
marthasharkey	517299bb09	Add new aliases for take and drop methods (#10022) ... Adds the aliases 'keep' and 'remove' to take/drop methods	2024-05-22 08:02:48 +00:00
James Dunkerley	2677e556e8	Align headers in doc comments... (#10025) ... - Always use `Arguments:` for parameters or fields. - Always use `> Example` for examples. - Align sections behind `!` or `?` headers. - Whitespace fixes.	2024-05-21 19:44:58 +00:00
AdRiley	3b59b40657	Update test framework to default to only show failures (#9986) ... * Update test framework to default to only show failures * Fix	2024-05-21 11:23:23 +03:00
James Dunkerley	31dd5944d7	Some fixes to make linter happy (#10004) ... - A few import orderings. - Missing doc comments on Text_Cleanse. - Indent correction.	2024-05-20 16:15:11 +00:00
AdRiley	c7476c10f3	Add data cleanse component (#9879) ... * Signature * More API work * Red * Still red * Green * Red * Green * Red * Green * Refactor * Refactor * Refactor * Red * Green * Red * Green * Red * Green * More tests * non-ascii * Ordering tests * Remove tabs * Numbers and Letters * Changelog.md * Add documentation * Tests for non-text columns * Add punctuation * Add symbols * Fix * Refactor * Refactor * Move to base * Fix * Start of in-db tests. Not working * DB versions * Update widget * Fix widgets * Move tests to base * Code review changes	2024-05-20 09:33:18 +01:00
James Dunkerley	3b29de313d	Update ICONs, linting fixes and add select_columns ALIASes. (#9985) ... - Linting fixes. - Add ICONs to all functions missing them. - Add ALIASes for select columns.	2024-05-17 19:24:17 +00:00
GregoryTravis	4d49b00375	Combine builders for Vector.build and Vector.new_builder (#9922) ... We have decided to keep the old new_builder, and to combine the new and old builders into one builder.	2024-05-17 16:18:47 +00:00
AdRiley	5c9ee94812	Make parse_fast_json private (#9978) ... Micro MR to make deprecated method private	2024-05-17 15:47:11 +00:00
Radosław Waśko	38ad7b0afa	Creating datalinks from code (#9957) ... - Closes #9673 - Adds the ability to save an existing Postgres connection as a datalink into the Enso Cloud, automatically promoting plain-text passwords into a Secret. - Fixes dataflow error propagation in `JS_Object.from_pairs`.	2024-05-16 13:29:41 +00:00
Radosław Waśko	a2481036e6	Prepare for the Path resolver change to GET (#9958) ... - Prepares for the Cloud API change, together with a fallback for the old API to avoid problems during migration. - This PR should be merged before the https://github.com/enso-org/cloud-v2/pull/1236 PR is _deployed_.	2024-05-15 13:00:32 +00:00
James Dunkerley	b2aeb9fc84	Moving away from Integer | Nothing to Rows_To_Read for limiting number of rows. (#9925) ... - Added a new `Rows_To_Read` type with conversions from `Nothing` and integers. - Updated `read` on `Table`, `Column`, `DB_Table` and `DB_Column`. - Updated `Delimited_Format.Delimited` to use `Rows_To_Read` for `row_limit`. - Updated `Excel_Format.Sheet` and `Excel_Format.Range` to use `Rows_To_Read` for `row_limit`. - Updated `Excel_Workbook.read` to use `Rows_To_Read`. - Updated `Connection.read` (in all connection types) to use `Rows_To_Read`.  	2024-05-14 16:31:26 +00:00
James Dunkerley	2d6735edc7	Allow a Table to be used to rename_columns. (#9940) ... Following an example from Steve, adjusted `rename_column` to allow a `Table` to define the mapping. - A single Text column table gives a list of new names. - A two Text column table gives a map from old name to new name. - If a `DB_Table` is passed errors and tells the user to materialize the table. 	2024-05-14 15:57:10 +00:00
Radosław Waśko	5f0a16c87c	Audit Logs for Postgres connections opened through a data link (#9873) ... - Closes #9599 - Implemented API for sending audit logs to the cloud on a background thread. - If the Postgres connection is opened through a datalink, its internal JDBC connection is replaced by a wrapper that reports executed queries to the audit log. - Also introduces `EnsoMeta` - a helper Java class that can be used in our helper libraries to access Enso types. - I have replaced the common pattern scattered throughout the codebase with calls to this 'library' to avoid repetitive code. - Refactored `Table.display` to share code between in-memory and DB - it was needed as the function stopped working for `DB_Table` after adding making the `Table` constructor `private`. - Clearer error when reading a SQLite database from a remote file (tells the user to download it first). - Follow up - correlate asset id of the data link: #9869 - Follow up - include project name (once bug is fixed): #9875 - Some problems/improvements of the audit log: - The audit log system is not yet ready for high throughput of logs #9870 - The logs may be lost if `System.exit` is used #9871	2024-05-11 08:54:33 +00:00
James Dunkerley	d97754da17	Error messages for rename_columns and Vector.duplicates (#9917) ... - Improve error message for `rename_columns`. - Add `length` to `Set` and `Map`. - Add `duplicates` to `Vector` (and `Array`). 	2024-05-10 17:43:50 +00:00
GregoryTravis	720d32cbe3	Convert most remaining uses of Vector.new_builder to Vector.build (#9891)	2024-05-09 15:52:53 +00:00
Radosław Waśko	1d8fc1bf6e	Update endpoint name after it was updated in the Cloud (#9912) ... Micro PR updating our API integration to the Cloud-side changes.	2024-05-09 15:17:19 +00:00
AdRiley	e25ec96aaa	Add table running variance skew sd and kurtosis (#9854) ... Adds support for Variance, Skew, Standard Deviation and Kurtosis to Table.Running.	2024-05-09 08:45:29 +00:00
James Dunkerley	ce360f9002	Fix the group colours for consistent colouring. (#9893) ... Fix the group colour to a fixed set. 	2024-05-08 16:52:42 +00:00
James Dunkerley	4e758e5c9d	Undo change to autoscoping. (#9881) ... Can't use auto-scoping for filter yet.	2024-05-08 07:52:12 +00:00
GregoryTravis	a2c36def26	Add Vector.build_multiple and handle dataflow error and warning propagation in build and build_multiple (#9766)	2024-05-07 19:30:21 +00:00
James Dunkerley	c0fd6eed2d	Small tweaks from Ned, Mark, Cass and Steve's feedback. (#9859) ... - Rename `.info` to `.column_info`. - Rename `.select_by_type` to `.select_columns_by_type`. (to be merged into `select_columns` functionality) - Rename `.remove_by_type` to `.remove_columns_by_type`. (to be merged into `remove_columns` functionality) - Adding "field" `ALIAS`es. - Making `Table.Value` private (and hence hiding `java_table`). - Making `Column.Value` private (and hence hiding `java_column`, added method to `Storage` to allow tests to work). - Making `DB_Table.Value` private (and hence hiding `connection`, `context` and `internal_columns`). - Making `DB_Column.Value` private (and hence hiding `connection`, `sql_type_reference`, `expression` and `context`). - Add widgets for everywhere `Filter_Condition` used (fix missing entry for lower, can't use auto-scoping).  - Fix for widgets in `Simple_Calculation`: `date_add` and `format`.   - Fix for nested `Row`, `Column` and `DB_Column` rendering in Table Viz.   # Important Notes - Can't use `.` to access a private constructor field when mapping, have to use a lambda. - We should agree convention for private backing fields which are wrapped by a public getter (went with `internal_` for this pass).	2024-05-06 13:49:12 +00:00
Dmitry Bushev	a44bb2b1b1	Language Server API for AI (#9679) ... close #9656 Changelog: - add: `ai/completion_v2` method - add: `Visualization.AI.print` method for converting the expression to text format - update: The default system prompt was updated to tell AI to use the `Visualization.AI.print` method for printing. # Important Notes The project [New_Project_1.zip](https://github.com/enso-org/enso/files/15152993/New_Project_1.zip) contains the following main file: ```py from Standard.Base import all from Standard.Table import all from Standard.Database import all from Standard.AWS import all import Standard.Visualization import Standard.Visualization.Warnings from Standard.Base.Errors.Common import Dry_Run_Operation type Student Value id region main = operator70395 = 226 operator47321 = 'east' operator76980 = Student.Value operator70395 operator47321 operator31302 = operator47321.words True operator91574 = 1 operator34358 = operator47321.take (Index_Sub_Range.By_Index [0, operator91574]) #### METADATA #### [[{"index":{"value":0},"size":{"value":4}},"4cf8de7f-2014-4dfd-9ceb-0164fe26c8bf"],[{"index":{"value":0},"size":{"value":29}},"389fe7a5-e59b-440a-8801-e0bd86716094"],[{"index":{"value":0},"size":{"value":558}},"a8a81ce3-199e-479e-98dd-5f919425842d"],[{"index":{"value":5},"size":{"value":8}},"c6f0de99-3bd3-459d-a69b-5fc774dd1e3f"],[{"index":{"value":5},"size":{"value":13}},"05827411-7354-478b-99d8-8370dadd560b"],[{"index":{"value":13},"size":{"value":1}},"41de94cc-ccd2-4ccf-b9db-cf686443efa0"],[{"index":{"value":14},"size":{"value":4}},"8abd24ea-b1cb-4c10-ad16-5a190f7ed0c7"],[{"index":{"value":19},"size":{"value":6}},"5c57a62d-ed82-4195-8b78-2ed660556dd0"],[{"index":{"value":26},"size":{"value":3}},"23544334-1117-4dbc-ac7f-bb3f84575264"],[{"index":{"value":30},"size":{"value":4}},"6058ba89-dc1b-45e1-b8f3-d1a4d27975f7"],[{"index":{"value":30},"size":{"value":30}},"bdd4b4cc-9c1e-4554-b0fb-3f73dcd5a590"],[{"index":{"value":35},"size":{"value":8}},"7e7bb9b4-8e9b-4700-9dcd-83c353800da5"],[{"index":{"value":35},"size":{"value":14}},"524bafb6-d3ca-4ee5-b8de-84b5c47ca87b"],[{"index":{"value":43},"size":{"value":1}},"b68b3929-8b63-49ad-977c-b04e058f8ee4"],[{"index":{"value":44},"size":{"value":5}},"7173f374-5f53-462b-ab1b-f7b1845d729b"],[{"index":{"value":50},"size":{"value":6}},"911d381e-1bdb-4e9c-826d-a00495c8fd23"],[{"index":{"value":57},"size":{"value":3}},"2f8fa1ee-9d13-4a73-99b2-bc77d1656387"],[{"index":{"value":61},"size":{"value":4}},"11abd658-4888-476c-afcd-592edaaa53c1"],[{"index":{"value":61},"size":{"value":33}},"9f6ae949-410b-48e6-bb75-84d4ba8a1989"],[{"index":{"value":66},"size":{"value":8}},"f4726e40-dd5b-49a0-aa2a-6cea6df88d5d"],[{"index":{"value":66},"size":{"value":17}},"539b4dcf-4487-49b6-9c90-6ae58d51c2db"],[{"index":{"value":74},"size":{"value":1}},"a34a41a0-5dcf-4c47-a36c-a4f427c87c03"],[{"index":{"value":75},"size":{"value":8}},"8fdf4ee7-2e74-4cac-b9b9-4230183f91c5"],[{"index":{"value":84},"size":{"value":6}},"7ff7efdc-fed6-4cb6-bed6-392d110ff991"],[{"index":{"value":91},"size":{"value":3}},"eacff407-dc6d-4f17-a28b-329f7a0582e1"],[{"index":{"value":95},"size":{"value":4}},"f2feac9f-ea02-4070-879a-f1d493473993"],[{"index":{"value":95},"size":{"value":28}},"f9b37b67-fb54-4e47-8281-e922edb4c5d3"],[{"index":{"value":100},"size":{"value":8}},"6cf398f8-d0c9-42fa-a6e6-e740de11562f"],[{"index":{"value":100},"size":{"value":12}},"28e4d0e3-7da4-4ee2-94c7-d9a7c692f8de"],[{"index":{"value":108},"size":{"value":1}},"955e8788-816c-4eb7-b5ec-020b4863536a"],[{"index":{"value":109},"size":{"value":3}},"bdc65807-0438-4296-8b1f-1fab3a885c17"],[{"index":{"value":113},"size":{"value":6}},"fe3dd265-1855-4d66-8a2d-51153b21e699"],[{"index":{"value":120},"size":{"value":3}},"3b7a14ac-3224-4b9a-b474-f6136a658f8b"],[{"index":{"value":124},"size":{"value":6}},"7f7f18a4-06ef-46e0-bddd-b9fe60878855"],[{"index":{"value":124},"size":{"value":29}},"d49e0fe3-a638-4d7e-ba58-12db7abad20f"],[{"index":{"value":131},"size":{"value":8}},"c9411433-5e73-4927-9175-15d3b1ccb0ef"],[{"index":{"value":131},"size":{"value":22}},"b53ad817-ea4c-491e-aaf8-49967e22aff6"],[{"index":{"value":139},"size":{"value":1}},"837a4d65-8af6-4860-ae0e-ad9172af6ad2"],[{"index":{"value":140},"size":{"value":13}},"3b662906-1887-4dd6-a0e2-a222ace135ce"],[{"index":{"value":154},"size":{"value":6}},"548ca873-544f-48c9-b7ab-6aa1e7f03d72"],[{"index":{"value":154},"size":{"value":38}},"7c45872c-22b4-4f37-bcd7-b3791408f737"],[{"index":{"value":161},"size":{"value":8}},"21152f0d-4222-48e4-9376-a2a28f8f6be6"],[{"index":{"value":161},"size":{"value":22}},"1cb71d49-a06d-4dd9-bc1b-54603b416601"],[{"index":{"value":161},"size":{"value":31}},"faa46cf2-3e90-44ed-9d9e-77b7f874b338"],[{"index":{"value":169},"size":{"value":1}},"6d5fdcd5-0ddf-4c83-aafe-a446ac5ce461"],[{"index":{"value":170},"size":{"value":13}},"830d73c2-1898-41a9-8046-22d86f159ef0"],[{"index":{"value":183},"size":{"value":1}},"ab897380-c596-4182-a2c5-b7b23cf59893"],[{"index":{"value":184},"size":{"value":8}},"29f35cf2-d79d-44d0-96d0-79b11589726c"],[{"index":{"value":193},"size":{"value":4}},"45bf8220-52f2-49f4-bbcf-9566d1f1b1c4"],[{"index":{"value":193},"size":{"value":57}},"478005ac-f0ca-497a-b298-554bd64946a9"],[{"index":{"value":198},"size":{"value":8}},"c11511ce-252c-4b84-9f61-dfa5544d4916"],[{"index":{"value":198},"size":{"value":13}},"dbae65a1-bdca-44b0-a497-7934d1e42616"],[{"index":{"value":198},"size":{"value":20}},"355392ad-8c81-4304-a6d0-2bbf3690da0c"],[{"index":{"value":198},"size":{"value":27}},"0720ccb5-ebd3-4c29-8113-0aa1f251e873"],[{"index":{"value":206},"size":{"value":1}},"f5a8d310-1f58-456e-84a3-78490f05ff13"],[{"index":{"value":207},"size":{"value":4}},"10046e78-5164-407c-adef-2ab11ce77b4c"],[{"index":{"value":211},"size":{"value":1}},"ed23da0c-9193-4eea-ab9c-fee90ba8f924"],[{"index":{"value":212},"size":{"value":6}},"7a09de10-35e2-45e0-9eb8-f79fa054b733"],[{"index":{"value":218},"size":{"value":1}},"b85a0981-9d82-4204-a03a-cd3a4720c72d"],[{"index":{"value":219},"size":{"value":6}},"1b04c19d-cdf0-4661-8f4e-d980cf12c996"],[{"index":{"value":226},"size":{"value":6}},"87d57f2c-e009-48a7-98bb-0e1612905564"],[{"index":{"value":233},"size":{"value":17}},"60fd6a1c-7ada-4546-ae20-e1f8b432b4fd"],[{"index":{"value":252},"size":{"value":4}},"9558affa-b913-4576-8ee3-6af22985e0f6"],[{"index":{"value":252},"size":{"value":32}},"8479091c-9232-49d6-b375-32f89693c389"],[{"index":{"value":257},"size":{"value":7}},"3d1f13f5-e22a-4cb6-9e75-9c717e016922"],[{"index":{"value":264},"size":{"value":1}},"aa429f07-973a-4c69-8e3f-74aa4780f85a"],[{"index":{"value":269},"size":{"value":5}},"5b304cf6-5ec4-4b23-ad0d-20e38b41cdcd"],[{"index":{"value":269},"size":{"value":15}},"e3315ef2-d0ec-43b1-b8f6-5b436054aaee"],[{"index":{"value":275},"size":{"value":2}},"bc7205c4-68bf-461e-a1ba-31400b9337ff"],[{"index":{"value":278},"size":{"value":6}},"78870c05-9117-4e24-bf77-a72e7aef9c18"],[{"index":{"value":286},"size":{"value":4}},"517c743f-c775-4031-8f87-222d0f0a365f"],[{"index":{"value":286},"size":{"value":271}},"d0d107bc-4997-41d6-9c20-32295590eaac"],[{"index":{"value":291},"size":{"value":1}},"91174930-f18b-4322-84cc-deb88637d012"],[{"index":{"value":292},"size":{"value":265}},"f09a4372-3231-4f2e-99f4-84aa751f9b60"],[{"index":{"value":297},"size":{"value":13}},"613df8c9-0a40-4c94-886f-9668c2c360c2"],[{"index":{"value":297},"size":{"value":19}},"5b88a4d4-6840-4a25-a862-8b5d0b75303d"],[{"index":{"value":311},"size":{"value":1}},"6bfe1dea-09df-4358-9613-74d8326bc680"],[{"index":{"value":313},"size":{"value":3}},"e3b7fac7-0c08-4f20-8a0c-a58f1b118097"],[{"index":{"value":321},"size":{"value":13}},"37d007fe-9cb6-4f2e-a8b7-30842eac60b2"],[{"index":{"value":321},"size":{"value":22}},"4233204a-543d-437a-a9fc-9f79853a9540"],[{"index":{"value":335},"size":{"value":1}},"6c01783b-27ba-413c-84a4-6a94a37d714a"],[{"index":{"value":337},"size":{"value":1}},"34bc865a-58b5-4c49-bf85-a8cfedaf9b54"],[{"index":{"value":337},"size":{"value":6}},"bb556514-570d-4a87-8b2a-6e7f198a975f"],[{"index":{"value":338},"size":{"value":4}},"87c2cedc-898e-43c3-be3d-24e15689c373"],[{"index":{"value":342},"size":{"value":1}},"13387ff5-ec5e-453a-86f2-deae721b5549"],[{"index":{"value":348},"size":{"value":13}},"6280a86b-5469-43f3-94d5-1e1726028a54"],[{"index":{"value":348},"size":{"value":57}},"a17c5e55-5e99-4e4f-961d-9b4072ecd6e4"],[{"index":{"value":362},"size":{"value":1}},"c0720382-9ce4-451a-a04b-f248143d2528"],[{"index":{"value":364},"size":{"value":7}},"9cd51399-d9d2-4898-9bcb-be2f540999ff"],[{"index":{"value":364},"size":{"value":13}},"b4980bfc-13cc-429f-bc43-9edfc07d2406"],[{"index":{"value":364},"size":{"value":27}},"1a3f6a8c-ab27-43dd-a494-bf413334fd9a"],[{"index":{"value":364},"size":{"value":41}},"71a97e88-9b19-4ec9-b3c8-ffd2940c4cb8"],[{"index":{"value":371},"size":{"value":1}},"99f38c61-3ea7-4b02-be71-f293fbecb7d7"],[{"index":{"value":372},"size":{"value":5}},"08820818-ddb9-408a-b913-e9382e5b6dc7"],[{"index":{"value":378},"size":{"value":13}},"2cf06b4e-af9f-492e-ac13-5723a896a508"],[{"index":{"value":392},"size":{"value":13}},"6c887279-5998-45ce-81ab-c37fdeb03144"],[{"index":{"value":410},"size":{"value":13}},"6c126d22-c018-46cc-bdae-cf8b89104173"],[{"index":{"value":410},"size":{"value":40}},"a65c1fa8-9fce-4c30-bef7-d85ff1b428eb"],[{"index":{"value":424},"size":{"value":1}},"208c049e-e221-49ce-99d7-96142f2d1b1c"],[{"index":{"value":426},"size":{"value":13}},"0adf4ddd-1402-4b96-bfb0-1917cc275063"],[{"index":{"value":426},"size":{"value":19}},"f2158ac6-2dd5-482d-9f3d-0bf4812d6d6e"],[{"index":{"value":426},"size":{"value":24}},"c7bbc3e7-1377-429e-b60a-0c2d2cd4ea74"],[{"index":{"value":439},"size":{"value":1}},"1a17a7ee-31d7-4885-84ce-c902bff4ea4a"],[{"index":{"value":440},"size":{"value":5}},"47016cac-40a0-45f6-8057-2b81edb052a5"],[{"index":{"value":446},"size":{"value":4}},"ce4fa4cd-5064-4752-9dbc-5fcf4e92138a"],[{"index":{"value":455},"size":{"value":13}},"3300001d-13ea-45f4-acbe-959813bcf85b"],[{"index":{"value":455},"size":{"value":17}},"b8f5900b-2370-4b21-8a0c-06d3bbb45068"],[{"index":{"value":469},"size":{"value":1}},"19ea3187-83d6-47d1-994c-64cf0ce9af3b"],[{"index":{"value":471},"size":{"value":1}},"9457c3f8-c878-4f01-a5c7-39336f163a28"],[{"index":{"value":477},"size":{"value":13}},"a5139627-05a8-4838-b171-02666c62c348"],[{"index":{"value":477},"size":{"value":80}},"8b5c864c-055d-4d11-a470-2679328fc131"],[{"index":{"value":491},"size":{"value":1}},"eb01b0af-06cf-4d75-81ad-d0bf7664b2d7"],[{"index":{"value":493},"size":{"value":13}},"6c042eb7-e895-473d-b456-6e0eec23e958"],[{"index":{"value":493},"size":{"value":18}},"f40730ff-ac6c-45db-8970-534f3becda2a"],[{"index":{"value":493},"size":{"value":64}},"b2df8ba8-683c-45c2-9932-8e1c970c799a"],[{"index":{"value":506},"size":{"value":1}},"2289bf31-74dd-431c-97f1-3ac179715453"],[{"index":{"value":507},"size":{"value":4}},"6db4523a-0bcd-4ba5-b6c2-7720db57d93c"],[{"index":{"value":512},"size":{"value":1}},"b6faea17-664d-470a-9641-999b6a2be5bd"],[{"index":{"value":512},"size":{"value":45}},"98aea277-bc44-4ceb-85a6-24ee453b7f72"],[{"index":{"value":513},"size":{"value":15}},"c0ae1c05-026d-4712-a571-979ce260b310"],[{"index":{"value":513},"size":{"value":24}},"502e8e4d-5105-4abe-8dba-4d7293cbe80b"],[{"index":{"value":513},"size":{"value":43}},"71cee748-378b-4817-be0e-b87bc1d3d847"],[{"index":{"value":528},"size":{"value":1}},"fcaad3ac-e080-4170-9d63-b2c01295447d"],[{"index":{"value":529},"size":{"value":8}},"a053e05a-4862-4407-abe8-2746784bdfc3"],[{"index":{"value":538},"size":{"value":1}},"9adae78d-7667-4865-83e9-b64464b13696"],[{"index":{"value":538},"size":{"value":18}},"92f153e3-da05-439e-bb4f-596ec8cfa9c8"],[{"index":{"value":539},"size":{"value":1}},"dddedc5e-415d-4f5d-ab1b-19468aa079a9"],[{"index":{"value":540},"size":{"value":1}},"4adce2e5-1e60-4a63-9ff3-5781d967b704"],[{"index":{"value":542},"size":{"value":13}},"ef06ed1e-246f-4106-a4c0-1e648b8ad5e7"],[{"index":{"value":555},"size":{"value":1}},"7bd1cc5f-20b1-4dd2-8a34-ccc40f5f091a"],[{"index":{"value":556},"size":{"value":1}},"720adbd6-24b0-49ac-b123-61cc037a9636"]] {"ide":{"node":{"e3b7fac7-0c08-4f20-8a0c-a58f1b118097":{"position":{"vector":[-224,13]}},"bb556514-570d-4a87-8b2a-6e7f198a975f":{"position":{"vector":[115,19]}},"71a97e88-9b19-4ec9-b3c8-ffd2940c4cb8":{"position":{"vector":[-224,-51]}},"c7bbc3e7-1377-429e-b60a-0c2d2cd4ea74":{"position":{"vector":[360,19]},"visualization":{"show":false,"fullscreen":false,"width":200}},"f2158ac6-2dd5-482d-9f3d-0bf4812d6d6e":{"position":{"vector":[297,-45]},"visualization":{"show":false,"fullscreen":false,"width":96}},"9457c3f8-c878-4f01-a5c7-39336f163a28":{"position":{"vector":[640,40]},"visualization":{"show":false,"fullscreen":false,"width":200}},"b2df8ba8-683c-45c2-9932-8e1c970c799a":{"position":{"vector":[219,-80]},"visualization":{"show":true,"fullscreen":false,"width":200}},"f40730ff-ac6c-45db-8970-534f3becda2a":{"position":{"vector":[219,-48]}}},"import":{}}} ``` To test the functionality, I asked AI to show me the result of the `operator70395` variable: 1. Init protocol connection ```json {"jsonrpc":"2.0","id":0,"method":"session/initProtocolConnection","params":{"clientId":"d8e948fd-6418-43c8-9f02-54827f09e10a"}} ``` 2. Create execution context ```json {"jsonrpc":"2.0","id":0,"method":"session/initProtocolConnection","params":{"clientId":"d8e948fd-6418-43c8-9f02-54827f09e10a"}} ``` 3. Push the main method ```json {"jsonrpc":"2.0","id":0,"method":"executionContext/push","params":{"contextId":"730a66ef-4222-46f8-8a03-d766946ab2bd","stackItem":{"methodPointer":{"module":"local.New_Project_1.Main","definedOnType":"local.New_Project_1.Main","name":"main"},"positionalArgumentsExpressions":[],"type":"ExplicitCall"}}} ``` 4. Ask AI for the variable contents ```json {"jsonrpc":"2.0","id":1,"method":"ai/completion_v2","params":{"contextId":"730a66ef-4222-46f8-8a03-d766946ab2bd","expressionId":"f09a4372-3231-4f2e-99f4-84aa751f9b60","prompt":"There is 'operator70395' variable defined in the program. What is the result of the variable 'operator70395'?"}} ``` I got the following responses: ```json {"jsonrpc":"2.0","method":"ai/completionProgress","params":{"code":"Visualization.AI.print(operator70395)","reason":"To provide the result of 'operator70395', I need to know its current value.","visualizationId":"edfb00a3-6ce5-41e1-bb8f-ab191809114e"}} ``` ```json {"jsonrpc":"2.0","id":1,"result":{"Success":{"fn":"def get_operator70395_result():\n return operator70395","fnCall":"get_operator70395_result()"}}} ```	2024-05-02 16:55:06 +00:00
AdRiley	5350b2d00d	Refactor add row number (#9822) ... * Refactor add row number * Refactor * Green * Green * Remove dead code * Cleanup * Deduplicate check	2024-05-02 12:29:54 +01:00
James Dunkerley	d2e6ff260e	Restructure SQLite_Details. (#9832) ... ``` type SQLite_Details SQLite location:File|In_Memory type In_Memory ``` to ``` type SQLite From_File location:File In_Memory ``` # Important Notes Splits the In-Memory entry for Database Connect but still works nicely.  	2024-05-01 22:15:41 +00:00
James Dunkerley	4d6d6f239c	Handle URL encoding automatically in query string. (#9823) ... A small fix to automatically encode the query string. Attaches a warning if needed.  	2024-04-30 22:03:46 +00:00
Radosław Waśko	f87c75a3da	Prepare for Cloud Environment variable name change (#9821) ... Changing `ENSO_PROJECT_DIRECTORY_PATH` to `ENSO_CLOUD_PROJECT_DIRECTORY_PATH`.	2024-04-30 16:02:12 +00:00
AdRiley	d1bf4cb771	Add Ignored_Nothing_Values (#9770) ... Add a `IgnoredNothing` warning for Table.Running   	2024-04-30 13:30:40 +00:00
Pavel Marek	660c5e7a9d	Atom constructors can be private (#9692) ... Closes #8836. Atom constructors can be declared as private (project-private). project-private constructors can be called only from the same project. See the encapsulation.md docs for more info. --------- Co-authored-by: Jaroslav Tulach <jaroslav.tulach@enso.org> Co-authored-by: Radosław Waśko <radoslaw.wasko@enso.org> Co-authored-by: Hubert Plociniczak <hubert.plociniczak@gmail.com> Co-authored-by: Kaz Wesley <kaz@lambdaverse.org>	2024-04-29 14:43:18 +02:00
Radosław Waśko	16e1999040	Fix copy_to/move_to edge case when source and target are the same (#9798) ... - Adds tests for an edge case where the source and target of copy/move operation are the same. - And fixes the behaviour to be as expected.	2024-04-29 12:29:07 +00:00
Radosław Waśko	8e03e3be9c	Print pending groups in-line and include their reason, also add progress bar to the runner (#9796) ... - Closes #9534 by printing the pending groups with pending reason - Re-introduces original ordering of tests - Adds a progress bar to the test suite runner in 'interactive' mode (if ANSI colors are enabled, progress bar will also be)	2024-04-26 16:05:05 +00:00
Jaroslav Tulach	c5bf2384e4	Removing Truffle API dependency from runtime-compiler project (#9785) ... Fixes #8888 by removing dependency on Truffle API and `polyglot-api` from `runtime-compiler` project.	2024-04-26 13:14:22 +00:00
James Dunkerley	c5179309fd	Improve Table Viz handling of Numbers (#9793) ... - Added support for NaN, Infinity and -Infinity in the Table viz. - Simplified the logic so all the formatting in a single place in the Table viz. - Sorted Number formatting for BigInt and < 10000.  	2024-04-26 07:52:40 +00:00
Radosław Waśko	df4a7efcdd	Add AWS SSO JARs to the Standard.AWS library (#9782) ... As reported by our users, when using the AWS SSO, our code was failing with: ``` Execution finished with an error: To use Sso related properties in the 'xyz' profile, the 'sso' service module must be on the class path. ``` This PR adds the missing JARs to fix that. Additionally it improves the license review tool UX a bit (parts of #9122): - sorting the report by amount of problems, so that dependencies with unresolved problems appear at the top, - semi-automatic helper button to rename package configurations after a version bump, - button to remove stale entries from config (files or copyrights that disappeared after update), - button to add custom copyright notice text straight from the report UI, - button to set a file as the license for the project (creating the `custom-license` file automatically) - ability to filter processed projects - e.g. `openLegalReviewReport AWS` will only run on the AWS subproject - saving time processing unchanged dependencies, - updated the license search heuristic, fixing a problem with duplicates: - if we had dependencies `netty-http` and `netty-http2`, because of a prefix-check logic, the notices for `netty-http` would also appear again for `netty-http2`, which is not valid. I have improved the heuristic to avoid these false positives and removed them from the current report. - WIP: button to mark a license type as reviewed (not finished in this PR).	2024-04-25 18:44:51 +00:00
Radosław Waśko	0c989c6938	Writing to Data Links (#9750) ... - Closes #9292 - and also closes #9522	2024-04-25 17:55:49 +00:00
GregoryTravis	b150b091b0	Convert Vector.new_builder to Vector.build in Standard.Base (#9754) ... * Vector.build * new_builder deprecated * convert one * convert vector_spec * limit param * convert vector * docs * changelog * wip * rename limit to capacity * wip * review * append comments * review * wip * wip * fix tests * docs * wip * wip * fix filter warning propagation * doc weird dependencies * fix tests * cleanup * check builder result	2024-04-25 10:38:29 -04:00
Jaroslav Tulach	0d495ffd97	Make conversion of double to BigDecimal exact (#9740) ... Resolves #9607 by computing `Number.hash` by converting given number to `Float` first and then computing the hash. Also the conversion from `Float.to Decimal` is exact - done via `new BigDecimal(double)`. There is `Decimal.new` that handles the user-friendly conversion. However as a result `Decimal.from 2.1 != Decimal.new 2.1` - that's the only way to ensure consistency between hash code and conversions.	2024-04-25 11:22:50 +00:00
James Dunkerley	fb9cf38914	Excel_Workbook.read_many (#9759) ... - Some minor linting fixes. - Adjust `headers` parameter so a dedicated type.  - Fix bug with `read` on an `Excel_Workbook` so error handled more gracefully and not panicking to UI.  - Fix bug when writing to a file with an `Excel_Format` with an invalid extension which was causing a panic.  - Add `read_many` to `Excel_Workbook` allowing reading more than one sheet at a time.	2024-04-24 13:16:44 +00:00
Jaroslav Tulach	ff62c1e25f	Access non-self arguments when widget annotations are computed (#9410)	2024-04-24 03:58:32 +02:00
AdRiley	6f3e649e7a	Make errors propagate out of each (#9742) ... Make errors propagate out of each	2024-04-23 17:14:54 +00:00
AdRiley	4a97bfa31f	Add table running functionality for Sum, Mean, Min, Max. (#9577) ... * Add Table.Running * Code Review fixes * Code Review changes * Change null handling	2024-04-23 09:45:43 +01:00
GregoryTravis	bc61d686c1	Integer.to_decimal and Float.to_decimal (#9716)	2024-04-23 08:06:31 +00:00
Hubert Plociniczak	58009b7c04	In-memory suggestions (#9751) ... This change replaces an sqllite-backed suggestions' repo with a simple, in-memory, one. As `completion` functionality has been implemented completely in GUI, there is no need to support it in backend, which simplifies a lot of functionality. Closes #9650 and #9471. # Important Notes Loading suggestions and sending them to GUI on startup is almost instantaneous. Previously it would take ~10s just for `Standard.Base`.	2024-04-22 11:02:17 +00:00
GregoryTravis	681df82697	Implement Vector.build: implementation and some tests (#9725) ... * Vector.build * new_builder deprecated * convert one * convert vector_spec * limit param * convert vector * docs * changelog * rename limit to capacity * review * append comments * review	2024-04-18 17:52:48 -04:00
James Dunkerley	16126a0c71	Working through various issues from OKR / blog use. (#9739) ... - Fixed `list_directory` so that it works with defaults and uses the `Folder_Browse`.  - Adjusted types of `order_by` in `Aggregate_Column.First` and `Aggregate_Column.Last` so supports single `Sort_Column`. - Adjusted types of `order_by` in `Aggregate_Column.First` and `Aggregate_Column.Last` so an empty Vector is valid (treated as Nothing). - Adjusted `Count_Distinct` so if an empty set of columns then equivalent to `Count`. - Use the multi-select widget for `columns` in `Count_Distinct`.  - Sort the widget for `order_by` in `First` / `Last`.  - Bug fix for widgets with both tagValues and dynamic data. (Thanks @farmaazon). - Use the multi-select for various things.	2024-04-18 21:50:20 +00:00
GregoryTravis	86ecd3e027	Add Decimal.floor, .ceil, and .trunc (#9694)	2024-04-17 18:42:38 +00:00
Radosław Waśko	34f3331561	Implement recursive argument for File.delete (#9719) ... - Closes #8993	2024-04-17 16:53:45 +00:00
Radosław Waśko	0310eb46ab	Highlight stack trace elements from the current project in Test suite reports (#9724) ... If ANSI coloring is enabled, stack trace entries corresponding to the currently running project will be highlighted in bold: 	2024-04-17 13:22:29 +00:00
Radosław Waśko	41a39eb019	Fix Json.parse "" edge case and add a test for it (#9722) ... - Fixes #9720	2024-04-17 08:48:48 +00:00
Hubert Plociniczak	d6f7afc624	Open Java modules for Snowflake setup (#9664) ... # Important Notes Some workarounds are being considered but we need this change sooner than later.	2024-04-16 21:01:32 +00:00
Radosław Waśko	fda41cbfd1	Writing Cloud files (#9686) ... - Closes #9291	2024-04-16 14:01:03 +00:00
Pavel Marek	0d915d0344	Update to GraalVM 24.0.0 (#9647) ... Update the GraalVM-related Maven packages from **23.1.2** to **24.0.0**. # Important Notes - Reverted workarounds mentioned in https://github.com/enso-org/enso/issues/9477 The language home search functionality in Truffle changed. It used to find the home for Enso from the class loader of `EnsoLanguage`: https://github.com/oracle/graal/blob/graal-23.1.2/truffle/src/com.oracle.truffle.polyglot/src/com/oracle/truffle/polyglot/LanguageCache.java#L362 In 24.0.0, the language home is no longer found via class loader, but via system properties: https://github.com/oracle/graal/blob/graal-24.0.0/truffle/src/com.oracle.truffle.polyglot/src/com/oracle/truffle/polyglot/LanguageCache.java#L353 I provided a "fix" for this by an explicit specification of the `org.graalvm.language.enso.home` system property in our launchers.	2024-04-12 17:01:49 +00:00
Radosław Waśko	bdda1830b7	Integrate Cloud path resolver (#9662) ... - Closes #9363 - Cleans up the Cloud mock as it got a bit messy. It still implements the bare minimum to be able to test basic secret and auth handling logic 'offline' (added very simple path resolution, only handling the minimum set of cases for the tests to work). - Adds first implementation of caching Cloud replies. - Currently only caching the `Enso_User.current`. This is a simple one to cache because we do not expect it to ever change, so it can be safely cached for a long period of time (I chose 2h to make it still refresh from time to time while not being noticeable). - We may try using this for caching other values in future PRs.	2024-04-12 13:03:09 +00:00
Pavel Marek	4dc7992ab5	Export works without import (#9683)	2024-04-12 14:23:34 +02:00
Michał Wawrzyniec Urbańczyk	cdf031f61f	[CI] Provide latest FlatBuffers to the Engine build. (#9654) ... This PR bumps the FlatBuffers version used by the backend to `24.3.25` (the latest version as of now). Since the newer FlatBuffers releases come with prebuilt binaries for all platforms we target, we can simplify the build process by simply downloading the required `flatc` binary from the official FlatBuffers GitHub release page. This allows us to remove the dependency on `conda`, which was the only reliable way to get the outdated `flatc`. The `conda` setup has been removed from the CI steps and the relevant code has been removed from the build script. The FlatBuffers version is no longer hard-coded in the Rust build script, it is inferred from the `build.sbt` definition (similar to GraalVM). # Important Notes This does not affect the GUI binary protocol implementation. While I initially wanted to update it, it turned out farly non-trivial. As there are multiple issues with the generated TS code, it was significantly refactored by hand and it is impossible to automatically update it. Work to address this problem is left as [a future task](https://github.com/enso-org/enso/issues/9658). As the Flatbuffers binary protocol is guaranteed to be compatible between versions (unlike the generated sources), there should be no adverse effects from bumping `flatc` only on the backend side.	2024-04-12 10:10:44 +00:00
GregoryTravis	e3afa5561d	Add Decimal.round (#9672)	2024-04-11 15:47:50 +00:00
GregoryTravis	bf90e2e8a8	Attach warning when converting from Decimal to Integer (#9660)	2024-04-11 15:44:58 +00:00
GregoryTravis	676e989f7f	Add Decimal.min and .max (#9663) ... * min and max * changelog * wip * scale approach mostly works * Revert "scale approach mostly works" This reverts commit 88e6073f7a. * review * review * return value type	2024-04-11 09:58:10 -04:00
GregoryTravis	9ac85b93b7	Decimal.parse and .format (#9637) ... * to_text + tests * locale note * format * parse * parse examples * wip * type * changelog	2024-04-11 09:29:59 -04:00
Jaroslav Tulach	32df870ad0	Accept small BigInteger values (#9655)	2024-04-09 14:55:33 +02:00
Radosław Waśko	5650c7aed2	Refactoring Enso_File to be path based (#9581) ... - Closes #9289 - Ensures that we can refer through `Enso_File` to files that do not _yet_ exist - preparing us for implementing the Write functionalities for `Enso_File` (#9291).	2024-04-09 11:15:29 +00:00
Radosław Waśko	354ee94a2f	Make HTTP tests more robust by adding retries to the tests (#9652) ... - As asked for by @hubertp who was encountering flaky test failures on CI in the Http_Spec and related ones, I'm adding retry logic to make such cases much less likely. - I've made the test server randomly fail 50% of tests and with the retry logic the tests are still passing, so I think that should be much more robust, in practice the failure rate is much much less (I imagine <1% as most of the time these tests were working and we do a ton of requests in a single CI run). - I move the `with_retries` method to now be `Test.with_retries` which can be used anywhere in our tests for the retry logic. - It sleeps for 0.1s between retries. Not all kinds of tests need it, this was mostly for propagation delays in the Cloud in our tests. I was thinking if the delay should be configurable, but I think the 0.1s delay is not problematic and if our tests are sometimes failing due to high machine load, the delay could also help. - This _does not_ add retry logic to raw HTTP operations or `Data.fetch`. We may add that later, but that needs some further design. In such case we may remove some retries from tests if they become unnecessary.	2024-04-09 10:07:22 +00:00
Radosław Waśko	fc557f8fd2	Improve handling of File.parent and File.name (#9642) ... - Closes #8906	2024-04-08 22:41:38 +00:00
GregoryTravis	ae91c5eee1	Decimal.abs, .negate, .signum (#9641)	2024-04-08 16:40:27 +00:00
GregoryTravis	973d2c6aea	Decimal arithmetic benchmarks (#9582)	2024-04-04 16:03:35 +00:00
GregoryTravis	c100a88ec3	Make the% consistent across both Integer sizes. (#9589)	2024-04-04 15:27:51 +00:00
Jaroslav Tulach	d9c7bf4138	Testing autoscoped constructors in a vector (#9630)	2024-04-04 17:13:33 +02:00
GregoryTravis	67b5745806	Add range info to Out_Of_Range error (#9586)	2024-04-04 12:25:45 +00:00
Hubert Plociniczak	fdeaf31dd1	Follow up #9611 (#9629)	2024-04-04 11:27:51 +00:00
Hubert Plociniczak	59379eaa4f	Manage analytics client to avoid leaks (#9611) ... This change makes sure to close the Google Analytics client after usage. This will a) ensure that resources are released properly b) potentially fix the exception that is causing problems on some platforms # Important Notes After this change I no longer see in **my** logs: ``` io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: *~*~*~ Previous channel ManagedChannelImpl{logId=1, target=analyticsdata.googleapis.com:443} was not shutdown properly!!! ~*~*~* Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:668) at io.grpc.ForwardingChannelBuilder2.build(ForwardingChannelBuilder2.java:260) at com.google.api.gax.grpc.InstantiatingGrpcChannelProvider.createSingleChannel(InstantiatingGrpcChannelProvider.java:436) at com.google.api.gax.grpc.ChannelPool.<init>(ChannelPool.java:107) at com.google.api.gax.grpc.ChannelPool.create(ChannelPool.java:85) at com.google.api.gax.grpc.InstantiatingGrpcChannelProvider.createChannel(InstantiatingGrpcChannelProvider.java:243) at com.google.api.gax.grpc.InstantiatingGrpcChannelProvider.getTransportChannel(InstantiatingGrpcChannelProvider.java:237) at com.google.api.gax.rpc.ClientContext.create(ClientContext.java:226) at com.google.analytics.data.v1beta.stub.GrpcBetaAnalyticsDataStub.create(GrpcBetaAnalyticsDataStub.java:217) at com.google.analytics.data.v1beta.stub.BetaAnalyticsDataStubSettings.createStub(BetaAnalyticsDataStubSettings.java:288) at com.google.analytics.data.v1beta.BetaAnalyticsDataClient.<init>(BetaAnalyticsDataClient.java:376) at com.google.analytics.data.v1beta.BetaAnalyticsDataClient.create(BetaAnalyticsDataClient.java:358) at org.graalvm.truffle/com.oracle.truffle.host.HostMethodDesc$SingleMethod$MHBase.invokeHandle(HostMethodDesc.java:371) ``` It's important because apparently that's where it would get stuck when trying to log that message.	2024-04-03 13:33:58 +00:00
Hubert Plociniczak	a83c75f8ec	Add missing API for Jackson_Object (#9591) ... `Jackson_Object` supported parsing but not creating JSON from text. With this change, `Jackson_Object` is on par with `JS_Object` API and replaces the latter. The most visible differences come from more detailed parsing exception's messages. Had to add some special cases for corner cases like `NaN` or infinity. Closes #9473.	2024-04-02 20:45:35 +00:00
GregoryTravis	ff562cb454	Conversions from Decimal to Integer and Float. (#9462) ... * wip * wip * Remove unnecessary conversion * changelog * also integer * cleanup * to_float inf * review * Using multiple simple if conditions * review * logging in conversions * cleanup * revert * pending test * truncation * Use TypeOfNode instead of TypesLibrary in InvokeConversionNode * combine cases * rename typesLib * String is not Enso type, return Text --------- Co-authored-by: Jaroslav Tulach <jaroslav.tulach@enso.org>	2024-03-30 10:42:56 -04:00
Pavel Marek	0b94493258	Equality does not swallow errors (#9560) ... `42 == (Error.throw "foo")` now correctly returns an `Error` rather than False # Important Notes The error was in the wrong usage of the `org.enso.interpreter.dsl.AcceptsError` DSL annotation.	2024-03-29 04:11:16 +00:00
AdRiley	c725703f50	Add google analytics sample data (#9571) ... * Stash * Test * Clean up	2024-03-28 20:49:49 +00:00
GregoryTravis	f80e3f3415	Decimal remainder, pow, div (#9566)	2024-03-28 20:20:29 +00:00
GregoryTravis	b74fb5c5c9	Set.to_text should not assume contents are Text (#9548) ... `Set.to_text` fails if the contents are anything other than `Text`.	2024-03-27 19:20:31 +00:00
James Dunkerley	e262801daa	Restructure Standard.Table. (#9559) ... Move the types from `Standard.Table.Data` to `Standard.Table`. Exceptions: - `Standard.Table.Data.Report_Unmatched` => `Standard.Table.Constants`. - `Standard.Table.Data.Join_Kind_Cross` => `Standard.Table.Internal.Join_Kind_Cross`. Also removed constructor as an atom type. - `Standard.Table.Extensions.Table_Ref` => `Standard.Table.Internal.Table_Ref`. - `Standard.Table.Data.Type.Value_Type_Helpers` => `Standard.Table.Internal.Value_Type_Helpers`. - `Standard.Table.Data.Type.Enso_Types` => `Standard.Table.Internal.Value_Type_Helpers`. - `Standard.Table.Data.Type.Storage` => `Standard.Table.Internal.Storage`. Changed all `Standard.Table` imports inside project to be project. Favoured importing from `Standard.Table.Main` in `Standard.Database`. Also fixed some linting in Enso_File.	2024-03-27 17:10:43 +00:00
Radosław Waśko	f2d6079ac4	Fix missing AWS region in S3 operations (#9546) ... - Closes #9284 - Now our tests run without the default `AWS_` config, thus ensuring that the tested setups work in a clean environment. - After all, more complicated logic was needed for buckets access - apparently the AWS SDK only allows for some operations on buckets to happen if the client is connected to the correct region. Thus detection of bucket regions had to be implemented. - Added `AWS_Region` widget based on autoscoping. - Fixed `AWS_Credential.profile_names` crashing if no AWS config was found. Now it returns no profiles if not found. Added a regression test.	2024-03-27 12:00:15 +00:00
Radosław Waśko	af5354b869	Data Link for reading Enso_File (#9525) ... - Closes #9282	2024-03-27 04:17:07 +00:00
Radosław Waśko	431a055608	Use DELETE /assets/<id> for deleting files and secrets (#9551) ... - Closes #9288	2024-03-26 21:48:17 +00:00
James Dunkerley	7098c5e3e6	Apply ICONs and other tweaks. (#9552) ... Lots of ICONs...	2024-03-26 19:44:06 +00:00
AdRiley	60fa83cb84	Make expand_to_rows, expand_column support Rows, Tables, Column data types (#9533) ... Make expand_to_rows work for Table and Column Make expand_column work for Column and Row Makes solving the book club exercise easier  # Important Notes We decided expand_column did not make sense for Table as the resulting Table of Columns would rarely be what was wanted.	2024-03-26 12:31:02 +00:00
AdRiley	64f67d1ad8	Added icon for rows (#9535)	2024-03-25 16:52:23 +00:00
Kaz Wesley	22a2c208c0	Multi-select (part 1) (#9516) ... * Multi-select	2024-03-25 12:05:20 -04:00
Adam Obuchowicz	a6fc8cb932	Reimplement AI PoC from GUI1 (#9476) ... Fixes #9313 [Screencast from 2024-03-22 09-09-07.webm](https://github.com/enso-org/enso/assets/3919101/6ad86145-6882-4bde-993d-b1270f1ec06c) # Important Notes * This is PoC, so I didn't spend time on polishing the visuals; the design will likely change. * I modified the shortcut handler a bit, allowing making multiple actions for same binding - the action's handler will be called in unspecified order, until one of them handle the event (i.e. not return false). * To make it working regardless of imports, I needed to export AI module in Standard.Visualization. Moreover, needed to remove build_ai_prompt for Any, because it was causing issues - expect a bug report soon.	2024-03-25 09:14:41 +00:00
Radosław Waśko	6665c22eb9	Make data-links behave more like 'symlinks' (#9485) ... - Closes #9324	2024-03-22 17:01:54 +00:00
James Dunkerley	283c0b61d9	Data link for Snowflake. (#9514) ... Adding in Snowflake into the Datalink APIs. 	2024-03-21 17:06:56 +00:00
James Dunkerley	1d9d32a6a9	Fix replace widget. (#9505) ... Before:  After: 	2024-03-20 17:47:35 +00:00
James Dunkerley	d2d5b3ba8d	Some fixes working towards a sales demo (#9501) ... - Fixed the `write` format dropdown. - Added `Text_Input` widget to path in various places. - ICONs and Widgets in various places. - Secret name dropdown.	2024-03-20 16:44:50 +00:00
AdRiley	933608e26a	Add new aliases (#9500)	2024-03-20 16:15:00 +00:00
James Dunkerley	2f0d99a1cb	Snowflake Connectivity (#9435) ... * Initial connection to Snowflake via an account, username and password. * Fix databases and schemas in Snowflake. Add warehouses. * Add warehouse. Update schema dropdowns. * Add ability to set warehouse and pass at connect. * Fix for NPE in license review * scalafmt * Separate Snowflake from Database. * Scala fmt. * Legal Review * Avoid using ARROW for snowflake. * Tidy up Entity_Naming_Properties. * Fix for separating Entity_Namimg_Properties. * Allow some tweaking of Postgres dialect to allow snowflake to use as well. * Working on reading Date, Time and Date Times. * Changelog. * Java format. * Make Snowflake Time and TimeStamp stuff work. Move some responsibilities to Type_Mapping. * Make Snowflake Time and TimeStamp stuff work. Move some responsibilities to Type_Mapping. * fix * Update distribution/lib/Standard/Database/0.0.0-dev/src/Connection/Connection.enso Co-authored-by: Radosław Waśko <radoslaw.wasko@enso.org> * PR comments. * Last refactor for PR. * Fix. --------- Co-authored-by: Radosław Waśko <radoslaw.wasko@enso.org> Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>	2024-03-20 10:06:12 +00:00
Radosław Waśko	6e5b4d93a3	Implement refreshing the Cloud token in Enso libraries (#9390) ... - Closes #9300 - Now the Enso libraries are themselves capable of refreshing the access token, thus there is no more problems if the token expires during a long running workflow. - Adds `get_optional_field` sibling to `get_required_field` for more unified parsing of JSON responses from the Cloud. - Adds `expected_type` that checks the type of extracted fields. This way, if the response is malformed we get a nice Enso Cloud error telling us what is wrong with the payload instead of a `Type_Error` later down the line. - Fixes `Test.expect_panic_with` to actually catch only panics. Before it used to also handle dataflow errors - but these have `.should_fail_with` instead. We should distinguish these scenarios.	2024-03-19 19:26:34 +00:00
GregoryTravis	53e2636b8c	Allow Table.replace to take mutiple target columns (#9406)	2024-03-19 19:02:26 +00:00
GregoryTravis	9a9eff1aa6	Decimal type: constuctors, comparisons, and arithmetic (#9272)	2024-03-15 21:13:41 +00:00
Cassandra-Clark	f7295f3060	Added table.from_union and respective tests (#9343) ... Table.from_union creates a new table when passed in a vector of tables. This is especially helpful when a grouped method is run multiple times, as it can create a unified result set.	2024-03-15 18:09:35 +00:00
James Dunkerley	4faae88c72	Wrong type dropdown for join_kind. (#9441) ... Had the incorrect type in the join_kind drop down when overriding for display. 	2024-03-15 09:07:09 +00:00
AdRiley	81c73a9866	Google Analytics Report (#9239) ... * Updating Google Analytics API * Move up one file level * Code Review changes * Code Review Changes * Updated Changelog * Revert * Code Review changes	2024-03-14 10:15:47 +00:00
James Dunkerley	19f15b8f97	Small fixes from building up another demo. (#9385) ... - Fix `Excel_Workbook.sheet` and add a test. - Add icon for `Table.row_count` and `DB_Table.row_count`. - Make `join_kind` widget `Display.Always`. - Add expression as an option to `Aggregate_Column`. - Add `Simple_Calculation.Copy` to create a copy. - Add defaults to `Simple_Expression` so less errory. - Set period to default to day for `date_diff` allowing use in expressions. - Add `Text_Left`, `Text_Right`, `Text_Length` and `Format` to `Simple_Expression`.	2024-03-13 18:13:33 +00:00
AdRiley	2fdb2fca62	Added Table.running (#9382) ... This is a first naïve implementation of Table.running that only supports count. Adding it as a scaffold for the rest of the functionality and to give us a place to agree on the API. (Which I changed slightly from the design)  # Important Notes Only supports Statistic.Count. Other functionality to follow.	2024-03-13 13:28:33 +00:00
Sergei Garin	6bf37b3d17	Update ~/.enso/credentials file (#9287) ... * Pass additional metadata to ~/.enso/credentials * support old and new credentials format * fix some issues after the review * use domain instead of iss field * small fixes * rename Uri -> Url * rename cognito -> Cognito * remove unneeded file --------- Co-authored-by: Radosław Waśko <radoslaw.wasko@enso.org>	2024-03-12 12:41:47 +03:00
AdRiley	cd4a6d456c	Add xml.write tests and .write to XML_Element (#9332) ... * Add xml.write tests and write to XML_Element * Code Review changes * Fix tests	2024-03-11 16:26:06 +00:00
Radosław Waśko	e98306f170	Excel DataLink (#9346) ... - Adds the Excel format as one of the formats supported when creating a data link. - The data link can choose to read the file as a workbook, or read a sheet or range from it as a table, like `Excel_Format`. - Also updated Delimited format dialog to allow customizing the quote style.	2024-03-11 16:12:12 +00:00
Radosław Waśko	2e35189d83	Better error message in Data.read when an argument to format is missing (#9337)	2024-03-11 14:50:32 +00:00
AdRiley	8e1bb16afd	Remove File from File./ (#9330) ... Closes #8905	2024-03-11 10:12:09 +00:00
James Dunkerley	9f9cf58d28	Add selecting by type to the table (#9334) ... - Adds `select_by_type` and `remove_by_type` to tables.	2024-03-08 18:40:53 +00:00
Hubert Plociniczak	f80dd9f593	Demonstrate usage of foreign arrow function (#9150) ... Including arrow language in the distribution by default. Added a basic example for creating an Arrow array. Making sure that memory layout agrees with Arrow specification (padding, continuous allocation of memory chunks). Related to #9118. This should unblock work on allowing serialization/deserialization to/from Parquet but I'd like to delay it to a follow up ticket as it is going to be a significant amount of specialized work.	2024-03-08 15:20:55 +00:00
Radosław Waśko	a3bf5a0be5	Split Excel_Format into 3 constructors (#9308) ... Splitting the `Excel_Format` into 3 constructors.	2024-03-08 14:26:30 +00:00
James Dunkerley	c7d693dfc8	Move Standard.Database.Data to Standard.Database. (#9321) ... Moves the types out of `Data`.	2024-03-07 14:43:38 +00:00
James Dunkerley	1e33723ce9	ICONs and linting... (#9319) ... - Apply all the icons from @Cassandra-Clark. - Fix various linting issues. - Remove circular dependency between Table and Database.	2024-03-07 12:26:32 +00:00
AdRiley	3ebf1340e8	Add write to xml document (#9299) ... * First commit * Add xml.write * Add comment * Changelog.md * Code review changes * Code review changes * Update import	2024-03-06 17:13:28 +00:00
Radosław Waśko	e37862b09d	Implement a Data Link for Postgres (#9269) ... - Closes #9124	2024-03-06 11:57:12 +00:00
James Dunkerley	7f6d10a9e0	Some minor improvements suggested from Ned's use (#9249) ... - Adjusted `AWS_Credential` to have a `Default` and removed support for `Nothing` from functions. - Renamed `Response_Body.to_file` to `Response_Body.write`. - Add `write` to `Response`. - Add `Table.get_value` and `DB_Table.get_value` allowing getting a single value from a table. - Added `Data.download` allowing downloading from a URL to a file. - Added text widget as input widget for `Data` methods. 	2024-03-04 16:33:31 +00:00
AdRiley	8b889f0977	Make Table.To_Xml return a XML_Document (#9263) ... As part of the XML improvements it makes more sense for Table.To_Xml to return a XML_Document.	2024-03-04 15:19:20 +00:00
Jaroslav Tulach	5676618bad	Autoscoped constructors (#9190) ... Fixes #8645 by recognizing `~` prefix to constructor names.	2024-03-04 11:41:02 +00:00