847 Commits

Author	SHA1	Message	Date
Jaroslav Tulach	9632f04e9b	Directly allocate warnings asVectorEnsoObjects (#10143)	2024-06-01 06:23:49 +02:00
AdRiley	af4177e61f	Make table default visualisation (#10128) ... Makes table the default vis type. Before:  After:  Closes #10093	2024-05-31 15:02:02 +00:00
James Dunkerley	ffdfc7195e	Linter and small widget change (#10136) ... Linter issues to allow doc site generation. Small change in order for aggregate column.	2024-05-31 12:30:38 +00:00
AdRiley	06327f8fde	Add statistic product (#10122) ... Add Statistic.Product 	2024-05-31 09:29:52 +00:00
Radosław Waśko	233f28235a	Small fixes to Postgres integration (#10105) ... - Better message when saving datalink in disabled Output context:  Before it was:  - Hack to get Postgres widget to display connection options:  Before the `Postgres` constructor was created without any parameters and it was not showing any parameters for modification.	2024-05-28 14:34:44 +00:00
AdRiley	28bd5c522b	Add named_pattern and make it usable in Text_Replace (#10040) ... Creates a new type Named_Expression and allows it to be used in text_replace    	2024-05-27 13:01:26 +00:00
James Dunkerley	ab4b1f0f35	Add day_of_week and day_of_year to Column and DB_Column (#10081) ... - Adds support for getting the weekday as an integer (1 Monday - 7 Sunday - ISO standard). - Add support for getting the day of year.	2024-05-27 11:29:25 +00:00
James Dunkerley	200da1ad50	Remove old GUI1 ICONs and mapping function (#10086) ... * Remove old GUI1 ICONs and mapping: ``` dataframe_clean: 'table_clean', dataframe_map_row: 'map_row', dataframe_map_column: 'column_add', dataframes_join: 'join2-1', dataframes_union: 'union', sigma: 'transform4', io: 'in_out', date_and_time: 'time', spatial: 'location', predictive: 'predict', machine_learning: 'robot', split_text: 'split', ``` * Linter. * Linter (2). * Sort out some Returns: * Sort out some ? Example	2024-05-27 11:17:21 +01:00
James Dunkerley	d8059fd22c	Some tweaks following Steve's testings (#10042) ... - Add ranged number widget to `at` and `get`. - Add defaults to `at` and `get` picking the first item. - PRIVATE on various Excel_Workbook methods. It still works like a connection but not shown in CB.	2024-05-27 09:04:29 +00:00
AdRiley	adfe2dbab4	Add expression alias (#10067) ... We call formulas expressions so having expression as well as formula makes sense as an alias.	2024-05-24 14:13:00 +00:00
AdRiley	084be279c5	Fix input_number icons (#10066) ... icon is called input_number not number_input 	2024-05-24 11:30:06 +00:00
Adam Obuchowicz	8ac0ee41c6	Allow picking non-existing files in write component (#10047) ... Fixes #9984 Added a flag to `File_Browse` widget configuration specifying if we require an existing file. Also, the FileBrowserWidget will match against all "Writable_File", also displaying Save dialog.	2024-05-24 09:21:32 +00:00
Radosław Waśko	9d75f79ff9	Cloud Integration updates: renames in file metadata structure, remove path resolver workaround, partial fix for datalink resolver issue (#10050) ... - Supersedes #9966 as I wanted to test these changes in one go. - Fixes #10037 caused by lack of CI check and my oversight (forgot to run full tests after a minor change). - Fixes a regression after [file metadata fields were renamed](c09d856ac8 (diff-9f59b6a0ee3155efecdc70c1ea0c90ab5cde00b5623d84363118b1793f941c46R2037)). - Fixes handling of creating new datalinks and using them after cache was cleared (e.g. workflow restart). - This was caused by troubles with path resolver. - The fix addresses the most common issue and adds a test for it (test flushes the caches to ensure path resolver is used instead of the cached value). - Some related issues were discovered on the cloud side, tracked by https://github.com/enso-org/cloud-v2/issues/1252	2024-05-23 16:05:48 +00:00
Jaroslav Tulach	16c1b74218	Enso Library Feature to execute (a bit of) Base_Tests (#9997)	2024-05-23 08:20:19 +02:00
Radosław Waśko	1e0649fda1	Improvements to Table.union (#9968) ... - Closes #9952	2024-05-22 09:38:10 +00:00
marthasharkey	517299bb09	Add new aliases for take and drop methods (#10022) ... Adds the aliases 'keep' and 'remove' to take/drop methods	2024-05-22 08:02:48 +00:00
James Dunkerley	2677e556e8	Align headers in doc comments... (#10025) ... - Always use `Arguments:` for parameters or fields. - Always use `> Example` for examples. - Align sections behind `!` or `?` headers. - Whitespace fixes.	2024-05-21 19:44:58 +00:00
AdRiley	3b59b40657	Update test framework to default to only show failures (#9986) ... * Update test framework to default to only show failures * Fix	2024-05-21 11:23:23 +03:00
James Dunkerley	31dd5944d7	Some fixes to make linter happy (#10004) ... - A few import orderings. - Missing doc comments on Text_Cleanse. - Indent correction.	2024-05-20 16:15:11 +00:00
AdRiley	c7476c10f3	Add data cleanse component (#9879) ... * Signature * More API work * Red * Still red * Green * Red * Green * Red * Green * Refactor * Refactor * Refactor * Red * Green * Red * Green * Red * Green * More tests * non-ascii * Ordering tests * Remove tabs * Numbers and Letters * Changelog.md * Add documentation * Tests for non-text columns * Add punctuation * Add symbols * Fix * Refactor * Refactor * Move to base * Fix * Start of in-db tests. Not working * DB versions * Update widget * Fix widgets * Move tests to base * Code review changes	2024-05-20 09:33:18 +01:00
James Dunkerley	3b29de313d	Update ICONs, linting fixes and add select_columns ALIASes. (#9985) ... - Linting fixes. - Add ICONs to all functions missing them. - Add ALIASes for select columns.	2024-05-17 19:24:17 +00:00
GregoryTravis	4d49b00375	Combine builders for Vector.build and Vector.new_builder (#9922) ... We have decided to keep the old new_builder, and to combine the new and old builders into one builder.	2024-05-17 16:18:47 +00:00
AdRiley	5c9ee94812	Make parse_fast_json private (#9978) ... Micro MR to make deprecated method private	2024-05-17 15:47:11 +00:00
Radosław Waśko	38ad7b0afa	Creating datalinks from code (#9957) ... - Closes #9673 - Adds the ability to save an existing Postgres connection as a datalink into the Enso Cloud, automatically promoting plain-text passwords into a Secret. - Fixes dataflow error propagation in `JS_Object.from_pairs`.	2024-05-16 13:29:41 +00:00
Radosław Waśko	a2481036e6	Prepare for the Path resolver change to GET (#9958) ... - Prepares for the Cloud API change, together with a fallback for the old API to avoid problems during migration. - This PR should be merged before the https://github.com/enso-org/cloud-v2/pull/1236 PR is _deployed_.	2024-05-15 13:00:32 +00:00
James Dunkerley	b2aeb9fc84	Moving away from Integer | Nothing to Rows_To_Read for limiting number of rows. (#9925) ... - Added a new `Rows_To_Read` type with conversions from `Nothing` and integers. - Updated `read` on `Table`, `Column`, `DB_Table` and `DB_Column`. - Updated `Delimited_Format.Delimited` to use `Rows_To_Read` for `row_limit`. - Updated `Excel_Format.Sheet` and `Excel_Format.Range` to use `Rows_To_Read` for `row_limit`. - Updated `Excel_Workbook.read` to use `Rows_To_Read`. - Updated `Connection.read` (in all connection types) to use `Rows_To_Read`.  	2024-05-14 16:31:26 +00:00
James Dunkerley	2d6735edc7	Allow a Table to be used to rename_columns. (#9940) ... Following an example from Steve, adjusted `rename_column` to allow a `Table` to define the mapping. - A single Text column table gives a list of new names. - A two Text column table gives a map from old name to new name. - If a `DB_Table` is passed errors and tells the user to materialize the table. 	2024-05-14 15:57:10 +00:00
Radosław Waśko	5f0a16c87c	Audit Logs for Postgres connections opened through a data link (#9873) ... - Closes #9599 - Implemented API for sending audit logs to the cloud on a background thread. - If the Postgres connection is opened through a datalink, its internal JDBC connection is replaced by a wrapper that reports executed queries to the audit log. - Also introduces `EnsoMeta` - a helper Java class that can be used in our helper libraries to access Enso types. - I have replaced the common pattern scattered throughout the codebase with calls to this 'library' to avoid repetitive code. - Refactored `Table.display` to share code between in-memory and DB - it was needed as the function stopped working for `DB_Table` after adding making the `Table` constructor `private`. - Clearer error when reading a SQLite database from a remote file (tells the user to download it first). - Follow up - correlate asset id of the data link: #9869 - Follow up - include project name (once bug is fixed): #9875 - Some problems/improvements of the audit log: - The audit log system is not yet ready for high throughput of logs #9870 - The logs may be lost if `System.exit` is used #9871	2024-05-11 08:54:33 +00:00
James Dunkerley	d97754da17	Error messages for rename_columns and Vector.duplicates (#9917) ... - Improve error message for `rename_columns`. - Add `length` to `Set` and `Map`. - Add `duplicates` to `Vector` (and `Array`). 	2024-05-10 17:43:50 +00:00
GregoryTravis	720d32cbe3	Convert most remaining uses of Vector.new_builder to Vector.build (#9891)	2024-05-09 15:52:53 +00:00
Radosław Waśko	1d8fc1bf6e	Update endpoint name after it was updated in the Cloud (#9912) ... Micro PR updating our API integration to the Cloud-side changes.	2024-05-09 15:17:19 +00:00
AdRiley	e25ec96aaa	Add table running variance skew sd and kurtosis (#9854) ... Adds support for Variance, Skew, Standard Deviation and Kurtosis to Table.Running.	2024-05-09 08:45:29 +00:00
James Dunkerley	ce360f9002	Fix the group colours for consistent colouring. (#9893) ... Fix the group colour to a fixed set. 	2024-05-08 16:52:42 +00:00
James Dunkerley	4e758e5c9d	Undo change to autoscoping. (#9881) ... Can't use auto-scoping for filter yet.	2024-05-08 07:52:12 +00:00
GregoryTravis	a2c36def26	Add Vector.build_multiple and handle dataflow error and warning propagation in build and build_multiple (#9766)	2024-05-07 19:30:21 +00:00
James Dunkerley	c0fd6eed2d	Small tweaks from Ned, Mark, Cass and Steve's feedback. (#9859) ... - Rename `.info` to `.column_info`. - Rename `.select_by_type` to `.select_columns_by_type`. (to be merged into `select_columns` functionality) - Rename `.remove_by_type` to `.remove_columns_by_type`. (to be merged into `remove_columns` functionality) - Adding "field" `ALIAS`es. - Making `Table.Value` private (and hence hiding `java_table`). - Making `Column.Value` private (and hence hiding `java_column`, added method to `Storage` to allow tests to work). - Making `DB_Table.Value` private (and hence hiding `connection`, `context` and `internal_columns`). - Making `DB_Column.Value` private (and hence hiding `connection`, `sql_type_reference`, `expression` and `context`). - Add widgets for everywhere `Filter_Condition` used (fix missing entry for lower, can't use auto-scoping).  - Fix for widgets in `Simple_Calculation`: `date_add` and `format`.   - Fix for nested `Row`, `Column` and `DB_Column` rendering in Table Viz.   # Important Notes - Can't use `.` to access a private constructor field when mapping, have to use a lambda. - We should agree convention for private backing fields which are wrapped by a public getter (went with `internal_` for this pass).	2024-05-06 13:49:12 +00:00
Dmitry Bushev	a44bb2b1b1	Language Server API for AI (#9679) ... close #9656 Changelog: - add: `ai/completion_v2` method - add: `Visualization.AI.print` method for converting the expression to text format - update: The default system prompt was updated to tell AI to use the `Visualization.AI.print` method for printing. # Important Notes The project [New_Project_1.zip](https://github.com/enso-org/enso/files/15152993/New_Project_1.zip) contains the following main file: ```py from Standard.Base import all from Standard.Table import all from Standard.Database import all from Standard.AWS import all import Standard.Visualization import Standard.Visualization.Warnings from Standard.Base.Errors.Common import Dry_Run_Operation type Student Value id region main = operator70395 = 226 operator47321 = 'east' operator76980 = Student.Value operator70395 operator47321 operator31302 = operator47321.words True operator91574 = 1 operator34358 = operator47321.take (Index_Sub_Range.By_Index [0, operator91574]) #### METADATA #### [[{"index":{"value":0},"size":{"value":4}},"4cf8de7f-2014-4dfd-9ceb-0164fe26c8bf"],[{"index":{"value":0},"size":{"value":29}},"389fe7a5-e59b-440a-8801-e0bd86716094"],[{"index":{"value":0},"size":{"value":558}},"a8a81ce3-199e-479e-98dd-5f919425842d"],[{"index":{"value":5},"size":{"value":8}},"c6f0de99-3bd3-459d-a69b-5fc774dd1e3f"],[{"index":{"value":5},"size":{"value":13}},"05827411-7354-478b-99d8-8370dadd560b"],[{"index":{"value":13},"size":{"value":1}},"41de94cc-ccd2-4ccf-b9db-cf686443efa0"],[{"index":{"value":14},"size":{"value":4}},"8abd24ea-b1cb-4c10-ad16-5a190f7ed0c7"],[{"index":{"value":19},"size":{"value":6}},"5c57a62d-ed82-4195-8b78-2ed660556dd0"],[{"index":{"value":26},"size":{"value":3}},"23544334-1117-4dbc-ac7f-bb3f84575264"],[{"index":{"value":30},"size":{"value":4}},"6058ba89-dc1b-45e1-b8f3-d1a4d27975f7"],[{"index":{"value":30},"size":{"value":30}},"bdd4b4cc-9c1e-4554-b0fb-3f73dcd5a590"],[{"index":{"value":35},"size":{"value":8}},"7e7bb9b4-8e9b-4700-9dcd-83c353800da5"],[{"index":{"value":35},"size":{"value":14}},"524bafb6-d3ca-4ee5-b8de-84b5c47ca87b"],[{"index":{"value":43},"size":{"value":1}},"b68b3929-8b63-49ad-977c-b04e058f8ee4"],[{"index":{"value":44},"size":{"value":5}},"7173f374-5f53-462b-ab1b-f7b1845d729b"],[{"index":{"value":50},"size":{"value":6}},"911d381e-1bdb-4e9c-826d-a00495c8fd23"],[{"index":{"value":57},"size":{"value":3}},"2f8fa1ee-9d13-4a73-99b2-bc77d1656387"],[{"index":{"value":61},"size":{"value":4}},"11abd658-4888-476c-afcd-592edaaa53c1"],[{"index":{"value":61},"size":{"value":33}},"9f6ae949-410b-48e6-bb75-84d4ba8a1989"],[{"index":{"value":66},"size":{"value":8}},"f4726e40-dd5b-49a0-aa2a-6cea6df88d5d"],[{"index":{"value":66},"size":{"value":17}},"539b4dcf-4487-49b6-9c90-6ae58d51c2db"],[{"index":{"value":74},"size":{"value":1}},"a34a41a0-5dcf-4c47-a36c-a4f427c87c03"],[{"index":{"value":75},"size":{"value":8}},"8fdf4ee7-2e74-4cac-b9b9-4230183f91c5"],[{"index":{"value":84},"size":{"value":6}},"7ff7efdc-fed6-4cb6-bed6-392d110ff991"],[{"index":{"value":91},"size":{"value":3}},"eacff407-dc6d-4f17-a28b-329f7a0582e1"],[{"index":{"value":95},"size":{"value":4}},"f2feac9f-ea02-4070-879a-f1d493473993"],[{"index":{"value":95},"size":{"value":28}},"f9b37b67-fb54-4e47-8281-e922edb4c5d3"],[{"index":{"value":100},"size":{"value":8}},"6cf398f8-d0c9-42fa-a6e6-e740de11562f"],[{"index":{"value":100},"size":{"value":12}},"28e4d0e3-7da4-4ee2-94c7-d9a7c692f8de"],[{"index":{"value":108},"size":{"value":1}},"955e8788-816c-4eb7-b5ec-020b4863536a"],[{"index":{"value":109},"size":{"value":3}},"bdc65807-0438-4296-8b1f-1fab3a885c17"],[{"index":{"value":113},"size":{"value":6}},"fe3dd265-1855-4d66-8a2d-51153b21e699"],[{"index":{"value":120},"size":{"value":3}},"3b7a14ac-3224-4b9a-b474-f6136a658f8b"],[{"index":{"value":124},"size":{"value":6}},"7f7f18a4-06ef-46e0-bddd-b9fe60878855"],[{"index":{"value":124},"size":{"value":29}},"d49e0fe3-a638-4d7e-ba58-12db7abad20f"],[{"index":{"value":131},"size":{"value":8}},"c9411433-5e73-4927-9175-15d3b1ccb0ef"],[{"index":{"value":131},"size":{"value":22}},"b53ad817-ea4c-491e-aaf8-49967e22aff6"],[{"index":{"value":139},"size":{"value":1}},"837a4d65-8af6-4860-ae0e-ad9172af6ad2"],[{"index":{"value":140},"size":{"value":13}},"3b662906-1887-4dd6-a0e2-a222ace135ce"],[{"index":{"value":154},"size":{"value":6}},"548ca873-544f-48c9-b7ab-6aa1e7f03d72"],[{"index":{"value":154},"size":{"value":38}},"7c45872c-22b4-4f37-bcd7-b3791408f737"],[{"index":{"value":161},"size":{"value":8}},"21152f0d-4222-48e4-9376-a2a28f8f6be6"],[{"index":{"value":161},"size":{"value":22}},"1cb71d49-a06d-4dd9-bc1b-54603b416601"],[{"index":{"value":161},"size":{"value":31}},"faa46cf2-3e90-44ed-9d9e-77b7f874b338"],[{"index":{"value":169},"size":{"value":1}},"6d5fdcd5-0ddf-4c83-aafe-a446ac5ce461"],[{"index":{"value":170},"size":{"value":13}},"830d73c2-1898-41a9-8046-22d86f159ef0"],[{"index":{"value":183},"size":{"value":1}},"ab897380-c596-4182-a2c5-b7b23cf59893"],[{"index":{"value":184},"size":{"value":8}},"29f35cf2-d79d-44d0-96d0-79b11589726c"],[{"index":{"value":193},"size":{"value":4}},"45bf8220-52f2-49f4-bbcf-9566d1f1b1c4"],[{"index":{"value":193},"size":{"value":57}},"478005ac-f0ca-497a-b298-554bd64946a9"],[{"index":{"value":198},"size":{"value":8}},"c11511ce-252c-4b84-9f61-dfa5544d4916"],[{"index":{"value":198},"size":{"value":13}},"dbae65a1-bdca-44b0-a497-7934d1e42616"],[{"index":{"value":198},"size":{"value":20}},"355392ad-8c81-4304-a6d0-2bbf3690da0c"],[{"index":{"value":198},"size":{"value":27}},"0720ccb5-ebd3-4c29-8113-0aa1f251e873"],[{"index":{"value":206},"size":{"value":1}},"f5a8d310-1f58-456e-84a3-78490f05ff13"],[{"index":{"value":207},"size":{"value":4}},"10046e78-5164-407c-adef-2ab11ce77b4c"],[{"index":{"value":211},"size":{"value":1}},"ed23da0c-9193-4eea-ab9c-fee90ba8f924"],[{"index":{"value":212},"size":{"value":6}},"7a09de10-35e2-45e0-9eb8-f79fa054b733"],[{"index":{"value":218},"size":{"value":1}},"b85a0981-9d82-4204-a03a-cd3a4720c72d"],[{"index":{"value":219},"size":{"value":6}},"1b04c19d-cdf0-4661-8f4e-d980cf12c996"],[{"index":{"value":226},"size":{"value":6}},"87d57f2c-e009-48a7-98bb-0e1612905564"],[{"index":{"value":233},"size":{"value":17}},"60fd6a1c-7ada-4546-ae20-e1f8b432b4fd"],[{"index":{"value":252},"size":{"value":4}},"9558affa-b913-4576-8ee3-6af22985e0f6"],[{"index":{"value":252},"size":{"value":32}},"8479091c-9232-49d6-b375-32f89693c389"],[{"index":{"value":257},"size":{"value":7}},"3d1f13f5-e22a-4cb6-9e75-9c717e016922"],[{"index":{"value":264},"size":{"value":1}},"aa429f07-973a-4c69-8e3f-74aa4780f85a"],[{"index":{"value":269},"size":{"value":5}},"5b304cf6-5ec4-4b23-ad0d-20e38b41cdcd"],[{"index":{"value":269},"size":{"value":15}},"e3315ef2-d0ec-43b1-b8f6-5b436054aaee"],[{"index":{"value":275},"size":{"value":2}},"bc7205c4-68bf-461e-a1ba-31400b9337ff"],[{"index":{"value":278},"size":{"value":6}},"78870c05-9117-4e24-bf77-a72e7aef9c18"],[{"index":{"value":286},"size":{"value":4}},"517c743f-c775-4031-8f87-222d0f0a365f"],[{"index":{"value":286},"size":{"value":271}},"d0d107bc-4997-41d6-9c20-32295590eaac"],[{"index":{"value":291},"size":{"value":1}},"91174930-f18b-4322-84cc-deb88637d012"],[{"index":{"value":292},"size":{"value":265}},"f09a4372-3231-4f2e-99f4-84aa751f9b60"],[{"index":{"value":297},"size":{"value":13}},"613df8c9-0a40-4c94-886f-9668c2c360c2"],[{"index":{"value":297},"size":{"value":19}},"5b88a4d4-6840-4a25-a862-8b5d0b75303d"],[{"index":{"value":311},"size":{"value":1}},"6bfe1dea-09df-4358-9613-74d8326bc680"],[{"index":{"value":313},"size":{"value":3}},"e3b7fac7-0c08-4f20-8a0c-a58f1b118097"],[{"index":{"value":321},"size":{"value":13}},"37d007fe-9cb6-4f2e-a8b7-30842eac60b2"],[{"index":{"value":321},"size":{"value":22}},"4233204a-543d-437a-a9fc-9f79853a9540"],[{"index":{"value":335},"size":{"value":1}},"6c01783b-27ba-413c-84a4-6a94a37d714a"],[{"index":{"value":337},"size":{"value":1}},"34bc865a-58b5-4c49-bf85-a8cfedaf9b54"],[{"index":{"value":337},"size":{"value":6}},"bb556514-570d-4a87-8b2a-6e7f198a975f"],[{"index":{"value":338},"size":{"value":4}},"87c2cedc-898e-43c3-be3d-24e15689c373"],[{"index":{"value":342},"size":{"value":1}},"13387ff5-ec5e-453a-86f2-deae721b5549"],[{"index":{"value":348},"size":{"value":13}},"6280a86b-5469-43f3-94d5-1e1726028a54"],[{"index":{"value":348},"size":{"value":57}},"a17c5e55-5e99-4e4f-961d-9b4072ecd6e4"],[{"index":{"value":362},"size":{"value":1}},"c0720382-9ce4-451a-a04b-f248143d2528"],[{"index":{"value":364},"size":{"value":7}},"9cd51399-d9d2-4898-9bcb-be2f540999ff"],[{"index":{"value":364},"size":{"value":13}},"b4980bfc-13cc-429f-bc43-9edfc07d2406"],[{"index":{"value":364},"size":{"value":27}},"1a3f6a8c-ab27-43dd-a494-bf413334fd9a"],[{"index":{"value":364},"size":{"value":41}},"71a97e88-9b19-4ec9-b3c8-ffd2940c4cb8"],[{"index":{"value":371},"size":{"value":1}},"99f38c61-3ea7-4b02-be71-f293fbecb7d7"],[{"index":{"value":372},"size":{"value":5}},"08820818-ddb9-408a-b913-e9382e5b6dc7"],[{"index":{"value":378},"size":{"value":13}},"2cf06b4e-af9f-492e-ac13-5723a896a508"],[{"index":{"value":392},"size":{"value":13}},"6c887279-5998-45ce-81ab-c37fdeb03144"],[{"index":{"value":410},"size":{"value":13}},"6c126d22-c018-46cc-bdae-cf8b89104173"],[{"index":{"value":410},"size":{"value":40}},"a65c1fa8-9fce-4c30-bef7-d85ff1b428eb"],[{"index":{"value":424},"size":{"value":1}},"208c049e-e221-49ce-99d7-96142f2d1b1c"],[{"index":{"value":426},"size":{"value":13}},"0adf4ddd-1402-4b96-bfb0-1917cc275063"],[{"index":{"value":426},"size":{"value":19}},"f2158ac6-2dd5-482d-9f3d-0bf4812d6d6e"],[{"index":{"value":426},"size":{"value":24}},"c7bbc3e7-1377-429e-b60a-0c2d2cd4ea74"],[{"index":{"value":439},"size":{"value":1}},"1a17a7ee-31d7-4885-84ce-c902bff4ea4a"],[{"index":{"value":440},"size":{"value":5}},"47016cac-40a0-45f6-8057-2b81edb052a5"],[{"index":{"value":446},"size":{"value":4}},"ce4fa4cd-5064-4752-9dbc-5fcf4e92138a"],[{"index":{"value":455},"size":{"value":13}},"3300001d-13ea-45f4-acbe-959813bcf85b"],[{"index":{"value":455},"size":{"value":17}},"b8f5900b-2370-4b21-8a0c-06d3bbb45068"],[{"index":{"value":469},"size":{"value":1}},"19ea3187-83d6-47d1-994c-64cf0ce9af3b"],[{"index":{"value":471},"size":{"value":1}},"9457c3f8-c878-4f01-a5c7-39336f163a28"],[{"index":{"value":477},"size":{"value":13}},"a5139627-05a8-4838-b171-02666c62c348"],[{"index":{"value":477},"size":{"value":80}},"8b5c864c-055d-4d11-a470-2679328fc131"],[{"index":{"value":491},"size":{"value":1}},"eb01b0af-06cf-4d75-81ad-d0bf7664b2d7"],[{"index":{"value":493},"size":{"value":13}},"6c042eb7-e895-473d-b456-6e0eec23e958"],[{"index":{"value":493},"size":{"value":18}},"f40730ff-ac6c-45db-8970-534f3becda2a"],[{"index":{"value":493},"size":{"value":64}},"b2df8ba8-683c-45c2-9932-8e1c970c799a"],[{"index":{"value":506},"size":{"value":1}},"2289bf31-74dd-431c-97f1-3ac179715453"],[{"index":{"value":507},"size":{"value":4}},"6db4523a-0bcd-4ba5-b6c2-7720db57d93c"],[{"index":{"value":512},"size":{"value":1}},"b6faea17-664d-470a-9641-999b6a2be5bd"],[{"index":{"value":512},"size":{"value":45}},"98aea277-bc44-4ceb-85a6-24ee453b7f72"],[{"index":{"value":513},"size":{"value":15}},"c0ae1c05-026d-4712-a571-979ce260b310"],[{"index":{"value":513},"size":{"value":24}},"502e8e4d-5105-4abe-8dba-4d7293cbe80b"],[{"index":{"value":513},"size":{"value":43}},"71cee748-378b-4817-be0e-b87bc1d3d847"],[{"index":{"value":528},"size":{"value":1}},"fcaad3ac-e080-4170-9d63-b2c01295447d"],[{"index":{"value":529},"size":{"value":8}},"a053e05a-4862-4407-abe8-2746784bdfc3"],[{"index":{"value":538},"size":{"value":1}},"9adae78d-7667-4865-83e9-b64464b13696"],[{"index":{"value":538},"size":{"value":18}},"92f153e3-da05-439e-bb4f-596ec8cfa9c8"],[{"index":{"value":539},"size":{"value":1}},"dddedc5e-415d-4f5d-ab1b-19468aa079a9"],[{"index":{"value":540},"size":{"value":1}},"4adce2e5-1e60-4a63-9ff3-5781d967b704"],[{"index":{"value":542},"size":{"value":13}},"ef06ed1e-246f-4106-a4c0-1e648b8ad5e7"],[{"index":{"value":555},"size":{"value":1}},"7bd1cc5f-20b1-4dd2-8a34-ccc40f5f091a"],[{"index":{"value":556},"size":{"value":1}},"720adbd6-24b0-49ac-b123-61cc037a9636"]] {"ide":{"node":{"e3b7fac7-0c08-4f20-8a0c-a58f1b118097":{"position":{"vector":[-224,13]}},"bb556514-570d-4a87-8b2a-6e7f198a975f":{"position":{"vector":[115,19]}},"71a97e88-9b19-4ec9-b3c8-ffd2940c4cb8":{"position":{"vector":[-224,-51]}},"c7bbc3e7-1377-429e-b60a-0c2d2cd4ea74":{"position":{"vector":[360,19]},"visualization":{"show":false,"fullscreen":false,"width":200}},"f2158ac6-2dd5-482d-9f3d-0bf4812d6d6e":{"position":{"vector":[297,-45]},"visualization":{"show":false,"fullscreen":false,"width":96}},"9457c3f8-c878-4f01-a5c7-39336f163a28":{"position":{"vector":[640,40]},"visualization":{"show":false,"fullscreen":false,"width":200}},"b2df8ba8-683c-45c2-9932-8e1c970c799a":{"position":{"vector":[219,-80]},"visualization":{"show":true,"fullscreen":false,"width":200}},"f40730ff-ac6c-45db-8970-534f3becda2a":{"position":{"vector":[219,-48]}}},"import":{}}} ``` To test the functionality, I asked AI to show me the result of the `operator70395` variable: 1. Init protocol connection ```json {"jsonrpc":"2.0","id":0,"method":"session/initProtocolConnection","params":{"clientId":"d8e948fd-6418-43c8-9f02-54827f09e10a"}} ``` 2. Create execution context ```json {"jsonrpc":"2.0","id":0,"method":"session/initProtocolConnection","params":{"clientId":"d8e948fd-6418-43c8-9f02-54827f09e10a"}} ``` 3. Push the main method ```json {"jsonrpc":"2.0","id":0,"method":"executionContext/push","params":{"contextId":"730a66ef-4222-46f8-8a03-d766946ab2bd","stackItem":{"methodPointer":{"module":"local.New_Project_1.Main","definedOnType":"local.New_Project_1.Main","name":"main"},"positionalArgumentsExpressions":[],"type":"ExplicitCall"}}} ``` 4. Ask AI for the variable contents ```json {"jsonrpc":"2.0","id":1,"method":"ai/completion_v2","params":{"contextId":"730a66ef-4222-46f8-8a03-d766946ab2bd","expressionId":"f09a4372-3231-4f2e-99f4-84aa751f9b60","prompt":"There is 'operator70395' variable defined in the program. What is the result of the variable 'operator70395'?"}} ``` I got the following responses: ```json {"jsonrpc":"2.0","method":"ai/completionProgress","params":{"code":"Visualization.AI.print(operator70395)","reason":"To provide the result of 'operator70395', I need to know its current value.","visualizationId":"edfb00a3-6ce5-41e1-bb8f-ab191809114e"}} ``` ```json {"jsonrpc":"2.0","id":1,"result":{"Success":{"fn":"def get_operator70395_result():\n return operator70395","fnCall":"get_operator70395_result()"}}} ```	2024-05-02 16:55:06 +00:00
AdRiley	5350b2d00d	Refactor add row number (#9822) ... * Refactor add row number * Refactor * Green * Green * Remove dead code * Cleanup * Deduplicate check	2024-05-02 12:29:54 +01:00
James Dunkerley	d2e6ff260e	Restructure SQLite_Details. (#9832) ... ``` type SQLite_Details SQLite location:File|In_Memory type In_Memory ``` to ``` type SQLite From_File location:File In_Memory ``` # Important Notes Splits the In-Memory entry for Database Connect but still works nicely.  	2024-05-01 22:15:41 +00:00
James Dunkerley	4d6d6f239c	Handle URL encoding automatically in query string. (#9823) ... A small fix to automatically encode the query string. Attaches a warning if needed.  	2024-04-30 22:03:46 +00:00
Radosław Waśko	f87c75a3da	Prepare for Cloud Environment variable name change (#9821) ... Changing `ENSO_PROJECT_DIRECTORY_PATH` to `ENSO_CLOUD_PROJECT_DIRECTORY_PATH`.	2024-04-30 16:02:12 +00:00
AdRiley	d1bf4cb771	Add Ignored_Nothing_Values (#9770) ... Add a `IgnoredNothing` warning for Table.Running   	2024-04-30 13:30:40 +00:00
Pavel Marek	660c5e7a9d	Atom constructors can be private (#9692) ... Closes #8836. Atom constructors can be declared as private (project-private). project-private constructors can be called only from the same project. See the encapsulation.md docs for more info. --------- Co-authored-by: Jaroslav Tulach <jaroslav.tulach@enso.org> Co-authored-by: Radosław Waśko <radoslaw.wasko@enso.org> Co-authored-by: Hubert Plociniczak <hubert.plociniczak@gmail.com> Co-authored-by: Kaz Wesley <kaz@lambdaverse.org>	2024-04-29 14:43:18 +02:00
Radosław Waśko	16e1999040	Fix copy_to/move_to edge case when source and target are the same (#9798) ... - Adds tests for an edge case where the source and target of copy/move operation are the same. - And fixes the behaviour to be as expected.	2024-04-29 12:29:07 +00:00
Radosław Waśko	8e03e3be9c	Print pending groups in-line and include their reason, also add progress bar to the runner (#9796) ... - Closes #9534 by printing the pending groups with pending reason - Re-introduces original ordering of tests - Adds a progress bar to the test suite runner in 'interactive' mode (if ANSI colors are enabled, progress bar will also be)	2024-04-26 16:05:05 +00:00
James Dunkerley	c5179309fd	Improve Table Viz handling of Numbers (#9793) ... - Added support for NaN, Infinity and -Infinity in the Table viz. - Simplified the logic so all the formatting in a single place in the Table viz. - Sorted Number formatting for BigInt and < 10000.  	2024-04-26 07:52:40 +00:00
Radosław Waśko	df4a7efcdd	Add AWS SSO JARs to the Standard.AWS library (#9782) ... As reported by our users, when using the AWS SSO, our code was failing with: ``` Execution finished with an error: To use Sso related properties in the 'xyz' profile, the 'sso' service module must be on the class path. ``` This PR adds the missing JARs to fix that. Additionally it improves the license review tool UX a bit (parts of #9122): - sorting the report by amount of problems, so that dependencies with unresolved problems appear at the top, - semi-automatic helper button to rename package configurations after a version bump, - button to remove stale entries from config (files or copyrights that disappeared after update), - button to add custom copyright notice text straight from the report UI, - button to set a file as the license for the project (creating the `custom-license` file automatically) - ability to filter processed projects - e.g. `openLegalReviewReport AWS` will only run on the AWS subproject - saving time processing unchanged dependencies, - updated the license search heuristic, fixing a problem with duplicates: - if we had dependencies `netty-http` and `netty-http2`, because of a prefix-check logic, the notices for `netty-http` would also appear again for `netty-http2`, which is not valid. I have improved the heuristic to avoid these false positives and removed them from the current report. - WIP: button to mark a license type as reviewed (not finished in this PR).	2024-04-25 18:44:51 +00:00
Radosław Waśko	0c989c6938	Writing to Data Links (#9750) ... - Closes #9292 - and also closes #9522	2024-04-25 17:55:49 +00:00
GregoryTravis	b150b091b0	Convert Vector.new_builder to Vector.build in Standard.Base (#9754) ... * Vector.build * new_builder deprecated * convert one * convert vector_spec * limit param * convert vector * docs * changelog * wip * rename limit to capacity * wip * review * append comments * review * wip * wip * fix tests * docs * wip * wip * fix filter warning propagation * doc weird dependencies * fix tests * cleanup * check builder result	2024-04-25 10:38:29 -04:00
Jaroslav Tulach	0d495ffd97	Make conversion of double to BigDecimal exact (#9740) ... Resolves #9607 by computing `Number.hash` by converting given number to `Float` first and then computing the hash. Also the conversion from `Float.to Decimal` is exact - done via `new BigDecimal(double)`. There is `Decimal.new` that handles the user-friendly conversion. However as a result `Decimal.from 2.1 != Decimal.new 2.1` - that's the only way to ensure consistency between hash code and conversions.	2024-04-25 11:22:50 +00:00
James Dunkerley	fb9cf38914	Excel_Workbook.read_many (#9759) ... - Some minor linting fixes. - Adjust `headers` parameter so a dedicated type.  - Fix bug with `read` on an `Excel_Workbook` so error handled more gracefully and not panicking to UI.  - Fix bug when writing to a file with an `Excel_Format` with an invalid extension which was causing a panic.  - Add `read_many` to `Excel_Workbook` allowing reading more than one sheet at a time.	2024-04-24 13:16:44 +00:00
Jaroslav Tulach	ff62c1e25f	Access non-self arguments when widget annotations are computed (#9410)	2024-04-24 03:58:32 +02:00
AdRiley	6f3e649e7a	Make errors propagate out of each (#9742) ... Make errors propagate out of each	2024-04-23 17:14:54 +00:00
AdRiley	4a97bfa31f	Add table running functionality for Sum, Mean, Min, Max. (#9577) ... * Add Table.Running * Code Review fixes * Code Review changes * Change null handling	2024-04-23 09:45:43 +01:00
GregoryTravis	bc61d686c1	Integer.to_decimal and Float.to_decimal (#9716)	2024-04-23 08:06:31 +00:00
GregoryTravis	681df82697	Implement Vector.build: implementation and some tests (#9725) ... * Vector.build * new_builder deprecated * convert one * convert vector_spec * limit param * convert vector * docs * changelog * rename limit to capacity * review * append comments * review	2024-04-18 17:52:48 -04:00
James Dunkerley	16126a0c71	Working through various issues from OKR / blog use. (#9739) ... - Fixed `list_directory` so that it works with defaults and uses the `Folder_Browse`.  - Adjusted types of `order_by` in `Aggregate_Column.First` and `Aggregate_Column.Last` so supports single `Sort_Column`. - Adjusted types of `order_by` in `Aggregate_Column.First` and `Aggregate_Column.Last` so an empty Vector is valid (treated as Nothing). - Adjusted `Count_Distinct` so if an empty set of columns then equivalent to `Count`. - Use the multi-select widget for `columns` in `Count_Distinct`.  - Sort the widget for `order_by` in `First` / `Last`.  - Bug fix for widgets with both tagValues and dynamic data. (Thanks @farmaazon). - Use the multi-select for various things.	2024-04-18 21:50:20 +00:00
GregoryTravis	86ecd3e027	Add Decimal.floor, .ceil, and .trunc (#9694)	2024-04-17 18:42:38 +00:00
Radosław Waśko	34f3331561	Implement recursive argument for File.delete (#9719) ... - Closes #8993	2024-04-17 16:53:45 +00:00
Radosław Waśko	0310eb46ab	Highlight stack trace elements from the current project in Test suite reports (#9724) ... If ANSI coloring is enabled, stack trace entries corresponding to the currently running project will be highlighted in bold: 	2024-04-17 13:22:29 +00:00
Radosław Waśko	41a39eb019	Fix Json.parse "" edge case and add a test for it (#9722) ... - Fixes #9720	2024-04-17 08:48:48 +00:00
Hubert Plociniczak	d6f7afc624	Open Java modules for Snowflake setup (#9664) ... # Important Notes Some workarounds are being considered but we need this change sooner than later.	2024-04-16 21:01:32 +00:00
Radosław Waśko	fda41cbfd1	Writing Cloud files (#9686) ... - Closes #9291	2024-04-16 14:01:03 +00:00
Pavel Marek	0d915d0344	Update to GraalVM 24.0.0 (#9647) ... Update the GraalVM-related Maven packages from **23.1.2** to **24.0.0**. # Important Notes - Reverted workarounds mentioned in https://github.com/enso-org/enso/issues/9477 The language home search functionality in Truffle changed. It used to find the home for Enso from the class loader of `EnsoLanguage`: https://github.com/oracle/graal/blob/graal-23.1.2/truffle/src/com.oracle.truffle.polyglot/src/com/oracle/truffle/polyglot/LanguageCache.java#L362 In 24.0.0, the language home is no longer found via class loader, but via system properties: https://github.com/oracle/graal/blob/graal-24.0.0/truffle/src/com.oracle.truffle.polyglot/src/com/oracle/truffle/polyglot/LanguageCache.java#L353 I provided a "fix" for this by an explicit specification of the `org.graalvm.language.enso.home` system property in our launchers.	2024-04-12 17:01:49 +00:00
Radosław Waśko	bdda1830b7	Integrate Cloud path resolver (#9662) ... - Closes #9363 - Cleans up the Cloud mock as it got a bit messy. It still implements the bare minimum to be able to test basic secret and auth handling logic 'offline' (added very simple path resolution, only handling the minimum set of cases for the tests to work). - Adds first implementation of caching Cloud replies. - Currently only caching the `Enso_User.current`. This is a simple one to cache because we do not expect it to ever change, so it can be safely cached for a long period of time (I chose 2h to make it still refresh from time to time while not being noticeable). - We may try using this for caching other values in future PRs.	2024-04-12 13:03:09 +00:00
Pavel Marek	4dc7992ab5	Export works without import (#9683)	2024-04-12 14:23:34 +02:00
GregoryTravis	e3afa5561d	Add Decimal.round (#9672)	2024-04-11 15:47:50 +00:00
GregoryTravis	bf90e2e8a8	Attach warning when converting from Decimal to Integer (#9660)	2024-04-11 15:44:58 +00:00
GregoryTravis	676e989f7f	Add Decimal.min and .max (#9663) ... * min and max * changelog * wip * scale approach mostly works * Revert "scale approach mostly works" This reverts commit 88e6073f7a. * review * review * return value type	2024-04-11 09:58:10 -04:00
GregoryTravis	9ac85b93b7	Decimal.parse and .format (#9637) ... * to_text + tests * locale note * format * parse * parse examples * wip * type * changelog	2024-04-11 09:29:59 -04:00
Jaroslav Tulach	32df870ad0	Accept small BigInteger values (#9655)	2024-04-09 14:55:33 +02:00
Radosław Waśko	5650c7aed2	Refactoring Enso_File to be path based (#9581) ... - Closes #9289 - Ensures that we can refer through `Enso_File` to files that do not _yet_ exist - preparing us for implementing the Write functionalities for `Enso_File` (#9291).	2024-04-09 11:15:29 +00:00
Radosław Waśko	354ee94a2f	Make HTTP tests more robust by adding retries to the tests (#9652) ... - As asked for by @hubertp who was encountering flaky test failures on CI in the Http_Spec and related ones, I'm adding retry logic to make such cases much less likely. - I've made the test server randomly fail 50% of tests and with the retry logic the tests are still passing, so I think that should be much more robust, in practice the failure rate is much much less (I imagine <1% as most of the time these tests were working and we do a ton of requests in a single CI run). - I move the `with_retries` method to now be `Test.with_retries` which can be used anywhere in our tests for the retry logic. - It sleeps for 0.1s between retries. Not all kinds of tests need it, this was mostly for propagation delays in the Cloud in our tests. I was thinking if the delay should be configurable, but I think the 0.1s delay is not problematic and if our tests are sometimes failing due to high machine load, the delay could also help. - This _does not_ add retry logic to raw HTTP operations or `Data.fetch`. We may add that later, but that needs some further design. In such case we may remove some retries from tests if they become unnecessary.	2024-04-09 10:07:22 +00:00
Radosław Waśko	fc557f8fd2	Improve handling of File.parent and File.name (#9642) ... - Closes #8906	2024-04-08 22:41:38 +00:00
GregoryTravis	ae91c5eee1	Decimal.abs, .negate, .signum (#9641)	2024-04-08 16:40:27 +00:00
GregoryTravis	973d2c6aea	Decimal arithmetic benchmarks (#9582)	2024-04-04 16:03:35 +00:00
GregoryTravis	c100a88ec3	Make the% consistent across both Integer sizes. (#9589)	2024-04-04 15:27:51 +00:00
Jaroslav Tulach	d9c7bf4138	Testing autoscoped constructors in a vector (#9630)	2024-04-04 17:13:33 +02:00
GregoryTravis	67b5745806	Add range info to Out_Of_Range error (#9586)	2024-04-04 12:25:45 +00:00
Hubert Plociniczak	fdeaf31dd1	Follow up #9611 (#9629)	2024-04-04 11:27:51 +00:00
Hubert Plociniczak	59379eaa4f	Manage analytics client to avoid leaks (#9611) ... This change makes sure to close the Google Analytics client after usage. This will a) ensure that resources are released properly b) potentially fix the exception that is causing problems on some platforms # Important Notes After this change I no longer see in **my** logs: ``` io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: *~*~*~ Previous channel ManagedChannelImpl{logId=1, target=analyticsdata.googleapis.com:443} was not shutdown properly!!! ~*~*~* Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:668) at io.grpc.ForwardingChannelBuilder2.build(ForwardingChannelBuilder2.java:260) at com.google.api.gax.grpc.InstantiatingGrpcChannelProvider.createSingleChannel(InstantiatingGrpcChannelProvider.java:436) at com.google.api.gax.grpc.ChannelPool.<init>(ChannelPool.java:107) at com.google.api.gax.grpc.ChannelPool.create(ChannelPool.java:85) at com.google.api.gax.grpc.InstantiatingGrpcChannelProvider.createChannel(InstantiatingGrpcChannelProvider.java:243) at com.google.api.gax.grpc.InstantiatingGrpcChannelProvider.getTransportChannel(InstantiatingGrpcChannelProvider.java:237) at com.google.api.gax.rpc.ClientContext.create(ClientContext.java:226) at com.google.analytics.data.v1beta.stub.GrpcBetaAnalyticsDataStub.create(GrpcBetaAnalyticsDataStub.java:217) at com.google.analytics.data.v1beta.stub.BetaAnalyticsDataStubSettings.createStub(BetaAnalyticsDataStubSettings.java:288) at com.google.analytics.data.v1beta.BetaAnalyticsDataClient.<init>(BetaAnalyticsDataClient.java:376) at com.google.analytics.data.v1beta.BetaAnalyticsDataClient.create(BetaAnalyticsDataClient.java:358) at org.graalvm.truffle/com.oracle.truffle.host.HostMethodDesc$SingleMethod$MHBase.invokeHandle(HostMethodDesc.java:371) ``` It's important because apparently that's where it would get stuck when trying to log that message.	2024-04-03 13:33:58 +00:00
Hubert Plociniczak	a83c75f8ec	Add missing API for Jackson_Object (#9591) ... `Jackson_Object` supported parsing but not creating JSON from text. With this change, `Jackson_Object` is on par with `JS_Object` API and replaces the latter. The most visible differences come from more detailed parsing exception's messages. Had to add some special cases for corner cases like `NaN` or infinity. Closes #9473.	2024-04-02 20:45:35 +00:00
GregoryTravis	ff562cb454	Conversions from Decimal to Integer and Float. (#9462) ... * wip * wip * Remove unnecessary conversion * changelog * also integer * cleanup * to_float inf * review * Using multiple simple if conditions * review * logging in conversions * cleanup * revert * pending test * truncation * Use TypeOfNode instead of TypesLibrary in InvokeConversionNode * combine cases * rename typesLib * String is not Enso type, return Text --------- Co-authored-by: Jaroslav Tulach <jaroslav.tulach@enso.org>	2024-03-30 10:42:56 -04:00
Pavel Marek	0b94493258	Equality does not swallow errors (#9560) ... `42 == (Error.throw "foo")` now correctly returns an `Error` rather than False # Important Notes The error was in the wrong usage of the `org.enso.interpreter.dsl.AcceptsError` DSL annotation.	2024-03-29 04:11:16 +00:00
AdRiley	c725703f50	Add google analytics sample data (#9571) ... * Stash * Test * Clean up	2024-03-28 20:49:49 +00:00
GregoryTravis	f80e3f3415	Decimal remainder, pow, div (#9566)	2024-03-28 20:20:29 +00:00
GregoryTravis	b74fb5c5c9	Set.to_text should not assume contents are Text (#9548) ... `Set.to_text` fails if the contents are anything other than `Text`.	2024-03-27 19:20:31 +00:00
James Dunkerley	e262801daa	Restructure Standard.Table. (#9559) ... Move the types from `Standard.Table.Data` to `Standard.Table`. Exceptions: - `Standard.Table.Data.Report_Unmatched` => `Standard.Table.Constants`. - `Standard.Table.Data.Join_Kind_Cross` => `Standard.Table.Internal.Join_Kind_Cross`. Also removed constructor as an atom type. - `Standard.Table.Extensions.Table_Ref` => `Standard.Table.Internal.Table_Ref`. - `Standard.Table.Data.Type.Value_Type_Helpers` => `Standard.Table.Internal.Value_Type_Helpers`. - `Standard.Table.Data.Type.Enso_Types` => `Standard.Table.Internal.Value_Type_Helpers`. - `Standard.Table.Data.Type.Storage` => `Standard.Table.Internal.Storage`. Changed all `Standard.Table` imports inside project to be project. Favoured importing from `Standard.Table.Main` in `Standard.Database`. Also fixed some linting in Enso_File.	2024-03-27 17:10:43 +00:00
Radosław Waśko	f2d6079ac4	Fix missing AWS region in S3 operations (#9546) ... - Closes #9284 - Now our tests run without the default `AWS_` config, thus ensuring that the tested setups work in a clean environment. - After all, more complicated logic was needed for buckets access - apparently the AWS SDK only allows for some operations on buckets to happen if the client is connected to the correct region. Thus detection of bucket regions had to be implemented. - Added `AWS_Region` widget based on autoscoping. - Fixed `AWS_Credential.profile_names` crashing if no AWS config was found. Now it returns no profiles if not found. Added a regression test.	2024-03-27 12:00:15 +00:00
Radosław Waśko	af5354b869	Data Link for reading Enso_File (#9525) ... - Closes #9282	2024-03-27 04:17:07 +00:00
Radosław Waśko	431a055608	Use DELETE /assets/<id> for deleting files and secrets (#9551) ... - Closes #9288	2024-03-26 21:48:17 +00:00
James Dunkerley	7098c5e3e6	Apply ICONs and other tweaks. (#9552) ... Lots of ICONs...	2024-03-26 19:44:06 +00:00
AdRiley	60fa83cb84	Make expand_to_rows, expand_column support Rows, Tables, Column data types (#9533) ... Make expand_to_rows work for Table and Column Make expand_column work for Column and Row Makes solving the book club exercise easier  # Important Notes We decided expand_column did not make sense for Table as the resulting Table of Columns would rarely be what was wanted.	2024-03-26 12:31:02 +00:00
AdRiley	64f67d1ad8	Added icon for rows (#9535)	2024-03-25 16:52:23 +00:00
Kaz Wesley	22a2c208c0	Multi-select (part 1) (#9516) ... * Multi-select	2024-03-25 12:05:20 -04:00
Adam Obuchowicz	a6fc8cb932	Reimplement AI PoC from GUI1 (#9476) ... Fixes #9313 [Screencast from 2024-03-22 09-09-07.webm](https://github.com/enso-org/enso/assets/3919101/6ad86145-6882-4bde-993d-b1270f1ec06c) # Important Notes * This is PoC, so I didn't spend time on polishing the visuals; the design will likely change. * I modified the shortcut handler a bit, allowing making multiple actions for same binding - the action's handler will be called in unspecified order, until one of them handle the event (i.e. not return false). * To make it working regardless of imports, I needed to export AI module in Standard.Visualization. Moreover, needed to remove build_ai_prompt for Any, because it was causing issues - expect a bug report soon.	2024-03-25 09:14:41 +00:00
Radosław Waśko	6665c22eb9	Make data-links behave more like 'symlinks' (#9485) ... - Closes #9324	2024-03-22 17:01:54 +00:00
James Dunkerley	283c0b61d9	Data link for Snowflake. (#9514) ... Adding in Snowflake into the Datalink APIs. 	2024-03-21 17:06:56 +00:00
James Dunkerley	1d9d32a6a9	Fix replace widget. (#9505) ... Before:  After: 	2024-03-20 17:47:35 +00:00
James Dunkerley	d2d5b3ba8d	Some fixes working towards a sales demo (#9501) ... - Fixed the `write` format dropdown. - Added `Text_Input` widget to path in various places. - ICONs and Widgets in various places. - Secret name dropdown.	2024-03-20 16:44:50 +00:00
AdRiley	933608e26a	Add new aliases (#9500)	2024-03-20 16:15:00 +00:00
James Dunkerley	2f0d99a1cb	Snowflake Connectivity (#9435) ... * Initial connection to Snowflake via an account, username and password. * Fix databases and schemas in Snowflake. Add warehouses. * Add warehouse. Update schema dropdowns. * Add ability to set warehouse and pass at connect. * Fix for NPE in license review * scalafmt * Separate Snowflake from Database. * Scala fmt. * Legal Review * Avoid using ARROW for snowflake. * Tidy up Entity_Naming_Properties. * Fix for separating Entity_Namimg_Properties. * Allow some tweaking of Postgres dialect to allow snowflake to use as well. * Working on reading Date, Time and Date Times. * Changelog. * Java format. * Make Snowflake Time and TimeStamp stuff work. Move some responsibilities to Type_Mapping. * Make Snowflake Time and TimeStamp stuff work. Move some responsibilities to Type_Mapping. * fix * Update distribution/lib/Standard/Database/0.0.0-dev/src/Connection/Connection.enso Co-authored-by: Radosław Waśko <radoslaw.wasko@enso.org> * PR comments. * Last refactor for PR. * Fix. --------- Co-authored-by: Radosław Waśko <radoslaw.wasko@enso.org> Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>	2024-03-20 10:06:12 +00:00
Radosław Waśko	6e5b4d93a3	Implement refreshing the Cloud token in Enso libraries (#9390) ... - Closes #9300 - Now the Enso libraries are themselves capable of refreshing the access token, thus there is no more problems if the token expires during a long running workflow. - Adds `get_optional_field` sibling to `get_required_field` for more unified parsing of JSON responses from the Cloud. - Adds `expected_type` that checks the type of extracted fields. This way, if the response is malformed we get a nice Enso Cloud error telling us what is wrong with the payload instead of a `Type_Error` later down the line. - Fixes `Test.expect_panic_with` to actually catch only panics. Before it used to also handle dataflow errors - but these have `.should_fail_with` instead. We should distinguish these scenarios.	2024-03-19 19:26:34 +00:00
GregoryTravis	53e2636b8c	Allow Table.replace to take mutiple target columns (#9406)	2024-03-19 19:02:26 +00:00
GregoryTravis	9a9eff1aa6	Decimal type: constuctors, comparisons, and arithmetic (#9272)	2024-03-15 21:13:41 +00:00
Cassandra-Clark	f7295f3060	Added table.from_union and respective tests (#9343) ... Table.from_union creates a new table when passed in a vector of tables. This is especially helpful when a grouped method is run multiple times, as it can create a unified result set.	2024-03-15 18:09:35 +00:00
James Dunkerley	4faae88c72	Wrong type dropdown for join_kind. (#9441) ... Had the incorrect type in the join_kind drop down when overriding for display. 	2024-03-15 09:07:09 +00:00
AdRiley	81c73a9866	Google Analytics Report (#9239) ... * Updating Google Analytics API * Move up one file level * Code Review changes * Code Review Changes * Updated Changelog * Revert * Code Review changes	2024-03-14 10:15:47 +00:00
James Dunkerley	19f15b8f97	Small fixes from building up another demo. (#9385) ... - Fix `Excel_Workbook.sheet` and add a test. - Add icon for `Table.row_count` and `DB_Table.row_count`. - Make `join_kind` widget `Display.Always`. - Add expression as an option to `Aggregate_Column`. - Add `Simple_Calculation.Copy` to create a copy. - Add defaults to `Simple_Expression` so less errory. - Set period to default to day for `date_diff` allowing use in expressions. - Add `Text_Left`, `Text_Right`, `Text_Length` and `Format` to `Simple_Expression`.	2024-03-13 18:13:33 +00:00
AdRiley	2fdb2fca62	Added Table.running (#9382) ... This is a first naïve implementation of Table.running that only supports count. Adding it as a scaffold for the rest of the functionality and to give us a place to agree on the API. (Which I changed slightly from the design)  # Important Notes Only supports Statistic.Count. Other functionality to follow.	2024-03-13 13:28:33 +00:00
Sergei Garin	6bf37b3d17	Update ~/.enso/credentials file (#9287) ... * Pass additional metadata to ~/.enso/credentials * support old and new credentials format * fix some issues after the review * use domain instead of iss field * small fixes * rename Uri -> Url * rename cognito -> Cognito * remove unneeded file --------- Co-authored-by: Radosław Waśko <radoslaw.wasko@enso.org>	2024-03-12 12:41:47 +03:00
AdRiley	cd4a6d456c	Add xml.write tests and .write to XML_Element (#9332) ... * Add xml.write tests and write to XML_Element * Code Review changes * Fix tests	2024-03-11 16:26:06 +00:00
Radosław Waśko	e98306f170	Excel DataLink (#9346) ... - Adds the Excel format as one of the formats supported when creating a data link. - The data link can choose to read the file as a workbook, or read a sheet or range from it as a table, like `Excel_Format`. - Also updated Delimited format dialog to allow customizing the quote style.	2024-03-11 16:12:12 +00:00
Radosław Waśko	2e35189d83	Better error message in Data.read when an argument to format is missing (#9337)	2024-03-11 14:50:32 +00:00
AdRiley	8e1bb16afd	Remove File from File./ (#9330) ... Closes #8905	2024-03-11 10:12:09 +00:00
James Dunkerley	9f9cf58d28	Add selecting by type to the table (#9334) ... - Adds `select_by_type` and `remove_by_type` to tables.	2024-03-08 18:40:53 +00:00
Hubert Plociniczak	f80dd9f593	Demonstrate usage of foreign arrow function (#9150) ... Including arrow language in the distribution by default. Added a basic example for creating an Arrow array. Making sure that memory layout agrees with Arrow specification (padding, continuous allocation of memory chunks). Related to #9118. This should unblock work on allowing serialization/deserialization to/from Parquet but I'd like to delay it to a follow up ticket as it is going to be a significant amount of specialized work.	2024-03-08 15:20:55 +00:00
Radosław Waśko	a3bf5a0be5	Split Excel_Format into 3 constructors (#9308) ... Splitting the `Excel_Format` into 3 constructors.	2024-03-08 14:26:30 +00:00
James Dunkerley	c7d693dfc8	Move Standard.Database.Data to Standard.Database. (#9321) ... Moves the types out of `Data`.	2024-03-07 14:43:38 +00:00
James Dunkerley	1e33723ce9	ICONs and linting... (#9319) ... - Apply all the icons from @Cassandra-Clark. - Fix various linting issues. - Remove circular dependency between Table and Database.	2024-03-07 12:26:32 +00:00
AdRiley	3ebf1340e8	Add write to xml document (#9299) ... * First commit * Add xml.write * Add comment * Changelog.md * Code review changes * Code review changes * Update import	2024-03-06 17:13:28 +00:00
Radosław Waśko	e37862b09d	Implement a Data Link for Postgres (#9269) ... - Closes #9124	2024-03-06 11:57:12 +00:00
James Dunkerley	7f6d10a9e0	Some minor improvements suggested from Ned's use (#9249) ... - Adjusted `AWS_Credential` to have a `Default` and removed support for `Nothing` from functions. - Renamed `Response_Body.to_file` to `Response_Body.write`. - Add `write` to `Response`. - Add `Table.get_value` and `DB_Table.get_value` allowing getting a single value from a table. - Added `Data.download` allowing downloading from a URL to a file. - Added text widget as input widget for `Data` methods. 	2024-03-04 16:33:31 +00:00
AdRiley	8b889f0977	Make Table.To_Xml return a XML_Document (#9263) ... As part of the XML improvements it makes more sense for Table.To_Xml to return a XML_Document.	2024-03-04 15:19:20 +00:00
Jaroslav Tulach	5676618bad	Autoscoped constructors (#9190) ... Fixes #8645 by recognizing `~` prefix to constructor names.	2024-03-04 11:41:02 +00:00
Radosław Waśko	39af372bcd	Allow resolving enso:// URIs in Data.read and other places (#9225) ... - Implements the core parts of #9048 - Currently the path resolution is done by resolving each segment, one by one - requiring as many API calls as there are segments in the path. - This should be replaced in a followup PR, once https://github.com/enso-org/cloud-v2/issues/899 is implemented.	2024-03-02 16:04:30 +00:00
James Dunkerley	964fdfd7ea	Align XML_Document and XML_Element APIs more. (#9233) ... - Added `to_table` extensions on some core types. - Added ICON to `Any.to`. - Added ICON to `Column.info`, `Table.info`, `DB_Column.info` and `DB_Table.info`. - Added defaults to `Table.cross_tab` and `DB_Table.cross_tab`. - Added `name`, `get`, `at`, `inner_xml` and `outer_xml` to `XML_Document`. - Added constants into left hand side of simple expressions. - Added widget to `get` and `at` on `XML_Document` and `XML_Element`. (Some bug in annotation code with Dmitry) - Altered `get` and `at` to not allow XPath and just get direct child/attribute values. - Added `get_xpath` to `XML_Document`. - Renamed `get_elements_by_tag_name` to `get_descendants_by_tag_name` and added new `get_children_by_tag_name`. - Added `child_names` and `attribute_names` to `XML_Document` and `XML_Element`.	2024-03-01 17:42:44 +00:00
Radosław Waśko	4316709379	Implementing reading Data Links (#9215) ... - Close #9123	2024-03-01 15:33:21 +00:00
Radosław Waśko	b33802a1d1	Start using pre-signed URLs for Enso Files (#9227) ... Since the cloud finally gives us the pre-signed URLs, we can start using that.	2024-03-01 01:01:21 +00:00
GregoryTravis	54675b1e4d	Implement Table.replace for the database backend (#8986)	2024-02-29 18:36:42 +00:00
Radosław Waśko	47c64167ef	Clearer warnings in license review (#9134) ... - Closes #9120 - Reorders CI steps to do the license check last (to avoid it preventing tests from running which are more important than the license check) - Tries to reword the warnings to be clearer - Adds some CSS to the report to more clearly indicate which elements can be clicked.	2024-02-27 16:32:08 +00:00
AdRiley	259ad09957	Update dry run warning messages (#9183)	2024-02-27 10:15:03 +00:00
James Dunkerley	8f2b9da664	IsNa to IsNothing, missing to Nothing in Table code. (#9154) ... Starting to use Nothing everywhere...	2024-02-26 10:52:07 +00:00
AdRiley	4420a403a9	Add ability to choose dimensions and metrics to google analytics report (#9156) ... * Metrics and Dimensions from Vector * Add dropdowns * Small cleanup * Updated list from Cass	2024-02-24 21:31:54 +00:00
AdRiley	0d635626aa	Added unique, deduplicate aliases for distinct (#9152) ... Added unique, deduplicate aliases for distinct	2024-02-23 11:12:21 +00:00
James Dunkerley	288a00a01f	Fix issue with date columns being fetched from Postgres. (#9143) ... Quick bug fix that was caused by us not handling `java.sql.Date` and mapping to `java.time.LocalDate`.	2024-02-22 20:39:42 +00:00
James Dunkerley	0e2a91cfe1	Remove countMissing from Storage and replace with a new CountNothing operation. (#9137) ... Removing another small piece of logic from the storages to it's own operation.	2024-02-22 19:32:46 +00:00
Radosław Waśko	d817df94a5	Move Enso_Cloud from Data to top-level in Standard.Base (#9140) ... - 4 weeks ago we discussed with @jdunkerley we may want to move this module. - `Data` is a submodule mostly for various data-structures etc., the cloud stuff did not fit that well in there.	2024-02-22 14:42:35 +00:00
Pavel Marek	21e1284086	Enso tests can be run with filter from cmdline (#9065) ... Simplify the `Test.Suite.run_with_filter` to accept a single filter parameter that searches for all the groups and specs that matches that filter. This filter can be a simple text provided from the command line. # Important Notes - Pending groups are now printed at the end of the run - `Test.Suite.run_with_filter` is simplified to accept a single filter parameter that is either `Text` or `Nothing`. See the docs. - Passing a filter from the command line is therefore straightforward, it is treated as a regex. - For convenience, I have left all the `main` methods in all the test sources. I have just refactored them to accept the `filter` argument from the command line. - For example, to run only a single spec from `Vector_Spec.enso`, invoke `enso --run test/Base_Tests/src/Data/Vector_Spec.enso "should allow vector creation with a programmatic constructor"` - **Majority of the PR is a regex replace** of `^main =` for `main filter=Nothing =` and of `suite.run_with_filter` for `suite.run_with_filter filter`. - **Fixed some internal engine bugs:** - `AtomWithHole` allows to specify only one hole - https://github.com/enso-org/enso/pull/9065/files#diff-0f7bb7e85cf86a965de133aa7e6b5958ceb889bd1921c01e00d3a9ceb19626ef - NaN keys in hash maps are handled in polyglot maps as well - c5257f6c2b78f893214ff67300893b593ea05e21..db4b3c0e9828ee79208d52e02586b24bb845b0d6	2024-02-22 12:31:44 +00:00
James Dunkerley	e50ded8b24	Rename new_name to as on Aggregate_Column. (#9135) ... Small tweak renaming a property. 	2024-02-22 10:34:00 +00:00
Radosław Waśko	d845e709a1	Refactor S3 path handling (#9092) ... - Closes #9021	2024-02-22 09:15:34 +00:00
James Dunkerley	fa6fccb99e	Refactoring Table.set for GUI2 and other GUI fixes (#9128) ... - Added `regex` function to `Standard.Base` as a way to easily and cleanly make regular expressions. - Added `expr` and `Expression.Value` to distinguish expressions from text values. - Fixed issues with `Table.join` widget so dropdown exists. - Needed fully qualified name. - Added default empty text values for right column to provided text input boxes. - Deprecate `Table.filter_by_expression` and allow `Table.filter` to take an `Expression`. - Added `Simple_Expression` and deprecated `Column_Operation`. Changes the order so takes a column then a calculation. - Rename `column` to `value` and `new_name` to `as` on `Table.set`. - Rename `name_column` to `names` on `Table.cross_tab`. - Removed `Column_Ref.Expression` in favour of using `Expression.Value`.	2024-02-21 23:51:41 +00:00
AdRiley	4cbdc9dfb6	Remove table aliases (#9098) ... Now Table and DB_Table have different names we can remove a lot of aliases. This closes #8981	2024-02-20 01:03:57 +00:00
Radosław Waśko	167a91dab1	Updating Enso Cloud integration - cheaper Enso_Secret.create, introducing Enso_File.creation_time and last_modified_time (#9085) ... - Closes #9047	2024-02-19 18:53:20 +00:00
AdRiley	27ec236c19	rename database Table to DB_Table (#9067) ... Rename database.Table to database.DB_Table to avoid name collisions as part of https://github.com/enso-org/enso/issues/8981	2024-02-19 17:31:58 +00:00
James Dunkerley	ee66b9fb1d	Refactoring the Unary operations so uncoupled from Storage. (#9090) ... In order to allow clever masking, slicing, filtering and arrow backing stores... - Adding ColumnStorage interface with the base API a storage will need. - Refactored each of the unary operations to a new `UnaryOperation` interface which makes them responsible for deciding if they can be executed.	2024-02-19 17:11:52 +00:00
Jaroslav Tulach	a664dd9d56	Equality with conversions (#9070)	2024-02-19 17:18:56 +01:00
Jaroslav Tulach	f1d4e546d5	Upgrading to GraalVM 21.0.2 (#8883) ... Upgrades to latest GraalVM 21.0.2	2024-02-19 12:08:59 +00:00
Radosław Waśko	cf71a05c3b	Refactor common context handling pattern (#9087)	2024-02-19 11:59:42 +00:00
Radosław Waśko	642d5a691e	Implement copy_to and move_to for S3_File (#9054) ... - Closes #8833 - Tests for copying between S3 and `Enso_File` will only be added once we implement Enso_File writing.	2024-02-16 10:42:28 +00:00