Commit Graph

139 Commits

Author SHA1 Message Date
Neil O'Toole
452a91547c
Better handling of download cache refresh (#366)
* A failed download cache refresh no longer destroys the previous cache.
2024-01-26 15:18:38 -07:00
Neil O'Toole
cf0908abfa
JSON ingest performance (#365)
* Implement json ingestion stmt caching
2024-01-25 09:21:56 -07:00
Neil O'Toole
2898a92983
Refactor sqlmodel pkg (#364)
* Refactor sqlmodel pkg
2024-01-25 00:42:51 -07:00
Neil O'Toole
26f0c9a381
Refactor source.Files (#363)
* Moved `source.Files` to its own package, thus the type is now `files.Files`.
* Moved much of the location functionality from pkg `source` to its own package `location`.
2024-01-24 23:29:55 -07:00
Neil O'Toole
bb4a4edaab
Switch downloads to use streamcache. (#361)
* Switch downloads to use neilotoole/streamcache.
2024-01-24 21:01:24 -07:00
Neil O'Toole
9aa45b1db3
More progress bars (#357)
* More progress bars
2024-01-14 20:56:54 -07:00
Neil O'Toole
db55986980
#307: Ingest cache (#354)
- Support for ingest cache, download cache, and progress bars.
2024-01-14 18:45:34 -07:00
Neil O'Toole
67a30d7129
Better detection of stdin input (#346) 2023-12-06 13:53:24 -07:00
Neil O'Toole
880c817958
Added aliases for cmd inspect flags; added aliases for order_by and group_by (#340) 2023-11-22 11:36:34 -07:00
Neil O'Toole
f85da722ad
#335 decimal type support (#336)
* Now using a dedicated `decimal.Decimal` type instead of float/string.
2023-11-21 14:49:52 -07:00
neilotoole
986faa1dd7 cmd diff help fix 2023-11-20 14:47:19 -07:00
Neil O'Toole
096e209a01
sq inspect now has --schemata and --catalogs modes (#334)
* Add --schemata and --catalogs flags to "sq inspect"
2023-11-20 14:42:38 -07:00
neilotoole
1b99583adc linting 2023-11-20 06:12:41 -07:00
neilotoole
5cd61489ad Docs typo 2023-11-20 00:06:52 -07:00
Neil O'Toole
25b9d87b08
Revert deletion of cmd sql --exec and --query flags (#333)
* Revert deletion of cmd sql --exec and --query flags

* Fixed conflicts
2023-11-20 00:04:23 -07:00
Neil O'Toole
0f9b5e2a75
"sq version" now honors format.datetime option (#330)
* sq version now honors config option format.date

* CHANGELOG update

* sq version now honors config option format.date
2023-11-19 20:28:09 -07:00
Neil O'Toole
2de993acaa
Sort imports using goimports-reviser (#331) 2023-11-19 18:06:36 -07:00
Neil O'Toole
d7fc315028
sq inspect now shows catalog (when outputting in JSON and YAML format) (#329) 2023-11-19 07:21:38 -07:00
neilotoole
a01c3240e7 Disable --exedc and --query flags on cmd sql 2023-11-18 21:37:36 -07:00
neilotoole
781e7ea235 CHANGELOG clarifications 2023-11-18 21:27:38 -07:00
Neil O'Toole
82727b3890
Refactor/rename database to pool (#328)
* Renamed `driver.Database` to `driver.Pool` (and related things)

* workflow: Update tparse version

* workflow: Update golangci-lint version
2023-11-18 19:21:14 -07:00
Neil O'Toole
f07edef14d
Add flag --src.schema (#326)
* Support for --src.schema in commands "slq", "sql", and "inspect"
2023-11-18 17:05:48 -07:00
neilotoole
4b1c4bdaec cmd version: was missing newline in output 2023-08-20 08:50:24 -06:00
Neil O'Toole
611ad30f60
Test ingest Excel file format variants (#303)
* Tests for additional formats

* Tests for ingest Excel file format variants
2023-08-20 07:22:24 -06:00
Neil O'Toole
edc933d897
#200: Feature/200 excel driver (#301)
* Switch to excelize driver
2023-08-16 09:09:50 -06:00
Neil O'Toole
c7bba4dfe4
go1.21: changes to support slog as part of stdlib (#299)
* go1.21: changes to support slog as part of stdlib

* Removed accidentially checked-in line of code

* Fixed minor linting issues; reenable typecheck

* go1.21: switched to stdlib slices pkg
2023-08-12 12:54:14 -06:00
Neil O'Toole
3c4b61b806
#200: Excel date format config (#294)
* Config options to control Excel date/time output format
2023-08-03 23:41:33 -06:00
Neil O'Toole
21c1dea9c4
#200: Switch excel driver for output (#291)
* Switched from xlsxw to excelw for Excel outpt
2023-07-26 22:19:11 -06:00
Neil O'Toole
6ca26f4e4f
Column rename: template now has Alpha field. (#285)
* wip: refactor col name mungeing

* Finished refactoring FieldMeta

* Renamed tpl .AlphaIndex to .Alpha

* wip: debugging source config override

* Source config override passing tests

* CHANGELOG update
2023-07-08 19:34:53 -06:00
Neil O'Toole
9c5836ef1c
#191: XLSX driver auto-detects header row (#284)
* xlsx driver now detects header row.
2023-07-08 09:21:27 -06:00
Neil O'Toole
4ffaae925f
#99: Rename duplicate ingest headers (#283)
* CSV now renames duplicate ingest headers

* Fix broken test

* xlsx ingester now handles duplicate col names

* Update CHANGELOG

* Additional tests for ingest.column.rename

* Removed dead comment in grammar
2023-07-04 11:31:47 -06:00
Neil O'Toole
7396aadb9e
#12: multiple joins (#280)
* The query language now supports multiple joins.
2023-07-03 09:34:19 -06:00
Neil O'Toole
072cb4f515
Tidy go.mod; revert osquery lib to original package (#276) 2023-06-22 21:07:27 -06:00
Neil O'Toole
9ebd1c4b01
Fix cmd version bug on windows (#275) 2023-06-22 11:34:35 -06:00
Neil O'Toole
a5c4f9d6bd
#263: Inspect --overview; improved output (#273)
* Refactor tablew md writer

* wip: cmd inspect -v

* cmd inspect output improved

* cmd inspect tests

* cmd inspect: help text
2023-06-21 23:48:58 -06:00
Neil O'Toole
85d6f7a2f9
#263: cmd version: structure yaml output correctly (#272)
* cmd version: structure yaml output correctly

* Fix bug_report.md to match 'sq version --yaml' output
2023-06-21 09:15:40 -06:00
Neil O'Toole
97739da1e1
#263: sq version host info (#271)
* sq version host info

* workflow: update bug_report.md with version instructions
2023-06-21 06:28:15 -06:00
Neil O'Toole
eedc11ec46
#261: jsonw: deadlock occurred when record was large, due to mutex on Flush() call (#262)
* jsonw: deadlock occurred when record was large, due to mutex on Flush() call
2023-06-19 10:55:38 -06:00
Neil O'Toole
2ba633fc2a
#258: Alias can be an arbitrary string. (#259)
* Fixed space issues with expressions

* Alias can now be an arbitrary string

* Alias can now be an arbitrary string (fixed)

* Alias now automatically applied to expressions

* Ignore .run

* Fixed issue with TestRun not logging correctly to testing.T

* Fiddling with sqlite3 temp file closing

* Re-enable tests
2023-06-18 00:05:09 -06:00
Neil O'Toole
44d27207f8
#256: column-only queries (#257)
* Column-only queries
2023-06-17 19:28:11 -06:00
Neil O'Toole
e93f462fff
#254: explicit where() clause (#255)
Implement explicit `where()` clause.
2023-06-16 22:54:25 -06:00
Neil O'Toole
9cb42bf579
#244: shell completion for "sq add LOCATION" (#246)
- Shell completion for `sq add LOCATION`.
2023-06-13 10:06:18 -06:00
Neil O'Toole
3ecdde5595
record.Record elements are now values, not pointers (#243)
* Updated record pkg

* sqlite migrated

* postgres migrated

* All DBs migrated

* CSV working

* Tests passing
2023-05-27 07:57:07 -06:00
Neil O'Toole
debb282386
diff: renamed --count flag to --counts as intended (#240)
* diff: renamed --count flag to --counts as intended

* CHANGELOG for v0.36.1
2023-05-26 14:45:08 -06:00
Neil O'Toole
c810d17eec
#229: sq diff ready for beta release (#239)
* sq config edit: fixed glaring bug that prevented editing a source

* Refine sq diff
2023-05-25 21:58:43 -06:00
Neil O'Toole
76d48154e7
#229: Yet more sq diff implementation. (#237)
* sq config edit: fixed glaring bug that prevented editing a source

* Refine sq diff
2023-05-24 17:36:10 -06:00
Neil O'Toole
2f2dfd6e47
#229: More diff (#233)
- Implement `sq diff --data`.
2023-05-22 09:08:14 -06:00
Neil O'Toole
1ea24dac4a
#229: sq diff core (#230)
* "sq diff" initial implementation

* Refactor "cli" pkg.
2023-05-19 08:24:18 -06:00
Neil O'Toole
12b33d5b49
Implemented yaml record writer (#226) 2023-05-10 20:03:45 -06:00
Neil O'Toole
f5e7e7b8cb
Restore --markdown flag (#220)
* Restore --markdown flag (also suppport --md)

* Update README and splash image
2023-05-08 07:39:47 -06:00