Neil O'Toole
452a91547c
Better handling of download cache refresh ( #366 )
...
* A failed download cache refresh no longer destroys the previous cache.
2024-01-26 15:18:38 -07:00
Neil O'Toole
2898a92983
Refactor sqlmodel pkg ( #364 )
...
* Refactor sqlmodel pkg
2024-01-25 00:42:51 -07:00
Neil O'Toole
26f0c9a381
Refactor source.Files ( #363 )
...
* Moved `source.Files` to its own package, thus the type is now `files.Files`.
* Moved much of the location functionality from pkg `source` to its own package `location`.
2024-01-24 23:29:55 -07:00
Neil O'Toole
bb4a4edaab
Switch downloads to use streamcache. ( #361 )
...
* Switch downloads to use neilotoole/streamcache.
2024-01-24 21:01:24 -07:00
Neil O'Toole
9aa45b1db3
More progress bars ( #357 )
...
* More progress bars
2024-01-14 20:56:54 -07:00
Neil O'Toole
db55986980
#307 : Ingest cache ( #354 )
...
- Support for ingest cache, download cache, and progress bars.
2024-01-14 18:45:34 -07:00
Neil O'Toole
f85da722ad
#335 decimal type support ( #336 )
...
* Now using a dedicated `decimal.Decimal` type instead of float/string.
2023-11-21 14:49:52 -07:00
Neil O'Toole
096e209a01
sq inspect now has --schemata and --catalogs modes ( #334 )
...
* Add --schemata and --catalogs flags to "sq inspect"
2023-11-20 14:42:38 -07:00
Neil O'Toole
2de993acaa
Sort imports using goimports-reviser ( #331 )
2023-11-19 18:06:36 -07:00
Neil O'Toole
d7fc315028
sq inspect now shows catalog (when outputting in JSON and YAML format) ( #329 )
2023-11-19 07:21:38 -07:00
Neil O'Toole
82727b3890
Refactor/rename database to pool ( #328 )
...
* Renamed `driver.Database` to `driver.Pool` (and related things)
* workflow: Update tparse version
* workflow: Update golangci-lint version
2023-11-18 19:21:14 -07:00
Neil O'Toole
f07edef14d
Add flag --src.schema ( #326 )
...
* Support for --src.schema in commands "slq", "sql", and "inspect"
2023-11-18 17:05:48 -07:00
Neil O'Toole
edc933d897
#200 : Feature/200 excel driver ( #301 )
...
* Switch to excelize driver
2023-08-16 09:09:50 -06:00
Neil O'Toole
c7bba4dfe4
go1.21: changes to support slog as part of stdlib ( #299 )
...
* go1.21: changes to support slog as part of stdlib
* Removed accidentially checked-in line of code
* Fixed minor linting issues; reenable typecheck
* go1.21: switched to stdlib slices pkg
2023-08-12 12:54:14 -06:00
Neil O'Toole
6ca26f4e4f
Column rename: template now has Alpha field. ( #285 )
...
* wip: refactor col name mungeing
* Finished refactoring FieldMeta
* Renamed tpl .AlphaIndex to .Alpha
* wip: debugging source config override
* Source config override passing tests
* CHANGELOG update
2023-07-08 19:34:53 -06:00
Neil O'Toole
9c5836ef1c
#191 : XLSX driver auto-detects header row ( #284 )
...
* xlsx driver now detects header row.
2023-07-08 09:21:27 -06:00
Neil O'Toole
4ffaae925f
#99 : Rename duplicate ingest headers ( #283 )
...
* CSV now renames duplicate ingest headers
* Fix broken test
* xlsx ingester now handles duplicate col names
* Update CHANGELOG
* Additional tests for ingest.column.rename
* Removed dead comment in grammar
2023-07-04 11:31:47 -06:00
Neil O'Toole
7396aadb9e
#12 : multiple joins ( #280 )
...
* The query language now supports multiple joins.
2023-07-03 09:34:19 -06:00
Neil O'Toole
a5c4f9d6bd
#263 : Inspect --overview; improved output ( #273 )
...
* Refactor tablew md writer
* wip: cmd inspect -v
* cmd inspect output improved
* cmd inspect tests
* cmd inspect: help text
2023-06-21 23:48:58 -06:00
Neil O'Toole
e0812e9a65
#242 - Handle *uint64 returned from db ( #253 )
2023-06-15 07:50:07 -06:00
Neil O'Toole
9cb42bf579
#244 : shell completion for "sq add LOCATION" ( #246 )
...
- Shell completion for `sq add LOCATION`.
2023-06-13 10:06:18 -06:00
Neil O'Toole
3ecdde5595
record.Record elements are now values, not pointers ( #243 )
...
* Updated record pkg
* sqlite migrated
* postgres migrated
* All DBs migrated
* CSV working
* Tests passing
2023-05-27 07:57:07 -06:00
Neil O'Toole
24b5fafd78
Proprietary functions now require leading underscore ( #241 )
2023-05-26 21:11:38 -06:00
Neil O'Toole
c3a543aa84
#229 : refactor mysql source metadata impl ( #236 )
...
* refactor mysql source metadata impl
* Made loop condition stronger
2023-05-23 18:42:36 -06:00
Neil O'Toole
2f2dfd6e47
#229 : More diff ( #233 )
...
- Implement `sq diff --data`.
2023-05-22 09:08:14 -06:00
Neil O'Toole
1ea24dac4a
#229 : sq diff core ( #230 )
...
* "sq diff" initial implementation
* Refactor "cli" pkg.
2023-05-19 08:24:18 -06:00
Neil O'Toole
c5cf6c0cc0
#217 : Configurable timestamp format ( #218 )
...
* Moved time functions from pkg stringz to pkg timez
* Refactor options.Opt
* wip: initial work on configurable time layout
* wip: most printers now respect format.datetime and friends
* Folded pkg timefmt into timez
* Refactor options.Opt; refine options
* Add 'sq config set OPTION --help' mechanism
* Finished completion of OptDateFormatAsNumber and OptTimeFormatAsNumber
2023-05-06 20:36:34 -06:00
Neil O'Toole
3180334c0c
#199 : Config overhaul ( #214 )
...
* refactor: partially moved over driver.Tuning params to options
* All knobs moved to options
* sq config edit: now has comments for options
* Major work complete on config/options overhaul
* Major work complete on config/options overhaul
* Updated help text for 'sq version'
2023-05-03 06:36:10 -06:00
Neil O'Toole
4521008b72
#199 : sq config set ( #212 )
...
* Initial impl of 'sq config set'
* Verbose output for 'sq config get'
* config/options: refining 'sq config get'
* Refine 'sq config get': now prints defaults when --verbose
* cli: 'sq config get option.key' implemented
* cli: initial impl of 'sq config get --src'
* cli: refine 'sq config get'
* cli: 'sq config set --src' is implemented
2023-04-30 21:59:34 -06:00
Neil O'Toole
e5db7990bc
#199 : Kill RunContext.Log ( #211 )
...
* refactor: RunContext.Log is dead
* Fiddling with options
* Changed default max conns to zero (no limit)
* Linting
2023-04-30 08:18:56 -06:00
Neil O'Toole
5e31da4644
Refactor config options ( #209 )
...
* Refactor config and options.
2023-04-26 09:16:42 -06:00
Neil O'Toole
81f631e135
Refactoring ( #206 )
...
* Renamed source.Type to source.DriverType for clarity
* More renaming wrt source.DriverType
* Renamed output.Formatting to output.Printing
2023-04-21 21:36:32 -06:00
neilotoole
c1b71fa68a
Renamed testh.OptLongDB to testh.OptLongOpen; added it to other tests.
2023-04-19 08:08:26 -06:00
Neil O'Toole
958d509088
Source groups ( #198 )
...
* Implemented source groups mechanism.
2023-04-15 16:28:51 -06:00
Neil O'Toole
ebb88b3a44
CSV empty string now treated as NULL ( #190 )
2023-04-09 19:29:13 -06:00
Neil O'Toole
ad23d5c116
Auto-detect CSV headers ( #188 )
...
* wip: initial header detection
* wip: refactored csv driver
* wip: Fixes to kind.Detector
* typo
* Refactor pkg csv files
* Update to changelog
* workflow: now running codacy and codeql on cron, not on push/pr
2023-04-09 08:44:27 -06:00
neilotoole
150dfc01a9
Fixed some tests that had neglected to drop tables they had created
2023-04-08 14:58:10 -06:00
Neil O'Toole
54a0155ed6
Deal with lots of connections, especially for sq inspect. ( #186 )
...
* wip: deal with lots of connections
* Clean up TestDatabase_SourceMetadata_concurrent
* Fixed error message
2023-04-08 12:09:27 -06:00
Neil O'Toole
9a1c6a7d09
Feature/173 args ( #183 )
...
- Implement --arg feature
- Refactor sqlbuilder package (now called "render").
- Bug fixes, especially around expressions.
2023-04-07 02:00:49 -06:00
Neil O'Toole
3f6157c4c4
Change logging library to slog ( #175 )
...
- Switch to slog logger.
2023-04-02 13:49:45 -06:00
Neil O'Toole
a1a89ee9dd
Support table and column names with spaces. ( #156 )
...
* sakila: initial test data
* sakila: more test data
* sakila: yet more test data setup
* whitespace cols: now working for sqlite
* grammar cleanup
* whitespace cols: now working inside count() func for sqlite
* whitespace cols: tests mostly passing; begining refactoring
* grammar: refactor handle
* grammar: more refactoring
* grammar: rename selElement to selector
* wip
* all tests passing
* all tests passing
* linting
* driver: implement CurrentSchema for all driver.SQLDriver impls
* driver: tests for AlterTableRename and AlterTableRenameColumn
* undo reformat of SQL
* undo reformat of SQL
* undo reformat of SQL
* undo reformat of SQL
2023-03-22 00:17:34 -06:00
Neil O'Toole
f71b124a1f
Testing for postgres alternate schema
2023-03-13 19:25:12 -06:00
neilotoole
70e650ef87
linting
2022-12-24 21:09:20 -07:00
Neil O'Toole
e2a9605ec6
Chore/sqlite3 upgrade ( #129 )
...
* wip
* made progress on new SQLite type stuff
* we're getting places
* largely working now
* tidying up
* almost there
* time to deal with failing tests
* seemed to have fixed sqlserver issue
* seems to all be fixed
* minor tidy up
2022-12-23 21:05:26 -07:00
Neil O'Toole
fab365f43c
gofumpt on files ( #122 )
...
* gofumpt on files
* more gofumpt
2022-12-18 01:35:59 -07:00
Neil O'Toole
c778c8ced5
Linting of _test.go files ( #121 )
...
* test linting
* test linting
* test linting
* test linting
2022-12-18 00:18:35 -07:00
Neil O'Toole
f9c19785e3
Almost at the end of the linting road ( #120 )
...
* yet more linting
* yet more linting
* yet more linting
* yet more linting
* yet more linting
* yet more linting
* yet more linting
* yet more linting
2022-12-17 23:42:11 -07:00
Neil O'Toole
425702e7ba
The linting goes on forever ( #119 )
...
* linting
* yet more linting
* yet more linting
* yet more linting
* yet more linting
* yet more linting
2022-12-17 23:07:38 -07:00
Neil O'Toole
ac7535609d
Yet more linting ( #118 )
...
* lint fixes
* lint gosec
2022-12-17 22:16:10 -07:00
Neil O'Toole
540adfac58
Lint long lines ( #115 )
...
* lint config now sorts results
* linted long lines
* linted long lines
2022-12-17 19:43:53 -07:00