Neil O'Toole
452a91547c
Better handling of download cache refresh ( #366 )
...
* A failed download cache refresh no longer destroys the previous cache.
2024-01-26 15:18:38 -07:00
Neil O'Toole
2898a92983
Refactor sqlmodel pkg ( #364 )
...
* Refactor sqlmodel pkg
2024-01-25 00:42:51 -07:00
Neil O'Toole
26f0c9a381
Refactor source.Files ( #363 )
...
* Moved `source.Files` to its own package, thus the type is now `files.Files`.
* Moved much of the location functionality from pkg `source` to its own package `location`.
2024-01-24 23:29:55 -07:00
Neil O'Toole
bb4a4edaab
Switch downloads to use streamcache. ( #361 )
...
* Switch downloads to use neilotoole/streamcache.
2024-01-24 21:01:24 -07:00
Neil O'Toole
db55986980
#307 : Ingest cache ( #354 )
...
- Support for ingest cache, download cache, and progress bars.
2024-01-14 18:45:34 -07:00
Neil O'Toole
096e209a01
sq inspect now has --schemata and --catalogs modes ( #334 )
...
* Add --schemata and --catalogs flags to "sq inspect"
2023-11-20 14:42:38 -07:00
Neil O'Toole
2de993acaa
Sort imports using goimports-reviser ( #331 )
2023-11-19 18:06:36 -07:00
Neil O'Toole
82727b3890
Refactor/rename database to pool ( #328 )
...
* Renamed `driver.Database` to `driver.Pool` (and related things)
* workflow: Update tparse version
* workflow: Update golangci-lint version
2023-11-18 19:21:14 -07:00
Neil O'Toole
f07edef14d
Add flag --src.schema ( #326 )
...
* Support for --src.schema in commands "slq", "sql", and "inspect"
2023-11-18 17:05:48 -07:00
Neil O'Toole
c7bba4dfe4
go1.21: changes to support slog as part of stdlib ( #299 )
...
* go1.21: changes to support slog as part of stdlib
* Removed accidentially checked-in line of code
* Fixed minor linting issues; reenable typecheck
* go1.21: switched to stdlib slices pkg
2023-08-12 12:54:14 -06:00
Neil O'Toole
9c5836ef1c
#191 : XLSX driver auto-detects header row ( #284 )
...
* xlsx driver now detects header row.
2023-07-08 09:21:27 -06:00
Neil O'Toole
a5c4f9d6bd
#263 : Inspect --overview; improved output ( #273 )
...
* Refactor tablew md writer
* wip: cmd inspect -v
* cmd inspect output improved
* cmd inspect tests
* cmd inspect: help text
2023-06-21 23:48:58 -06:00
Neil O'Toole
44d27207f8
#256 : column-only queries ( #257 )
...
* Column-only queries
2023-06-17 19:28:11 -06:00
Neil O'Toole
3180334c0c
#199 : Config overhaul ( #214 )
...
* refactor: partially moved over driver.Tuning params to options
* All knobs moved to options
* sq config edit: now has comments for options
* Major work complete on config/options overhaul
* Major work complete on config/options overhaul
* Updated help text for 'sq version'
2023-05-03 06:36:10 -06:00
Neil O'Toole
e5db7990bc
#199 : Kill RunContext.Log ( #211 )
...
* refactor: RunContext.Log is dead
* Fiddling with options
* Changed default max conns to zero (no limit)
* Linting
2023-04-30 08:18:56 -06:00
Neil O'Toole
5e31da4644
Refactor config options ( #209 )
...
* Refactor config and options.
2023-04-26 09:16:42 -06:00
Neil O'Toole
81f631e135
Refactoring ( #206 )
...
* Renamed source.Type to source.DriverType for clarity
* More renaming wrt source.DriverType
* Renamed output.Formatting to output.Printing
2023-04-21 21:36:32 -06:00
neilotoole
c1b71fa68a
Renamed testh.OptLongDB to testh.OptLongOpen; added it to other tests.
2023-04-19 08:08:26 -06:00
Neil O'Toole
98b47a2666
#199 - Config, refactoring ( #204 )
...
* refactor: moved cli flags to pkg cli/flag
* testh: add OptLongDB for long-running tests
* implement 'sq config dir'
* legacy dir migration: probably a bad idea
* cleanup
* Refactored SQ_CONFIG and --config
* added yaml writer
* Dialing in tests
* YAML output for 'sq driver ls'
* Significant refactoring of config
* Minor test for ioz
* Rename source.Set to source.Collection
* Cleaning up references to source.Set
2023-04-18 23:28:09 -06:00
Neil O'Toole
ad23d5c116
Auto-detect CSV headers ( #188 )
...
* wip: initial header detection
* wip: refactored csv driver
* wip: Fixes to kind.Detector
* typo
* Refactor pkg csv files
* Update to changelog
* workflow: now running codacy and codeql on cron, not on push/pr
2023-04-09 08:44:27 -06:00
Neil O'Toole
54a0155ed6
Deal with lots of connections, especially for sq inspect. ( #186 )
...
* wip: deal with lots of connections
* Clean up TestDatabase_SourceMetadata_concurrent
* Fixed error message
2023-04-08 12:09:27 -06:00
Neil O'Toole
3f6157c4c4
Change logging library to slog ( #175 )
...
- Switch to slog logger.
2023-04-02 13:49:45 -06:00
Neil O'Toole
8d47ef806d
go1.20 upgrade; lots of linting ( #172 )
2023-04-01 02:38:32 -06:00
Neil O'Toole
161d6f9ee7
Fix to docs for cmd_sql ( #148 )
2023-03-15 01:43:48 -06:00
Neil O'Toole
fff01a32db
Chore/yet more mod upgrades ( #128 )
...
* gopkg.in/yaml.v3 upgrade
* emirpasic/gods@v1.18.1
* yet more module stuff
2022-12-23 14:05:24 -07:00
Neil O'Toole
fab365f43c
gofumpt on files ( #122 )
...
* gofumpt on files
* more gofumpt
2022-12-18 01:35:59 -07:00
Neil O'Toole
c778c8ced5
Linting of _test.go files ( #121 )
...
* test linting
* test linting
* test linting
* test linting
2022-12-18 00:18:35 -07:00
Neil O'Toole
f9c19785e3
Almost at the end of the linting road ( #120 )
...
* yet more linting
* yet more linting
* yet more linting
* yet more linting
* yet more linting
* yet more linting
* yet more linting
* yet more linting
2022-12-17 23:42:11 -07:00
Neil O'Toole
425702e7ba
The linting goes on forever ( #119 )
...
* linting
* yet more linting
* yet more linting
* yet more linting
* yet more linting
* yet more linting
2022-12-17 23:07:38 -07:00
Neil O'Toole
08dfa10325
Errors linting ( #117 )
...
* errors linting
* errors linting
* formatting
2022-12-17 21:31:06 -07:00
Neil O'Toole
540adfac58
Lint long lines ( #115 )
...
* lint config now sorts results
* linted long lines
* linted long lines
2022-12-17 19:43:53 -07:00
Neil O'Toole
2831211ae9
Yet more linting ( #114 )
...
* wip: bunch o' linting
* bunch more linting
2022-12-17 17:51:33 -07:00
Neil O'Toole
6a0878bc6b
fixed broken mysql tests (parseTime param); moved some test funcs to pkg tutil ( #109 )
2022-12-16 19:09:49 -07:00
Neil O'Toole
e674cdc724
change 'interface{}' to 'any' ( #108 )
2022-12-16 16:34:33 -07:00
unknown
8d2398b309
close db resources
2021-01-01 18:57:07 -07:00
Neil O'Toole
1818d50546
moved pkg libsq/sqlmodel to libsq/core/sqlmodel ( #68 )
2020-08-23 13:00:13 -06:00
Neil O'Toole
58ccfc9ded
Json driver; refactoring of core packages ( #66 )
...
* Type Detector refactor
* json driver impl; refactoring of source.Files reader et al
* working on kind detector
* significant switcheroo of packages
* partway throught refactoring Kind
* major package switcheroo for Kind
2020-08-23 04:42:15 -06:00
Neil O'Toole
1ceb50e795
SQL batch insert ( #58 )
...
* initial refactoring for the numRows param
* work on driver.NewBatchInsert
* work on NewBatchInsert
* batch insert seems to work
* switched testh.Insert to use BatchInsert
* doc cleanup
* batch insert for dbwriter and csv
* removed unneeded NumRows from driver.StmtExecer
* minor tidyup
2020-08-12 12:24:01 -06:00
Neil O'Toole
fd4ae53f31
codebase refactor
2020-08-06 11:58:47 -06:00