Neil O'Toole
f07edef14d
Add flag --src.schema ( #326 )
...
* Support for --src.schema in commands "slq", "sql", and "inspect"
2023-11-18 17:05:48 -07:00
Neil O'Toole
db092d5453
CSV ingest improvements ( #302 )
...
* csv: additional datetime detect formats
2023-08-18 09:21:11 -06:00
Neil O'Toole
c7bba4dfe4
go1.21: changes to support slog as part of stdlib ( #299 )
...
* go1.21: changes to support slog as part of stdlib
* Removed accidentially checked-in line of code
* Fixed minor linting issues; reenable typecheck
* go1.21: switched to stdlib slices pkg
2023-08-12 12:54:14 -06:00
Neil O'Toole
6ca26f4e4f
Column rename: template now has Alpha field. ( #285 )
...
* wip: refactor col name mungeing
* Finished refactoring FieldMeta
* Renamed tpl .AlphaIndex to .Alpha
* wip: debugging source config override
* Source config override passing tests
* CHANGELOG update
2023-07-08 19:34:53 -06:00
Neil O'Toole
9c5836ef1c
#191 : XLSX driver auto-detects header row ( #284 )
...
* xlsx driver now detects header row.
2023-07-08 09:21:27 -06:00
Neil O'Toole
4ffaae925f
#99 : Rename duplicate ingest headers ( #283 )
...
* CSV now renames duplicate ingest headers
* Fix broken test
* xlsx ingester now handles duplicate col names
* Update CHANGELOG
* Additional tests for ingest.column.rename
* Removed dead comment in grammar
2023-07-04 11:31:47 -06:00
Neil O'Toole
7396aadb9e
#12 : multiple joins ( #280 )
...
* The query language now supports multiple joins.
2023-07-03 09:34:19 -06:00
Neil O'Toole
a5c4f9d6bd
#263 : Inspect --overview; improved output ( #273 )
...
* Refactor tablew md writer
* wip: cmd inspect -v
* cmd inspect output improved
* cmd inspect tests
* cmd inspect: help text
2023-06-21 23:48:58 -06:00
Neil O'Toole
3ecdde5595
record.Record elements are now values, not pointers ( #243 )
...
* Updated record pkg
* sqlite migrated
* postgres migrated
* All DBs migrated
* CSV working
* Tests passing
2023-05-27 07:57:07 -06:00
Neil O'Toole
2f2dfd6e47
#229 : More diff ( #233 )
...
- Implement `sq diff --data`.
2023-05-22 09:08:14 -06:00
Neil O'Toole
1ea24dac4a
#229 : sq diff core ( #230 )
...
* "sq diff" initial implementation
* Refactor "cli" pkg.
2023-05-19 08:24:18 -06:00
Neil O'Toole
c5cf6c0cc0
#217 : Configurable timestamp format ( #218 )
...
* Moved time functions from pkg stringz to pkg timez
* Refactor options.Opt
* wip: initial work on configurable time layout
* wip: most printers now respect format.datetime and friends
* Folded pkg timefmt into timez
* Refactor options.Opt; refine options
* Add 'sq config set OPTION --help' mechanism
* Finished completion of OptDateFormatAsNumber and OptTimeFormatAsNumber
2023-05-06 20:36:34 -06:00
Neil O'Toole
3180334c0c
#199 : Config overhaul ( #214 )
...
* refactor: partially moved over driver.Tuning params to options
* All knobs moved to options
* sq config edit: now has comments for options
* Major work complete on config/options overhaul
* Major work complete on config/options overhaul
* Updated help text for 'sq version'
2023-05-03 06:36:10 -06:00
Neil O'Toole
4521008b72
#199 : sq config set ( #212 )
...
* Initial impl of 'sq config set'
* Verbose output for 'sq config get'
* config/options: refining 'sq config get'
* Refine 'sq config get': now prints defaults when --verbose
* cli: 'sq config get option.key' implemented
* cli: initial impl of 'sq config get --src'
* cli: refine 'sq config get'
* cli: 'sq config set --src' is implemented
2023-04-30 21:59:34 -06:00
Neil O'Toole
e5db7990bc
#199 : Kill RunContext.Log ( #211 )
...
* refactor: RunContext.Log is dead
* Fiddling with options
* Changed default max conns to zero (no limit)
* Linting
2023-04-30 08:18:56 -06:00
Neil O'Toole
5e31da4644
Refactor config options ( #209 )
...
* Refactor config and options.
2023-04-26 09:16:42 -06:00
Neil O'Toole
81f631e135
Refactoring ( #206 )
...
* Renamed source.Type to source.DriverType for clarity
* More renaming wrt source.DriverType
* Renamed output.Formatting to output.Printing
2023-04-21 21:36:32 -06:00
Neil O'Toole
ebb88b3a44
CSV empty string now treated as NULL ( #190 )
2023-04-09 19:29:13 -06:00
Neil O'Toole
ad23d5c116
Auto-detect CSV headers ( #188 )
...
* wip: initial header detection
* wip: refactored csv driver
* wip: Fixes to kind.Detector
* typo
* Refactor pkg csv files
* Update to changelog
* workflow: now running codacy and codeql on cron, not on push/pr
2023-04-09 08:44:27 -06:00
Neil O'Toole
54a0155ed6
Deal with lots of connections, especially for sq inspect. ( #186 )
...
* wip: deal with lots of connections
* Clean up TestDatabase_SourceMetadata_concurrent
* Fixed error message
2023-04-08 12:09:27 -06:00
Neil O'Toole
3f6157c4c4
Change logging library to slog ( #175 )
...
- Switch to slog logger.
2023-04-02 13:49:45 -06:00
Neil O'Toole
8d47ef806d
go1.20 upgrade; lots of linting ( #172 )
2023-04-01 02:38:32 -06:00
Neil O'Toole
7148505a84
CSV: check for mismatch field count vs explicitly specified column names ( #147 )
...
* csv: check for mismatch field count vs explicitly specified column names
* CHANGELOG update
2023-03-14 23:04:49 -06:00
Neil O'Toole
fab365f43c
gofumpt on files ( #122 )
...
* gofumpt on files
* more gofumpt
2022-12-18 01:35:59 -07:00
Neil O'Toole
c778c8ced5
Linting of _test.go files ( #121 )
...
* test linting
* test linting
* test linting
* test linting
2022-12-18 00:18:35 -07:00
Neil O'Toole
425702e7ba
The linting goes on forever ( #119 )
...
* linting
* yet more linting
* yet more linting
* yet more linting
* yet more linting
* yet more linting
2022-12-17 23:07:38 -07:00
Neil O'Toole
ac7535609d
Yet more linting ( #118 )
...
* lint fixes
* lint gosec
2022-12-17 22:16:10 -07:00
Neil O'Toole
08dfa10325
Errors linting ( #117 )
...
* errors linting
* errors linting
* formatting
2022-12-17 21:31:06 -07:00
Neil O'Toole
540adfac58
Lint long lines ( #115 )
...
* lint config now sorts results
* linted long lines
* linted long lines
2022-12-17 19:43:53 -07:00
Neil O'Toole
2831211ae9
Yet more linting ( #114 )
...
* wip: bunch o' linting
* bunch more linting
2022-12-17 17:51:33 -07:00
Neil O'Toole
5187e8000a
bunch of linting issues fixed ( #113 )
2022-12-17 16:11:33 -07:00
Neil O'Toole
e674cdc724
change 'interface{}' to 'any' ( #108 )
2022-12-16 16:34:33 -07:00
Neil O'Toole
a419e0b693
Misc cleanup, goimports, updates ( #107 )
...
* debugging
* generic retry functionality; some additions to stringz.go
* fiddling with magefile_sakila
* added test lock function testh.Lock
* bunch of linting, goimports, what not
2022-12-16 15:54:09 -07:00
Neil O'Toole
5aebc04356
Fixed issues with files and databases not being closed correctly ( #73 )
...
* fiddling with scratch database close order
* files debugging
* files debugging2
* files debugging3
* files debugging 4
* files debugging 5
* didn't close the ReadCloser in csv import
* more closing cleanup
2020-12-30 11:57:58 -07:00
Neil O'Toole
0f3bc26f52
JSON driver: initial jsona driver ( #69 )
...
* jsona driver appears to be mostly working
* jsona verified as working
* minor tidy
2020-08-23 20:32:59 -06:00
Neil O'Toole
1818d50546
moved pkg libsq/sqlmodel to libsq/core/sqlmodel ( #68 )
2020-08-23 13:00:13 -06:00
Neil O'Toole
58ccfc9ded
Json driver; refactoring of core packages ( #66 )
...
* Type Detector refactor
* json driver impl; refactoring of source.Files reader et al
* working on kind detector
* significant switcheroo of packages
* partway throught refactoring Kind
* major package switcheroo for Kind
2020-08-23 04:42:15 -06:00
Neil O'Toole
1ceb50e795
SQL batch insert ( #58 )
...
* initial refactoring for the numRows param
* work on driver.NewBatchInsert
* work on NewBatchInsert
* batch insert seems to work
* switched testh.Insert to use BatchInsert
* doc cleanup
* batch insert for dbwriter and csv
* removed unneeded NumRows from driver.StmtExecer
* minor tidyup
2020-08-12 12:24:01 -06:00
Neil O'Toole
3e10868a29
Switched pkg sakila "const" slices to functions ( #57 )
...
* replaced sakila source slices with funcs
* missed some pkg sakila slices to refactor
2020-08-10 09:16:44 -06:00
Neil O'Toole
fd4ae53f31
codebase refactor
2020-08-06 11:58:47 -06:00
