neilotoole/sq
1
1
Fork 0
mirror of https://github.com/neilotoole/sq.git synced 2024-12-20 06:31:32 +03:00
Code Issues Actions Packages Projects Releases Wiki Activity
472 Commits 7 Branches 98 Tags 55 MiB
c60fbc8d13
Commit Graph

17 Commits

Author SHA1 Message Date
Neil O'Toole
611ad30f60
Test ingest Excel file format variants (#303) 
* Tests for additional formats

* Tests for ingest Excel file format variants
 2023-08-20 07:22:24 -06:00
Neil O'Toole
db092d5453
CSV ingest improvements (#302) 
* csv: additional datetime detect formats
 2023-08-18 09:21:11 -06:00
Neil O'Toole
edc933d897
#200: Feature/200 excel driver (#301) 
* Switch to excelize driver
 2023-08-16 09:09:50 -06:00
Neil O'Toole
9c5836ef1c
#191: XLSX driver auto-detects header row (#284) 
* xlsx driver now detects header row.
 2023-07-08 09:21:27 -06:00
Neil O'Toole
4ffaae925f
#99: Rename duplicate ingest headers (#283) 
* CSV now renames duplicate ingest headers

* Fix broken test

* xlsx ingester now handles duplicate col names

* Update CHANGELOG

* Additional tests for ingest.column.rename

* Removed dead comment in grammar
 2023-07-04 11:31:47 -06:00
neilotoole
4eb917f276 Make testh.OptLongOpen even longer 2023-05-25 23:02:11 -06:00
Neil O'Toole
5e31da4644
Refactor config options (#209) 
* Refactor config and options.
 2023-04-26 09:16:42 -06:00
neilotoole
c1b71fa68a Renamed testh.OptLongDB to testh.OptLongOpen; added it to other tests. 2023-04-19 08:08:26 -06:00
Neil O'Toole
98b47a2666
#199 - Config, refactoring (#204) 
* refactor: moved cli flags to pkg cli/flag

* testh: add OptLongDB for long-running tests

* implement 'sq config dir'

* legacy dir migration: probably a bad idea

* cleanup

* Refactored SQ_CONFIG and --config

* added yaml writer

* Dialing in tests

* YAML output for 'sq driver ls'

* Significant refactoring of config

* Minor test for ioz

* Rename source.Set to source.Collection

* Cleaning up references to source.Set
 2023-04-18 23:28:09 -06:00
Neil O'Toole
958d509088
Source groups (#198) 
* Implemented source groups mechanism.
 2023-04-15 16:28:51 -06:00
Neil O'Toole
c778c8ced5
Linting of _test.go files (#121) 
* test linting

* test linting

* test linting

* test linting
 2022-12-18 00:18:35 -07:00
Neil O'Toole
6a0878bc6b
fixed broken mysql tests (parseTime param); moved some test funcs to pkg tutil (#109) 2022-12-16 19:09:49 -07:00
Neil O'Toole
a1cfd5d525
Xlsx import handle empty sheets (#79) 
* can now import XLSX with empty sheets

* renamed XLSX test article
 2021-02-19 23:22:35 -07:00
Neil O'Toole
58ccfc9ded
Json driver; refactoring of core packages (#66) 
* Type Detector refactor

* json driver impl; refactoring of source.Files reader et al

* working on kind detector

* significant switcheroo of packages

* partway throught refactoring Kind

* major package switcheroo for Kind
 2020-08-23 04:42:15 -06:00
Neil O'Toole
1ceb50e795
SQL batch insert (#58) 
* initial refactoring for the numRows param

* work on driver.NewBatchInsert

* work on NewBatchInsert

* batch insert seems to work

* switched testh.Insert to use BatchInsert

* doc cleanup

* batch insert for dbwriter and csv

* removed unneeded NumRows from driver.StmtExecer

* minor tidyup
 2020-08-12 12:24:01 -06:00
Neil O'Toole
3e10868a29
Switched pkg sakila "const" slices to functions (#57) 
* replaced sakila source slices with funcs

* missed some pkg sakila slices to refactor
 2020-08-10 09:16:44 -06:00
Neil O'Toole
fd4ae53f31 codebase refactor 2020-08-06 11:58:47 -06:00