Commit Graph

20 Commits

Author SHA1 Message Date
Neil O'Toole
99454852f0
db tools preliminary work; --src.schema changes ()
- Preliminary work on the (currently hidden) `db` cmds.
- Improvements to `--src.schema`
2024-02-09 09:08:39 -07:00
Neil O'Toole
fd070eefd3
More file closing issues (test) ()
* Refactored tu.TempDir

* More files fiddling
2024-01-29 19:34:10 -07:00
Neil O'Toole
20b71c91b9
Moved time/tzdata import to main () 2024-01-29 15:30:26 -07:00
Neil O'Toole
0841e7154f
tu.SkipIssue mechanism ()
* tu.SkipIssue mechanism
2024-01-26 22:36:04 -07:00
Neil O'Toole
26f0c9a381
Refactor source.Files ()
* Moved `source.Files` to its own package, thus the type is now `files.Files`.
* Moved much of the location functionality from pkg `source` to its own package `location`.
2024-01-24 23:29:55 -07:00
Neil O'Toole
db55986980
: Ingest cache ()
- Support for ingest cache, download cache, and progress bars.
2024-01-14 18:45:34 -07:00
Neil O'Toole
f85da722ad
decimal type support ()
* Now using a dedicated `decimal.Decimal` type instead of float/string.
2023-11-21 14:49:52 -07:00
Neil O'Toole
096e209a01
sq inspect now has --schemata and --catalogs modes ()
* Add --schemata and --catalogs flags to "sq inspect"
2023-11-20 14:42:38 -07:00
Neil O'Toole
2de993acaa
Sort imports using goimports-reviser () 2023-11-19 18:06:36 -07:00
Neil O'Toole
f07edef14d
Add flag --src.schema ()
* Support for --src.schema in commands "slq", "sql", and "inspect"
2023-11-18 17:05:48 -07:00
Neil O'Toole
db092d5453
CSV ingest improvements ()
* csv: additional datetime detect formats
2023-08-18 09:21:11 -06:00
Neil O'Toole
9c5836ef1c
: XLSX driver auto-detects header row ()
* xlsx driver now detects header row.
2023-07-08 09:21:27 -06:00
Neil O'Toole
4ffaae925f
: Rename duplicate ingest headers ()
* CSV now renames duplicate ingest headers

* Fix broken test

* xlsx ingester now handles duplicate col names

* Update CHANGELOG

* Additional tests for ingest.column.rename

* Removed dead comment in grammar
2023-07-04 11:31:47 -06:00
Neil O'Toole
3ecdde5595
record.Record elements are now values, not pointers ()
* Updated record pkg

* sqlite migrated

* postgres migrated

* All DBs migrated

* CSV working

* Tests passing
2023-05-27 07:57:07 -06:00
Neil O'Toole
c5cf6c0cc0
: Configurable timestamp format ()
* Moved time functions from pkg stringz to pkg timez

* Refactor options.Opt

* wip: initial work on configurable time layout

* wip: most printers now respect format.datetime and friends

* Folded pkg timefmt into timez

* Refactor options.Opt; refine options

* Add 'sq config set OPTION --help' mechanism

* Finished completion of OptDateFormatAsNumber and OptTimeFormatAsNumber
2023-05-06 20:36:34 -06:00
Neil O'Toole
ebb88b3a44
CSV empty string now treated as NULL () 2023-04-09 19:29:13 -06:00
Neil O'Toole
c778c8ced5
Linting of _test.go files ()
* test linting

* test linting

* test linting

* test linting
2022-12-18 00:18:35 -07:00
Neil O'Toole
1ceb50e795
SQL batch insert ()
* initial refactoring for the numRows param

* work on driver.NewBatchInsert

* work on NewBatchInsert

* batch insert seems to work

* switched testh.Insert to use BatchInsert

* doc cleanup

* batch insert for dbwriter and csv

* removed unneeded NumRows from driver.StmtExecer

* minor tidyup
2020-08-12 12:24:01 -06:00
Neil O'Toole
3e10868a29
Switched pkg sakila "const" slices to functions ()
* replaced sakila source slices with funcs

* missed some pkg sakila slices to refactor
2020-08-10 09:16:44 -06:00
Neil O'Toole
fd4ae53f31 codebase refactor 2020-08-06 11:58:47 -06:00