Commit Graph

348 Commits

Author SHA1 Message Date
Neil O'Toole
188a033a26
files handling cleanup (#77) 2021-01-01 21:10:02 -07:00
unknown
8d2398b309 close db resources 2021-01-01 18:57:07 -07:00
Neil O'Toole
7c4c8c8313 github workflow 2021-01-01 18:28:58 -07:00
neilotoole
fcca64874d Scoop update for sq version v0.14.5 2020-12-30 12:41:36 -07:00
Neil O'Toole
4faf1608ab
made sq repo public, at long last (#75) 2020-12-30 12:26:33 -07:00
Neil O'Toole
8345e6743b
removed notify stuff (#74) 2020-12-30 12:18:22 -07:00
Neil O'Toole
5aebc04356
Fixed issues with files and databases not being closed correctly (#73)
* fiddling with scratch database close order

* files debugging

* files debugging2

* files debugging3

* files debugging 4

* files debugging 5

* didn't close the ReadCloser in csv import

* more closing cleanup
2020-12-30 11:57:58 -07:00
Neil O'Toole
8c883d276e
sq tbl truncate for postgres now outputs the number of rows truncated (#72) 2020-11-24 22:12:15 -07:00
Neil O'Toole
06900f8c84
fixed some panics with oddly-shaped xlsx imports (#71) 2020-11-02 10:40:29 -07:00
Neil O'Toole
93f0de8614 README update 2020-10-20 09:18:56 -06:00
Neil O'Toole
a92b9abf34
Initial work on a JSON driver (#70)
* implementation work for json importers

* json driver checkpoint

* working on json.ParseObjectsInArray

* json.ParseObjectsInArray seems to be working

* checkpoint while tidying up ParseObjectsInArray

* more tidy checkpoint

* more tidy checkpoint 2

* tidying up ParseObjectsInArray

* tidy up

* code/docs cleanup

* more cleanup of json driver

* more cleanup of json driver

* flat json import seemingly working

* improvements to json driver

* json writer now prints empty [] for postgres empty tables
2020-10-20 09:05:43 -06:00
Neil O'Toole
0f3bc26f52
JSON driver: initial jsona driver (#69)
* jsona driver appears to be mostly working

* jsona verified as working

* minor tidy
2020-08-23 20:32:59 -06:00
Neil O'Toole
1818d50546
moved pkg libsq/sqlmodel to libsq/core/sqlmodel (#68) 2020-08-23 13:00:13 -06:00
Neil O'Toole
38be39a12f yet more pkg moving 2020-08-23 05:52:09 -06:00
Neil O'Toole
e4cc68b714
Slq move (#67)
* moved it

* what used to be libsq/slq in now libsq/ast/internal/slq
2020-08-23 05:16:16 -06:00
Neil O'Toole
58ccfc9ded
Json driver; refactoring of core packages (#66)
* Type Detector refactor

* json driver impl; refactoring of source.Files reader et al

* working on kind detector

* significant switcheroo of packages

* partway throught refactoring Kind

* major package switcheroo for Kind
2020-08-23 04:42:15 -06:00
Neil O'Toole
b3667d60cd
implementing SQLDriver.AlterTableAddColumn (#65) 2020-08-20 21:08:59 -06:00
Neil O'Toole
9746f726f6
fixing issues with inspect/metadata (#64) 2020-08-20 14:19:16 -06:00
Neil O'Toole
f2e69603a5
minor doc tidy (#63) 2020-08-19 14:46:04 -06:00
Neil O'Toole
929b81c6d3
MySQL "inspect" performance (#62)
* mysql inspect performance

* tidying up mysql metadata
2020-08-18 13:13:25 -06:00
Neil O'Toole
65259754f5
Improvements to metadata (sq inspect) (#61)
* improvements to sqlite source metadata query

* table metadatawriter colorization tuning; minor testh.Helper refactoring

* cleanup of metadata for multiple drivers

* more cleanup of source/table metadata

* yet more cleanup of source/table metadata

* improvements to mysql SourceMetadata

* improvements to mysql TableMetadata

* yet more fiddling with mysql metadata
2020-08-15 15:06:40 -06:00
Neil O'Toole
f00c1f2307
renamed driver.Driver impls from mysql.Driver to mysql.driveri etc (#60) 2020-08-12 21:40:03 -06:00
Neil O'Toole
48630a621f
Removed sqlx dependencies (#59) 2020-08-12 21:22:53 -06:00
Neil O'Toole
1ceb50e795
SQL batch insert (#58)
* initial refactoring for the numRows param

* work on driver.NewBatchInsert

* work on NewBatchInsert

* batch insert seems to work

* switched testh.Insert to use BatchInsert

* doc cleanup

* batch insert for dbwriter and csv

* removed unneeded NumRows from driver.StmtExecer

* minor tidyup
2020-08-12 12:24:01 -06:00
Neil O'Toole
3e10868a29
Switched pkg sakila "const" slices to functions (#57)
* replaced sakila source slices with funcs

* missed some pkg sakila slices to refactor
2020-08-10 09:16:44 -06:00
Neil O'Toole
8b1bd4c03a
replaced sakila source slices with funcs (#56) 2020-08-09 08:40:46 -06:00
Neil O'Toole
67cfb142e1
config cleanup; misc doc fixes; minor refactoring; fiddling with output writer presentation (#55) 2020-08-09 07:46:46 -06:00
Neil O'Toole
915e01fdda
added Go dependency cache to go.yml workflow, and go test now covers the full codebase (#53)
* added Go dependency cache to go.yml workflow

* more windows path issues

* docs

* restricting workflow triggers to master

* wrong cleanup order for downloaded files

* de-restricting workflow triggers, for now

* more out-of-order cleanup issues that only manifested on windows

* more out-of-order cleanup issues

* removed mediatype check from TestFetchFile; FetchFile is deprecated and not worth fixing

* tracked down out-of-sequence close/remove issue with sqlite

* probably long-running test failure

* disabling long-running tests that are breaking CI

* switching to go test -short because tests seem to be taking too long in CI
2020-08-08 15:23:30 -06:00
Neil O'Toole
27ff71516e
Added go test to github action; fixed Windows test issues (#52)
* initial test of testing workflow

* added .gitattributes for crlf issue on windows

* testh was attempting to remove the copied sqlite3 file before it was closed by sqlite3.database.Close()

* fiddling with .gitattributes to get line endings to work
2020-08-07 23:10:41 -06:00
Neil O'Toole
26abe3eb6d
refactor cli.writers (#51) 2020-08-07 21:06:56 -06:00
Neil O'Toole
062e2dea88
Filepath and colorization issues with the v0.12.1 release on Windows (#50)
- Windows filepath handling
- Windows colorization handling
- Minor code tidy up and refactor
2020-08-07 13:51:30 -06:00
Neil O'Toole
58d8e301e0 More restrictive filemode for sq.yml and sq.log files 2020-08-06 13:22:11 -06:00
Neil O'Toole
c3cdc0b972 Minor tidying of README and .goreleaser.yml 2020-08-06 12:37:33 -06:00
Neil O'Toole
fd4ae53f31 codebase refactor 2020-08-06 11:58:47 -06:00
Neil O'Toole
1a2c9baaf6 Merge branch 'master' of https://github.com/neilotoole/sq 2020-08-06 11:42:30 -06:00
Neil O'Toole
85b89d8b37
Create go.yml 2020-03-03 03:19:04 -07:00
Neil O'Toole
4993d6e13d working on grammar 2016-10-30 16:35:56 -06:00
Neil O'Toole
0190eeaf70 mostly tidyup 2016-10-21 21:11:19 -06:00
Neil O'Toole
cce4196fe4 cleaning up "cmd" package level vars and init (#41)
* cleaning up build system

* more build stuff

* makefile and grammar stuff

* cleaning up cmd pkg vars
2016-10-21 14:58:31 -06:00
Neil O'Toole
1aa5091aa4 mostly build stuff (#40)
* cleaning up build system

* more build stuff

* makefile and grammar stuff
2016-10-21 13:29:21 -06:00
Neil O'Toole
076d3a33f2 adding assets back, duh 2016-10-21 10:59:19 -06:00
Neil O'Toole
c66d067d86 removing assets from VCS 2016-10-21 10:56:48 -06:00
Neil O'Toole
81007f7dcf merging 2016-10-21 10:21:06 -06:00
Neil O'Toole
5c8be18f37 working on build system (#39)
* cleaning up build system

* more build stuff
2016-10-21 10:20:11 -06:00
Neil O'Toole
6693495f41 cleaning up build system (#38) 2016-10-21 10:14:48 -06:00
Neil O'Toole
790544ef9f making the build system work (#33)
* build and dist improvements in makefile

* tidying up postgres docker

* makefile update
2016-10-17 05:05:48 -06:00
Neil O'Toole
980e49358e tidy up 2016-10-16 22:14:01 -06:00
Neil O'Toole
f66bc5da16 Initial commit 2016-02-15 19:01:18 -07:00