neilotoole/sq
1
1
Fork 0
mirror of https://github.com/neilotoole/sq.git synced 2024-12-22 15:41:35 +03:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
608 Commits 7 Branches 98 Tags 55 MiB
6b0918094d
Commit Graph

65 Commits

Author SHA1 Message Date
Neil O'Toole
78c3cfc77d
More progress bar enhancements (#404) 
* Progress bar enhancements
 2024-02-28 10:35:22 -07:00
Neil O'Toole
3df79308a9
profiling (#400) 
* oncecache refinement
* pprof
 2024-02-23 05:35:13 -07:00
Neil O'Toole
a3cd01f36a
#353 Diff performance (#399) 
* Diff refactor
 2024-02-20 16:26:45 -07:00
Neil O'Toole
99454852f0
db tools preliminary work; --src.schema changes (#392) 
- Preliminary work on the (currently hidden) `db` cmds.
- Improvements to `--src.schema`
 2024-02-09 09:08:39 -07:00
Neil O'Toole
7c56377b40
Struct alignment (#369) 
* Field alignment
 2024-01-27 00:11:24 -07:00
Neil O'Toole
cf0908abfa
JSON ingest performance (#365) 
* Implement json ingestion stmt caching
 2024-01-25 09:21:56 -07:00
Neil O'Toole
2898a92983
Refactor sqlmodel pkg (#364) 
* Refactor sqlmodel pkg
 2024-01-25 00:42:51 -07:00
Neil O'Toole
26f0c9a381
Refactor source.Files (#363) 
* Moved `source.Files` to its own package, thus the type is now `files.Files`.
* Moved much of the location functionality from pkg `source` to its own package `location`.
 2024-01-24 23:29:55 -07:00
Neil O'Toole
9aa45b1db3
More progress bars (#357) 
* More progress bars
 2024-01-14 20:56:54 -07:00
Neil O'Toole
db55986980
#307: Ingest cache (#354) 
- Support for ingest cache, download cache, and progress bars.
 2024-01-14 18:45:34 -07:00
Neil O'Toole
f85da722ad
#335 decimal type support (#336) 
* Now using a dedicated `decimal.Decimal` type instead of float/string.
 2023-11-21 14:49:52 -07:00
Neil O'Toole
096e209a01
sq inspect now has --schemata and --catalogs modes (#334) 
* Add --schemata and --catalogs flags to "sq inspect"
 2023-11-20 14:42:38 -07:00
Neil O'Toole
2de993acaa
Sort imports using goimports-reviser (#331) 2023-11-19 18:06:36 -07:00
Neil O'Toole
d7fc315028
sq inspect now shows catalog (when outputting in JSON and YAML format) (#329) 2023-11-19 07:21:38 -07:00
Neil O'Toole
82727b3890
Refactor/rename database to pool (#328) 
* Renamed `driver.Database` to `driver.Pool` (and related things)

* workflow: Update tparse version

* workflow: Update golangci-lint version
 2023-11-18 19:21:14 -07:00
Neil O'Toole
f07edef14d
Add flag --src.schema (#326) 
* Support for --src.schema in commands "slq", "sql", and "inspect"
 2023-11-18 17:05:48 -07:00
Neil O'Toole
5533dcab6f
Postgres sakiladb no longer requires separate admin user (#309) 2023-09-10 10:40:37 -06:00
Neil O'Toole
c7bba4dfe4
go1.21: changes to support slog as part of stdlib (#299) 
* go1.21: changes to support slog as part of stdlib

* Removed accidentially checked-in line of code

* Fixed minor linting issues; reenable typecheck

* go1.21: switched to stdlib slices pkg
 2023-08-12 12:54:14 -06:00
Neil O'Toole
6ca26f4e4f
Column rename: template now has Alpha field. (#285) 
* wip: refactor col name mungeing

* Finished refactoring FieldMeta

* Renamed tpl .AlphaIndex to .Alpha

* wip: debugging source config override

* Source config override passing tests

* CHANGELOG update
 2023-07-08 19:34:53 -06:00
Neil O'Toole
9c5836ef1c
#191: XLSX driver auto-detects header row (#284) 
* xlsx driver now detects header row.
 2023-07-08 09:21:27 -06:00
Neil O'Toole
4ffaae925f
#99: Rename duplicate ingest headers (#283) 
* CSV now renames duplicate ingest headers

* Fix broken test

* xlsx ingester now handles duplicate col names

* Update CHANGELOG

* Additional tests for ingest.column.rename

* Removed dead comment in grammar
 2023-07-04 11:31:47 -06:00
Neil O'Toole
7396aadb9e
#12: multiple joins (#280) 
* The query language now supports multiple joins.
 2023-07-03 09:34:19 -06:00
Neil O'Toole
a5c4f9d6bd
#263: Inspect --overview; improved output (#273) 
* Refactor tablew md writer

* wip: cmd inspect -v

* cmd inspect output improved

* cmd inspect tests

* cmd inspect: help text
 2023-06-21 23:48:58 -06:00
Neil O'Toole
9cb42bf579
#244: shell completion for "sq add LOCATION" (#246) 
- Shell completion for `sq add LOCATION`.
 2023-06-13 10:06:18 -06:00
Neil O'Toole
c810d17eec
#229: sq diff ready for beta release (#239) 
* sq config edit: fixed glaring bug that prevented editing a source

* Refine sq diff
 2023-05-25 21:58:43 -06:00
Neil O'Toole
2f2dfd6e47
#229: More diff (#233) 
- Implement `sq diff --data`.
 2023-05-22 09:08:14 -06:00
Neil O'Toole
1ea24dac4a
#229: sq diff core (#230) 
* "sq diff" initial implementation

* Refactor "cli" pkg.
 2023-05-19 08:24:18 -06:00
Neil O'Toole
3180334c0c
#199: Config overhaul (#214) 
* refactor: partially moved over driver.Tuning params to options

* All knobs moved to options

* sq config edit: now has comments for options

* Major work complete on config/options overhaul

* Major work complete on config/options overhaul

* Updated help text for 'sq version'
 2023-05-03 06:36:10 -06:00
Neil O'Toole
e5db7990bc
#199: Kill RunContext.Log (#211) 
* refactor: RunContext.Log is dead

* Fiddling with options

* Changed default max conns to zero (no limit)

* Linting
 2023-04-30 08:18:56 -06:00
Neil O'Toole
81f631e135
Refactoring (#206) 
* Renamed source.Type to source.DriverType for clarity

* More renaming wrt source.DriverType

* Renamed output.Formatting to output.Printing
 2023-04-21 21:36:32 -06:00
Neil O'Toole
54a0155ed6
Deal with lots of connections, especially for sq inspect. (#186) 
* wip: deal with lots of connections

* Clean up TestDatabase_SourceMetadata_concurrent

* Fixed error message
 2023-04-08 12:09:27 -06:00
Neil O'Toole
256d9c1ab6
go.mod: upgrade to jackc/pgx v5 (#184) 
* jackc/pgx upgrade

* jackc/pgx upgrade
 2023-04-08 06:39:06 -06:00
Neil O'Toole
9a1c6a7d09
Feature/173 args (#183) 
- Implement --arg feature
- Refactor sqlbuilder package (now called "render").
- Bug fixes, especially around expressions.
 2023-04-07 02:00:49 -06:00
Neil O'Toole
791d41ad1d
Removed dependencies on neilotoole/errgroup in favor of sync/errgroup (#176) 
* Removed dependencies on neilotoole/errgroup in favor of sync/errgroup

* Removed deadcode
 2023-04-02 15:17:15 -06:00
Neil O'Toole
3f6157c4c4
Change logging library to slog (#175) 
- Switch to slog logger.
 2023-04-02 13:49:45 -06:00
Neil O'Toole
8d47ef806d
go1.20 upgrade; lots of linting (#172) 2023-04-01 02:38:32 -06:00
Neil O'Toole
29e33ed2b1
Implement unique / DISTINCT (#165) 
- Implemented "unique" function
- Implemented "count_unique" function
 2023-03-28 00:48:24 -06:00
Neil O'Toole
a1a89ee9dd
Support table and column names with spaces. (#156) 
* sakila: initial test data

* sakila: more test data

* sakila: yet more test data setup

* whitespace cols: now working for sqlite

* grammar cleanup

* whitespace cols: now working inside count() func for sqlite

* whitespace cols: tests mostly passing; begining refactoring

* grammar: refactor handle

* grammar: more refactoring

* grammar: rename selElement to selector

* wip

* all tests passing

* all tests passing

* linting

* driver: implement CurrentSchema for all driver.SQLDriver impls

* driver: tests for AlterTableRename and AlterTableRenameColumn

* undo reformat of SQL

* undo reformat of SQL

* undo reformat of SQL

* undo reformat of SQL
 2023-03-22 00:17:34 -06:00
Neil O'Toole
d3e6f89829
SLQ support for column aliases (#150) 
* alias: more early work

* alias: test cases working for sqlite

* alias: SQL builder tests

* alias: func (col expr) aliases now working for SQLite

* linting

* CHANGELOG update

* Docs update

* Docs update

* Rename buildAst() -> buildAST()

* CHANGELOG typo
 2023-03-18 22:58:00 -06:00
Neil O'Toole
f71b124a1f
Testing for postgres alternate schema 2023-03-13 19:25:12 -06:00
Neil O'Toole
fab365f43c
gofumpt on files (#122) 
* gofumpt on files

* more gofumpt
 2022-12-18 01:35:59 -07:00
Neil O'Toole
c778c8ced5
Linting of _test.go files (#121) 
* test linting

* test linting

* test linting

* test linting
 2022-12-18 00:18:35 -07:00
Neil O'Toole
f9c19785e3
Almost at the end of the linting road (#120) 
* yet more linting

* yet more linting

* yet more linting

* yet more linting

* yet more linting

* yet more linting

* yet more linting

* yet more linting
 2022-12-17 23:42:11 -07:00
Neil O'Toole
ac7535609d
Yet more linting (#118) 
* lint fixes

* lint gosec
 2022-12-17 22:16:10 -07:00
Neil O'Toole
08dfa10325
Errors linting (#117) 
* errors linting

* errors linting

* formatting
 2022-12-17 21:31:06 -07:00
Neil O'Toole
540adfac58
Lint long lines (#115) 
* lint config now sorts results

* linted long lines

* linted long lines
 2022-12-17 19:43:53 -07:00
Neil O'Toole
2831211ae9
Yet more linting (#114) 
* wip: bunch o' linting

* bunch more linting
 2022-12-17 17:51:33 -07:00
Neil O'Toole
5187e8000a
bunch of linting issues fixed (#113) 2022-12-17 16:11:33 -07:00
Neil O'Toole
e425da528f
pg constraints now scan into sql.NullString for some fields (#110) 2022-12-16 19:24:52 -07:00
Neil O'Toole
e674cdc724
change 'interface{}' to 'any' (#108) 2022-12-16 16:34:33 -07:00