neilotoole/sq
1
1
Fork 0
mirror of https://github.com/neilotoole/sq.git synced 2024-12-18 13:41:49 +03:00
Code Issues Actions Packages Projects Releases Wiki Activity
605 Commits 7 Branches 98 Tags 55 MiB
3df79308a9
Commit Graph

128 Commits

Author SHA1 Message Date
Neil O'Toole
3df79308a9
profiling (#400) 
* oncecache refinement
* pprof
 2024-02-23 05:35:13 -07:00
Neil O'Toole
a3cd01f36a
#353 Diff performance (#399) 
* Diff refactor
 2024-02-20 16:26:45 -07:00
Neil O'Toole
07cbe46bde
Options refactoring (#395) 
* options.Opt now has a separate options.Flag field.
 2024-02-09 17:06:07 -07:00
Neil O'Toole
99454852f0
db tools preliminary work; --src.schema changes (#392) 
- Preliminary work on the (currently hidden) `db` cmds.
- Improvements to `--src.schema`
 2024-02-09 09:08:39 -07:00
Neil O'Toole
fd070eefd3
More file closing issues (test) (#386) 
* Refactored tu.TempDir

* More files fiddling
 2024-01-29 19:34:10 -07:00
Neil O'Toole
20b71c91b9
Moved time/tzdata import to main (#385) 2024-01-29 15:30:26 -07:00
Neil O'Toole
d8d5eb34df
Comments cleanup (#381) 2024-01-29 09:43:06 -07:00
Neil O'Toole
181e128a2d
Release wrap up v0.47.0 (#377) 
* Misc cleanup pre-release
 2024-01-28 14:55:51 -07:00
Neil O'Toole
54be3d614b
Linting (#373) 
* More linting
 2024-01-27 06:43:17 -07:00
Neil O'Toole
7c56377b40
Struct alignment (#369) 
* Field alignment
 2024-01-27 00:11:24 -07:00
Neil O'Toole
0841e7154f
tu.SkipIssue mechanism (#370) 
* tu.SkipIssue mechanism
 2024-01-26 22:36:04 -07:00
Neil O'Toole
452a91547c
Better handling of download cache refresh (#366) 
* A failed download cache refresh no longer destroys the previous cache.
 2024-01-26 15:18:38 -07:00
Neil O'Toole
cf0908abfa
JSON ingest performance (#365) 
* Implement json ingestion stmt caching
 2024-01-25 09:21:56 -07:00
Neil O'Toole
2898a92983
Refactor sqlmodel pkg (#364) 
* Refactor sqlmodel pkg
 2024-01-25 00:42:51 -07:00
Neil O'Toole
26f0c9a381
Refactor source.Files (#363) 
* Moved `source.Files` to its own package, thus the type is now `files.Files`.
* Moved much of the location functionality from pkg `source` to its own package `location`.
 2024-01-24 23:29:55 -07:00
Neil O'Toole
bb4a4edaab
Switch downloads to use streamcache. (#361) 
* Switch downloads to use neilotoole/streamcache.
 2024-01-24 21:01:24 -07:00
Neil O'Toole
9aa45b1db3
More progress bars (#357) 
* More progress bars
 2024-01-14 20:56:54 -07:00
Neil O'Toole
db55986980
#307: Ingest cache (#354) 
- Support for ingest cache, download cache, and progress bars.
 2024-01-14 18:45:34 -07:00
neilotoole
e7a28a73cc .gitignore updates 2023-12-06 13:36:13 -07:00
Neil O'Toole
f85da722ad
#335 decimal type support (#336) 
* Now using a dedicated `decimal.Decimal` type instead of float/string.
 2023-11-21 14:49:52 -07:00
Neil O'Toole
096e209a01
sq inspect now has --schemata and --catalogs modes (#334) 
* Add --schemata and --catalogs flags to "sq inspect"
 2023-11-20 14:42:38 -07:00
Neil O'Toole
79e1afd64f
SQL rownum() func (#332) 
* Implemented SLQ rownum() func
 2023-11-19 23:44:36 -07:00
Neil O'Toole
2de993acaa
Sort imports using goimports-reviser (#331) 2023-11-19 18:06:36 -07:00
Neil O'Toole
d7fc315028
sq inspect now shows catalog (when outputting in JSON and YAML format) (#329) 2023-11-19 07:21:38 -07:00
neilotoole
30b7d6421e Revert accidentally modified sakila.db 2023-11-19 05:48:41 -07:00
neilotoole
781e7ea235 CHANGELOG clarifications 2023-11-18 21:27:38 -07:00
Neil O'Toole
82727b3890
Refactor/rename database to pool (#328) 
* Renamed `driver.Database` to `driver.Pool` (and related things)

* workflow: Update tparse version

* workflow: Update golangci-lint version
 2023-11-18 19:21:14 -07:00
Neil O'Toole
511e69f59b
Bunch o' dependency updates (#327) 
* Bunch o' dependency updates

* All deps updated

* Linting
 2023-11-18 18:02:50 -07:00
Neil O'Toole
f07edef14d
Add flag --src.schema (#326) 
* Support for --src.schema in commands "slq", "sql", and "inspect"
 2023-11-18 17:05:48 -07:00
Neil O'Toole
5533dcab6f
Postgres sakiladb no longer requires separate admin user (#309) 2023-09-10 10:40:37 -06:00
Neil O'Toole
6b613d9adc
#279: SQLite virtual tables (#304) 
* sqlite: initial extensions support, including virtual tables and fts5
* sqlite: virtual table columns now report type
 2023-08-21 10:05:17 -06:00
Neil O'Toole
611ad30f60
Test ingest Excel file format variants (#303) 
* Tests for additional formats

* Tests for ingest Excel file format variants
 2023-08-20 07:22:24 -06:00
Neil O'Toole
db092d5453
CSV ingest improvements (#302) 
* csv: additional datetime detect formats
 2023-08-18 09:21:11 -06:00
Neil O'Toole
edc933d897
#200: Feature/200 excel driver (#301) 
* Switch to excelize driver
 2023-08-16 09:09:50 -06:00
Neil O'Toole
c7bba4dfe4
go1.21: changes to support slog as part of stdlib (#299) 
* go1.21: changes to support slog as part of stdlib

* Removed accidentially checked-in line of code

* Fixed minor linting issues; reenable typecheck

* go1.21: switched to stdlib slices pkg
 2023-08-12 12:54:14 -06:00
Neil O'Toole
21c1dea9c4
#200: Switch excel driver for output (#291) 
* Switched from xlsxw to excelw for Excel outpt
 2023-07-26 22:19:11 -06:00
Neil O'Toole
6ca26f4e4f
Column rename: template now has Alpha field. (#285) 
* wip: refactor col name mungeing

* Finished refactoring FieldMeta

* Renamed tpl .AlphaIndex to .Alpha

* wip: debugging source config override

* Source config override passing tests

* CHANGELOG update
 2023-07-08 19:34:53 -06:00
Neil O'Toole
9c5836ef1c
#191: XLSX driver auto-detects header row (#284) 
* xlsx driver now detects header row.
 2023-07-08 09:21:27 -06:00
Neil O'Toole
4ffaae925f
#99: Rename duplicate ingest headers (#283) 
* CSV now renames duplicate ingest headers

* Fix broken test

* xlsx ingester now handles duplicate col names

* Update CHANGELOG

* Additional tests for ingest.column.rename

* Removed dead comment in grammar
 2023-07-04 11:31:47 -06:00
Neil O'Toole
7396aadb9e
#12: multiple joins (#280) 
* The query language now supports multiple joins.
 2023-07-03 09:34:19 -06:00
Neil O'Toole
a5c4f9d6bd
#263: Inspect --overview; improved output (#273) 
* Refactor tablew md writer

* wip: cmd inspect -v

* cmd inspect output improved

* cmd inspect tests

* cmd inspect: help text
 2023-06-21 23:48:58 -06:00
Neil O'Toole
2abf7222ef
Simplify temp file handling (#260) 2023-06-18 00:44:01 -06:00
Neil O'Toole
2ba633fc2a
#258: Alias can be an arbitrary string. (#259) 
* Fixed space issues with expressions

* Alias can now be an arbitrary string

* Alias can now be an arbitrary string (fixed)

* Alias now automatically applied to expressions

* Ignore .run

* Fixed issue with TestRun not logging correctly to testing.T

* Fiddling with sqlite3 temp file closing

* Re-enable tests
 2023-06-18 00:05:09 -06:00
Neil O'Toole
44d27207f8
#256: column-only queries (#257) 
* Column-only queries
 2023-06-17 19:28:11 -06:00
Neil O'Toole
e0812e9a65
#242 - Handle *uint64 returned from db (#253) 2023-06-15 07:50:07 -06:00
Neil O'Toole
9cb42bf579
#244: shell completion for "sq add LOCATION" (#246) 
- Shell completion for `sq add LOCATION`.
 2023-06-13 10:06:18 -06:00
Neil O'Toole
3ecdde5595
record.Record elements are now values, not pointers (#243) 
* Updated record pkg

* sqlite migrated

* postgres migrated

* All DBs migrated

* CSV working

* Tests passing
 2023-05-27 07:57:07 -06:00
neilotoole
4eb917f276 Make testh.OptLongOpen even longer 2023-05-25 23:02:11 -06:00
Neil O'Toole
c810d17eec
#229: sq diff ready for beta release (#239) 
* sq config edit: fixed glaring bug that prevented editing a source

* Refine sq diff
 2023-05-25 21:58:43 -06:00
Neil O'Toole
c3a543aa84
#229: refactor mysql source metadata impl (#236) 
* refactor mysql source metadata impl

* Made loop condition stronger
 2023-05-23 18:42:36 -06:00