41 Commits

Author	SHA1	Message	Date
Neil O'Toole	54be3d614b	Linting (#373) ... * More linting	2024-01-27 06:43:17 -07:00
Neil O'Toole	7c56377b40	Struct alignment (#369) ... * Field alignment	2024-01-27 00:11:24 -07:00
Neil O'Toole	452a91547c	Better handling of download cache refresh (#366) ... * A failed download cache refresh no longer destroys the previous cache.	2024-01-26 15:18:38 -07:00
Neil O'Toole	2898a92983	Refactor sqlmodel pkg (#364) ... * Refactor sqlmodel pkg	2024-01-25 00:42:51 -07:00
Neil O'Toole	26f0c9a381	Refactor source.Files (#363) ... * Moved `source.Files` to its own package, thus the type is now `files.Files`. * Moved much of the location functionality from pkg `source` to its own package `location`.	2024-01-24 23:29:55 -07:00
Neil O'Toole	bb4a4edaab	Switch downloads to use streamcache. (#361) ... * Switch downloads to use neilotoole/streamcache.	2024-01-24 21:01:24 -07:00
Neil O'Toole	db55986980	#307: Ingest cache (#354) ... - Support for ingest cache, download cache, and progress bars.	2024-01-14 18:45:34 -07:00
Neil O'Toole	096e209a01	sq inspect now has --schemata and --catalogs modes (#334) ... * Add --schemata and --catalogs flags to "sq inspect"	2023-11-20 14:42:38 -07:00
Neil O'Toole	2de993acaa	Sort imports using goimports-reviser (#331)	2023-11-19 18:06:36 -07:00
Neil O'Toole	82727b3890	Refactor/rename database to pool (#328) ... * Renamed `driver.Database` to `driver.Pool` (and related things) * workflow: Update tparse version * workflow: Update golangci-lint version	2023-11-18 19:21:14 -07:00
Neil O'Toole	f07edef14d	Add flag --src.schema (#326) ... * Support for --src.schema in commands "slq", "sql", and "inspect"	2023-11-18 17:05:48 -07:00
Neil O'Toole	c7bba4dfe4	go1.21: changes to support slog as part of stdlib (#299) ... * go1.21: changes to support slog as part of stdlib * Removed accidentially checked-in line of code * Fixed minor linting issues; reenable typecheck * go1.21: switched to stdlib slices pkg	2023-08-12 12:54:14 -06:00
Neil O'Toole	9c5836ef1c	#191: XLSX driver auto-detects header row (#284) ... * xlsx driver now detects header row.	2023-07-08 09:21:27 -06:00
Neil O'Toole	a5c4f9d6bd	#263: Inspect --overview; improved output (#273) ... * Refactor tablew md writer * wip: cmd inspect -v * cmd inspect output improved * cmd inspect tests * cmd inspect: help text	2023-06-21 23:48:58 -06:00
Neil O'Toole	44d27207f8	#256: column-only queries (#257) ... * Column-only queries	2023-06-17 19:28:11 -06:00
Neil O'Toole	3180334c0c	#199: Config overhaul (#214) ... * refactor: partially moved over driver.Tuning params to options * All knobs moved to options * sq config edit: now has comments for options * Major work complete on config/options overhaul * Major work complete on config/options overhaul * Updated help text for 'sq version'	2023-05-03 06:36:10 -06:00
Neil O'Toole	e5db7990bc	#199: Kill RunContext.Log (#211) ... * refactor: RunContext.Log is dead * Fiddling with options * Changed default max conns to zero (no limit) * Linting	2023-04-30 08:18:56 -06:00
Neil O'Toole	5e31da4644	Refactor config options (#209) ... * Refactor config and options.	2023-04-26 09:16:42 -06:00
Neil O'Toole	81f631e135	Refactoring (#206) ... * Renamed source.Type to source.DriverType for clarity * More renaming wrt source.DriverType * Renamed output.Formatting to output.Printing	2023-04-21 21:36:32 -06:00
neilotoole	c1b71fa68a	Renamed testh.OptLongDB to testh.OptLongOpen; added it to other tests.	2023-04-19 08:08:26 -06:00
Neil O'Toole	98b47a2666	#199 - Config, refactoring (#204) ... * refactor: moved cli flags to pkg cli/flag * testh: add OptLongDB for long-running tests * implement 'sq config dir' * legacy dir migration: probably a bad idea * cleanup * Refactored SQ_CONFIG and --config * added yaml writer * Dialing in tests * YAML output for 'sq driver ls' * Significant refactoring of config * Minor test for ioz * Rename source.Set to source.Collection * Cleaning up references to source.Set	2023-04-18 23:28:09 -06:00
Neil O'Toole	ad23d5c116	Auto-detect CSV headers (#188) ... * wip: initial header detection * wip: refactored csv driver * wip: Fixes to kind.Detector * typo * Refactor pkg csv files * Update to changelog * workflow: now running codacy and codeql on cron, not on push/pr	2023-04-09 08:44:27 -06:00
Neil O'Toole	54a0155ed6	Deal with lots of connections, especially for sq inspect. (#186) ... * wip: deal with lots of connections * Clean up TestDatabase_SourceMetadata_concurrent * Fixed error message	2023-04-08 12:09:27 -06:00
Neil O'Toole	3f6157c4c4	Change logging library to slog (#175) ... - Switch to slog logger.	2023-04-02 13:49:45 -06:00
Neil O'Toole	8d47ef806d	go1.20 upgrade; lots of linting (#172)	2023-04-01 02:38:32 -06:00
Neil O'Toole	161d6f9ee7	Fix to docs for cmd_sql (#148)	2023-03-15 01:43:48 -06:00
Neil O'Toole	fff01a32db	Chore/yet more mod upgrades (#128) ... * gopkg.in/yaml.v3 upgrade * emirpasic/gods@v1.18.1 * yet more module stuff	2022-12-23 14:05:24 -07:00
Neil O'Toole	fab365f43c	gofumpt on files (#122) ... * gofumpt on files * more gofumpt	2022-12-18 01:35:59 -07:00
Neil O'Toole	c778c8ced5	Linting of _test.go files (#121) ... * test linting * test linting * test linting * test linting	2022-12-18 00:18:35 -07:00
Neil O'Toole	f9c19785e3	Almost at the end of the linting road (#120) ... * yet more linting * yet more linting * yet more linting * yet more linting * yet more linting * yet more linting * yet more linting * yet more linting	2022-12-17 23:42:11 -07:00
Neil O'Toole	425702e7ba	The linting goes on forever (#119) ... * linting * yet more linting * yet more linting * yet more linting * yet more linting * yet more linting	2022-12-17 23:07:38 -07:00
Neil O'Toole	08dfa10325	Errors linting (#117) ... * errors linting * errors linting * formatting	2022-12-17 21:31:06 -07:00
Neil O'Toole	540adfac58	Lint long lines (#115) ... * lint config now sorts results * linted long lines * linted long lines	2022-12-17 19:43:53 -07:00
Neil O'Toole	2831211ae9	Yet more linting (#114) ... * wip: bunch o' linting * bunch more linting	2022-12-17 17:51:33 -07:00
Neil O'Toole	6a0878bc6b	fixed broken mysql tests (parseTime param); moved some test funcs to pkg tutil (#109)	2022-12-16 19:09:49 -07:00
Neil O'Toole	e674cdc724	change 'interface{}' to 'any' (#108)	2022-12-16 16:34:33 -07:00
unknown	8d2398b309	close db resources	2021-01-01 18:57:07 -07:00
Neil O'Toole	1818d50546	moved pkg libsq/sqlmodel to libsq/core/sqlmodel (#68)	2020-08-23 13:00:13 -06:00
Neil O'Toole	58ccfc9ded	Json driver; refactoring of core packages (#66) ... * Type Detector refactor * json driver impl; refactoring of source.Files reader et al * working on kind detector * significant switcheroo of packages * partway throught refactoring Kind * major package switcheroo for Kind	2020-08-23 04:42:15 -06:00
Neil O'Toole	1ceb50e795	SQL batch insert (#58) ... * initial refactoring for the numRows param * work on driver.NewBatchInsert * work on NewBatchInsert * batch insert seems to work * switched testh.Insert to use BatchInsert * doc cleanup * batch insert for dbwriter and csv * removed unneeded NumRows from driver.StmtExecer * minor tidyup	2020-08-12 12:24:01 -06:00
Neil O'Toole	fd4ae53f31	codebase refactor	2020-08-06 11:58:47 -06:00