sq data wrangler
Go to file
Neil O'Toole 1ceb50e795
SQL batch insert (#58)
* initial refactoring for the numRows param

* work on driver.NewBatchInsert

* work on NewBatchInsert

* batch insert seems to work

* switched testh.Insert to use BatchInsert

* doc cleanup

* batch insert for dbwriter and csv

* removed unneeded NumRows from driver.StmtExecer

* minor tidyup
2020-08-12 12:24:01 -06:00
.github/workflows replaced sakila source slices with funcs (#56) 2020-08-09 08:40:46 -06:00
cli SQL batch insert (#58) 2020-08-12 12:24:01 -06:00
drivers SQL batch insert (#58) 2020-08-12 12:24:01 -06:00
grammar codebase refactor 2020-08-06 11:58:47 -06:00
libsq SQL batch insert (#58) 2020-08-12 12:24:01 -06:00
notifiers codebase refactor 2020-08-06 11:58:47 -06:00
testh SQL batch insert (#58) 2020-08-12 12:24:01 -06:00
.editorconfig tidy up 2016-10-16 22:14:01 -06:00
.gitattributes Added go test to github action; fixed Windows test issues (#52) 2020-08-07 23:10:41 -06:00
.gitignore codebase refactor 2020-08-06 11:58:47 -06:00
.golangci.yml codebase refactor 2020-08-06 11:58:47 -06:00
.goreleaser.yml Minor tidying of README and .goreleaser.yml 2020-08-06 12:37:33 -06:00
.lnav.json codebase refactor 2020-08-06 11:58:47 -06:00
go.mod SQL batch insert (#58) 2020-08-12 12:24:01 -06:00
go.sum SQL batch insert (#58) 2020-08-12 12:24:01 -06:00
LICENSE codebase refactor 2020-08-06 11:58:47 -06:00
magefile_release.go codebase refactor 2020-08-06 11:58:47 -06:00
magefile_sakila.go codebase refactor 2020-08-06 11:58:47 -06:00
magefile.go codebase refactor 2020-08-06 11:58:47 -06:00
main.go refactor cli.writers (#51) 2020-08-07 21:06:56 -06:00
README.md Minor tidying of README and .goreleaser.yml 2020-08-06 12:37:33 -06:00

sq: swiss army knife for data

sq is a swiss army knife for data. sq provides uniform access to structured data sources like traditional SQL-style databases, or document formats such as CSV or Excel. sq can perform cross-source joins, execute database-native SQL, and output to a multitude of formats including JSON, Excel, CSV, HTML markdown and XML, or output directly to a SQL database. sq can inspect sources to see metadata about the source structure (tables, columns, size) and has commands for frequent database operations such as copying or dropping tables.

Usage

See the wiki.

Installation

From source

From the sq project dir:

$ go install

The simple go install does not populate the binary with build info that is output via the sq version command. To do so, use mage.

$ brew install mage
$ mage install

Other installation options

For homebrew, scoop, rpm etc, see the wiki.

Acknowledgements

  • Much inspiration is owed to jq.
  • See go.mod for a list of third-party packages.
  • Additionally, sq incorporates modified versions of:
  • The Sakila example databases were lifted from jOOQ, which in turn owe their heritage to earlier work on Sakila.