PostgreSQL zero-downtime migrations made easy
Go to file
Andrew Farries 9a08b6cc77
Implement Start for adding columns with NOT NULL and no DEFAULT (#37)
Implement `Start` for **add column** operations that add a `NOT NULL`
column without a `DEFAULT`.

To add such a column without forcing a exclusive lock while a full table
scan is performed, these steps need to be followed:

On `Start`:
1. Add the new column
2. Add a `CHECK IS NOT NULL` constraint to the new column, but with `NOT
VALID`, to avoid the scan.
3. Backfill the new column with the provided `up` SQL.

On `Complete`
1. Validate the constraint (with `ALTER TABLE VALIDATE CONSTRAINT`).
2. Add the `NOT NULL` attribute to the column. The presence of a valid
`NOT NULL` constraint on the column means that adding `NOT NULL` to the
column does not perform a full table scan.

See [this
post](https://medium.com/paypal-tech/postgresql-at-scale-database-schema-changes-without-downtime-20d3749ed680#00dc)
for a summary of these steps.
2023-07-21 07:47:42 +01:00
.github Pin Go to 1.20.5 to work around testcontainers/Go breakage (#40) 2023-07-21 07:44:35 +01:00
.vscode Add linter to tests (#9) 2023-06-27 16:33:50 +01:00
cmd Add a --complete flag to to the start command (#33) 2023-07-18 09:08:49 +01:00
examples Implement Start for adding columns with NOT NULL and no DEFAULT (#37) 2023-07-21 07:47:42 +01:00
pkg Implement Start for adding columns with NOT NULL and no DEFAULT (#37) 2023-07-21 07:47:42 +01:00
.golangci.yml Add linter to tests (#9) 2023-06-27 16:33:50 +01:00
docker-compose.yml Initial commit 2023-06-22 17:30:40 +02:00
go.mod Rename table op (#23) 2023-07-11 08:01:05 +00:00
go.sum Rename table op (#23) 2023-07-11 08:01:05 +00:00
main.go Add linter to tests (#9) 2023-06-27 16:33:50 +01:00
README.md Add migrations state handling (#7) 2023-06-28 11:10:03 +02:00

pg-roll

⚠️ Under development ⚠️

PostgreSQL zero-downtime migrations made easy.

Getting started (development)

  • Bring a development PostgreSQL up:

    docker compose up
    
  • Initialize pg-roll (first time only):

    go run . init
    
  • Start a migration:

    go run . start examples/01_create_tables.json
    
  • Inspect the results:

    psql postgres://localhost -U postgres
    
    \d+ public.*
    \d+ 01_create_tables.*
    
  • (Optional) Rollback the migration (undo):

    go run . rollback
    
  • Complete the migration:

    go run . complete