hasura/graphql-engine
1
0
Fork 0
mirror of https://github.com/hasura/graphql-engine.git synced 2024-12-15 17:31:56 +03:00
Code Issues Projects Releases Wiki Activity
b42d1dd249
graphql-engine/scripts/make/tests.mk

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

160 lines
6.4 KiB
Makefile
Raw Normal View History

server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
GRAPHQL_ENGINE_PATH=$(shell cabal list-bin exe:graphql-engine)
GRAPHQL_ENGINE_PRO_PATH=$(shell cabal list-bin exe:graphql-engine-pro)
tooling: add test commands to Makefile PR-URL: https://github.com/hasura/graphql-engine-mono/pull/4787 GitOrigin-RevId: 6fef3933dbc414ddc79f0f738e91e28bee4b8c4f
2022-06-20 16:33:04 +03:00
.PHONY: test-bigquery
## test-bigquery: run tests for BigQuery backend
Extract the test harness from the Hspec tests PR-URL: https://github.com/hasura/graphql-engine-mono/pull/6095 Co-authored-by: Gil Mizrahi <8547573+soupi@users.noreply.github.com> GitOrigin-RevId: 51693f7324e62e201a2bdc701255cf6c730745e2
2022-10-04 11:30:09 +03:00
# will require some setup detailed here: https://github.com/hasura/graphql-engine-mono/tree/main/server/lib/api-tests#required-setup-for-bigquery-tests
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
test-bigquery: build remove-tix-file
server/api-tests: Add a Docker Compose file for the API tests. We were previously using the Docker Compose file in the root directory for manual testing _and_ the server API tests. This splits them so we can e.g. add Yugabyte for easy manual testing. In the future, this will also allow us to use ephemeral ports for API test databases, while keeping the fixed ports for manual testing. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7524 GitOrigin-RevId: 7244e296b0ed0ace9782b6f44f321933a9d9a49d
2023-01-16 19:42:45 +03:00
$(API_TESTS_DOCKER_COMPOSE) up -d --wait postgres
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
HASURA_TEST_BACKEND_TYPE=BigQuery \
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PATH) \
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
cabal run api-tests:exe:api-tests
tooling: add test commands to Makefile PR-URL: https://github.com/hasura/graphql-engine-mono/pull/4787 GitOrigin-RevId: 6fef3933dbc414ddc79f0f738e91e28bee4b8c4f
2022-06-20 16:33:04 +03:00
.PHONY: test-sqlserver
server: Split the integration tests out into their own directories. We currently have a fairly intricate way of running our PostgreSQL and MSSQL integration tests (not the API tests). By splitting them out, we can simplify this a lot. Most prominently, we can rely on Cabal to be our argument parser instead of writing our own. We can also simplify how they're run in CI. They are currently (weirdly) run alongside the Python integration tests. This breaks them out into their own jobs for better visibility, and to avoid conflating the two. The changes are as follows: - The "unit" tests that rely on a running PostgreSQL database are extracted out to a new test directory so they can be run separately. - Most of the `Main` module comes with them. - We now refer to these as "integration" tests instead. - Likewise for the "unit" tests that rely on a running MS SQL Server database. These are a little simpler and we can use `hspec-discover`, with a `SpecHook` to extract the connection string from an environment variable. - Henceforth, these are the MS SQL Server integration tests. - New CI jobs have been added for each of these. - There wasn't actually a job for the MS SQL Server integration tests. It's pretty amazing they still run well. - The "haskell-tests" CI job, which used to run the PostgreSQL integration tests, has been removed. - The makefiles and contributing guide have been updated to run these. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/6912 GitOrigin-RevId: 67bbe2941bba31793f63d04a9a693779d4463ee1
2022-11-17 15:55:05 +03:00
## test-sqlserver: run tests for MS SQL Server backend
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
test-sqlserver: build remove-tix-file
server/api-tests: Add a Docker Compose file for the API tests. We were previously using the Docker Compose file in the root directory for manual testing _and_ the server API tests. This splits them so we can e.g. add Yugabyte for easy manual testing. In the future, this will also allow us to use ephemeral ports for API test databases, while keeping the fixed ports for manual testing. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7524 GitOrigin-RevId: 7244e296b0ed0ace9782b6f44f321933a9d9a49d
2023-01-16 19:42:45 +03:00
$(API_TESTS_DOCKER_COMPOSE) up -d --wait postgres sqlserver-healthcheck
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
HASURA_TEST_BACKEND_TYPE=SQLServer \
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PATH) \
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
cabal run api-tests:exe:api-tests
tooling: add test commands to Makefile PR-URL: https://github.com/hasura/graphql-engine-mono/pull/4787 GitOrigin-RevId: 6fef3933dbc414ddc79f0f738e91e28bee4b8c4f
2022-06-20 16:33:04 +03:00
tooling: Add `make ghcid-test-x` commands PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5274 GitOrigin-RevId: e9096812b1cd97f45fd89bf7deeca4d45fd9d422
2022-08-03 14:05:59 +03:00
.PHONY: test-citus
## test-citus: run tests for Citus backend
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
test-citus: build remove-tix-file
server/api-tests: Add a Docker Compose file for the API tests. We were previously using the Docker Compose file in the root directory for manual testing _and_ the server API tests. This splits them so we can e.g. add Yugabyte for easy manual testing. In the future, this will also allow us to use ephemeral ports for API test databases, while keeping the fixed ports for manual testing. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7524 GitOrigin-RevId: 7244e296b0ed0ace9782b6f44f321933a9d9a49d
2023-01-16 19:42:45 +03:00
$(API_TESTS_DOCKER_COMPOSE) up -d --wait postgres citus
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
HASURA_TEST_BACKEND_TYPE=Citus \
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PATH) \
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
cabal run api-tests:exe:api-tests
tooling: Add `make ghcid-test-x` commands PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5274 GitOrigin-RevId: e9096812b1cd97f45fd89bf7deeca4d45fd9d422
2022-08-03 14:05:59 +03:00
tooling: `make` commands for data-connectors PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5395 GitOrigin-RevId: 76e10ac7ebb1fa655a7523d38174f049dc683105
2022-08-25 15:08:07 +03:00
.PHONY: test-data-connectors
## test-data-connectors: run tests for Data Connectors
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
test-data-connectors: build remove-tix-file
server/api-tests: Add a Docker Compose file for the API tests. We were previously using the Docker Compose file in the root directory for manual testing _and_ the server API tests. This splits them so we can e.g. add Yugabyte for easy manual testing. In the future, this will also allow us to use ephemeral ports for API test databases, while keeping the fixed ports for manual testing. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7524 GitOrigin-RevId: 7244e296b0ed0ace9782b6f44f321933a9d9a49d
2023-01-16 19:42:45 +03:00
$(API_TESTS_DOCKER_COMPOSE) build
$(API_TESTS_DOCKER_COMPOSE) up -d --wait postgres dc-reference-agent dc-sqlite-agent
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
HASURA_TEST_BACKEND_TYPE=DataConnector \
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PATH) \
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
cabal run api-tests:exe:api-tests
tooling: `make` commands for data-connectors PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5395 GitOrigin-RevId: 76e10ac7ebb1fa655a7523d38174f049dc683105
2022-08-25 15:08:07 +03:00
add cockroach to docker compose and tests-hspec PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5558 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: b7f242939e718d5bb4f22b11c093ae77d21cdcce
2022-08-25 20:17:28 +03:00
.PHONY: test-cockroach
## test-cockroach: run tests for Cockroach backend
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
test-cockroach: build remove-tix-file
server/api-tests: Add a Docker Compose file for the API tests. We were previously using the Docker Compose file in the root directory for manual testing _and_ the server API tests. This splits them so we can e.g. add Yugabyte for easy manual testing. In the future, this will also allow us to use ephemeral ports for API test databases, while keeping the fixed ports for manual testing. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7524 GitOrigin-RevId: 7244e296b0ed0ace9782b6f44f321933a9d9a49d
2023-01-16 19:42:45 +03:00
$(API_TESTS_DOCKER_COMPOSE) up -d --wait postgres cockroach
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
HASURA_TEST_BACKEND_TYPE=Cockroach \
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PATH) \
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
cabal run api-tests:exe:api-tests
add cockroach to docker compose and tests-hspec PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5558 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: b7f242939e718d5bb4f22b11c093ae77d21cdcce
2022-08-25 20:17:28 +03:00
[tests] Add Yugabyte to docker compose PR-URL: https://github.com/hasura/graphql-engine-mono/pull/6532 GitOrigin-RevId: 1915c8f073ffb5f97d9e92faf436a8f03f4694b7
2022-11-01 18:17:45 +03:00
.PHONY: test-postgres
## test-postgres: run tests for Postgres backend
NDAT-293 Cleanup `Test.Databases.Postgres` PR-URL: https://github.com/hasura/graphql-engine-mono/pull/6929 GitOrigin-RevId: ef973937b3d80fba2ffa4a30ba9460c799eb677c
2022-11-18 01:34:02 +03:00
# we have a few tests labeled with 'Postgres' which test their variants, too,
# so this also starts containers for Postgres variants
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
test-postgres: build remove-tix-file
server/api-tests: Add a Docker Compose file for the API tests. We were previously using the Docker Compose file in the root directory for manual testing _and_ the server API tests. This splits them so we can e.g. add Yugabyte for easy manual testing. In the future, this will also allow us to use ephemeral ports for API test databases, while keeping the fixed ports for manual testing. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7524 GitOrigin-RevId: 7244e296b0ed0ace9782b6f44f321933a9d9a49d
2023-01-16 19:42:45 +03:00
$(API_TESTS_DOCKER_COMPOSE) up -d --wait postgres cockroach citus dc-sqlite-agent
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
HASURA_TEST_BACKEND_TYPE=Postgres \
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PATH) \
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
cabal run api-tests:exe:api-tests
[server/tests] allow api-tests to be filtered by backend type PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7056 GitOrigin-RevId: 84618c3d5a0c2273b51584831287968b4df73fba
2022-11-25 18:07:57 +03:00
.PHONY: test-no-backends
## test-no-backends
# the leftover tests with no particular backend, like Remote Schemas
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
test-no-backends: build start-backends remove-tix-file
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
HASURA_TEST_BACKEND_TYPE=None \
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PATH) \
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
cabal run api-tests:exe:api-tests
[tests] Add Yugabyte to docker compose PR-URL: https://github.com/hasura/graphql-engine-mono/pull/6532 GitOrigin-RevId: 1915c8f073ffb5f97d9e92faf436a8f03f4694b7
2022-11-01 18:17:45 +03:00
tooling: add test commands to Makefile PR-URL: https://github.com/hasura/graphql-engine-mono/pull/4787 GitOrigin-RevId: 6fef3933dbc414ddc79f0f738e91e28bee4b8c4f
2022-06-20 16:33:04 +03:00
.PHONY: test-backends
## test-backends: run tests for all backends
Extract the test harness from the Hspec tests PR-URL: https://github.com/hasura/graphql-engine-mono/pull/6095 Co-authored-by: Gil Mizrahi <8547573+soupi@users.noreply.github.com> GitOrigin-RevId: 51693f7324e62e201a2bdc701255cf6c730745e2
2022-10-04 11:30:09 +03:00
# BigQuery tests will require some setup detailed here: https://github.com/hasura/graphql-engine-mono/tree/main/server/lib/api-tests#required-setup-for-bigquery-tests
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
test-backends: build start-backends remove-tix-file
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PATH) \
cabal run api-tests:exe:api-tests
[server/tests] drop old postgres database better, and use less connections PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7227 GitOrigin-RevId: d7b3b313440d3f3c91d4ecb550513b53cbf2e92e
2022-12-12 20:44:47 +03:00
.PHONY: test-matrix
## test-matrix: postgres test matrix generator
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
test-matrix: build remove-tix-file
server/api-tests: Add a Docker Compose file for the API tests. We were previously using the Docker Compose file in the root directory for manual testing _and_ the server API tests. This splits them so we can e.g. add Yugabyte for easy manual testing. In the future, this will also allow us to use ephemeral ports for API test databases, while keeping the fixed ports for manual testing. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7524 GitOrigin-RevId: 7244e296b0ed0ace9782b6f44f321933a9d9a49d
2023-01-16 19:42:45 +03:00
$(API_TESTS_DOCKER_COMPOSE) up -d --wait postgres cockroach citus dc-sqlite-agent
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PATH) \
cabal run api-tests:exe:produce-feature-matrix +RTS -N4 -RTS
tooling: add `make` commands for running unit tests PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5537 GitOrigin-RevId: 6427a51f729a4d4724299ea9a6a5d0e808882c86
2022-08-19 14:22:28 +03:00
GDC Snowflake Integration Tests PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7528 GitOrigin-RevId: f90ee61899349735dc2fc0fbe6ed499614630a0f
2023-01-25 08:53:05 +03:00
.PHONY: test-data-connectors-pro
GDC Mysql integration tests PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7603 Co-authored-by: Daniel Chambers <1214352+daniel-chambers@users.noreply.github.com> GitOrigin-RevId: 651bc2fb59a46449e2a4325a4c7af57592e53845
2023-02-16 09:29:19 +03:00
## test-data-connectors-pro: run tests for HGE pro for all backends
GDC Snowflake Integration Tests PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7528 GitOrigin-RevId: f90ee61899349735dc2fc0fbe6ed499614630a0f
2023-01-25 08:53:05 +03:00
test-data-connectors-pro: build-pro remove-tix-file
docker compose up -d --wait postgres dc-sqlite-agent
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PRO_PATH) \
cabal run api-tests-pro:exe:api-tests-pro
GDC Snowflake Integration Tests PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7528 GitOrigin-RevId: f90ee61899349735dc2fc0fbe6ed499614630a0f
2023-01-25 08:53:05 +03:00
.PHONY: test-data-connectors-snowflake-pro
## test-data-connectors-snowflake-pro: run tests for HGE pro for all backends
test-data-connectors-snowflake-pro: build-pro remove-tix-file
docker compose up -d --wait postgres dc-sqlite-agent
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PRO_PATH) \
cabal run api-tests-pro:exe:api-tests-pro -- --match "DataConnector \"snowflake\""
GDC Snowflake Integration Tests PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7528 GitOrigin-RevId: f90ee61899349735dc2fc0fbe6ed499614630a0f
2023-01-25 08:53:05 +03:00
GDC Mysql integration tests PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7603 Co-authored-by: Daniel Chambers <1214352+daniel-chambers@users.noreply.github.com> GitOrigin-RevId: 651bc2fb59a46449e2a4325a4c7af57592e53845
2023-02-16 09:29:19 +03:00
.PHONY: test-data-connectors-athena-pro
## test-data-connectors-athena-pro: run tests for HGE pro for all backends
test-data-connectors-athena-pro: build-pro remove-tix-file
docker compose up -d --wait postgres dc-sqlite-agent
$(call stop_after, \
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PRO_PATH) \
cabal run api-tests-pro:exe:api-tests-pro -- --match "DataConnector \"athena\"")
.PHONY: test-data-connectors-mysql-pro
## test-data-connectors-mysql-pro: run tests for HGE pro for all backends
test-data-connectors-mysql-pro: build-pro remove-tix-file
cd pro/server/lib/api-tests && docker compose up -d --wait postgres dc-sqlite-agent --wait mysql
$(call stop_after, \
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PRO_PATH) \
cabal run api-tests-pro:exe:api-tests-pro -- --match "DataConnector \"mysql2\"")
[pro/tests] add sample tests for `api-tests-pro` PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7180 GitOrigin-RevId: 65f8b5fefbb2341dad0cf73e6b1d2e9d604e6bfb
2022-12-14 06:46:10 +03:00
.PHONY: test-backends-pro
## test-backends-pro: run tests for HGE pro for all backends
server/tests: Ability to run HGE via external process. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7329 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> GitOrigin-RevId: 74b293a1d5fb7de52a85e42cfcb0314af0006822
2023-01-03 17:03:35 +03:00
test-backends-pro: build-pro start-backends remove-tix-file
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PRO_PATH) \
cabal run api-tests-pro:exe:api-tests-pro
[pro/tests] add sample tests for `api-tests-pro` PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7180 GitOrigin-RevId: 65f8b5fefbb2341dad0cf73e6b1d2e9d604e6bfb
2022-12-14 06:46:10 +03:00
tooling: add `make` commands for running unit tests PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5537 GitOrigin-RevId: 6427a51f729a4d4724299ea9a6a5d0e808882c86
2022-08-19 14:22:28 +03:00
.PHONY: test-unit
## test-unit: run unit tests from main suite
test-unit: remove-tix-file
server: Split the integration tests out into their own directories. We currently have a fairly intricate way of running our PostgreSQL and MSSQL integration tests (not the API tests). By splitting them out, we can simplify this a lot. Most prominently, we can rely on Cabal to be our argument parser instead of writing our own. We can also simplify how they're run in CI. They are currently (weirdly) run alongside the Python integration tests. This breaks them out into their own jobs for better visibility, and to avoid conflating the two. The changes are as follows: - The "unit" tests that rely on a running PostgreSQL database are extracted out to a new test directory so they can be run separately. - Most of the `Main` module comes with them. - We now refer to these as "integration" tests instead. - Likewise for the "unit" tests that rely on a running MS SQL Server database. These are a little simpler and we can use `hspec-discover`, with a `SpecHook` to extract the connection string from an environment variable. - Henceforth, these are the MS SQL Server integration tests. - New CI jobs have been added for each of these. - There wasn't actually a job for the MS SQL Server integration tests. It's pretty amazing they still run well. - The "haskell-tests" CI job, which used to run the PostgreSQL integration tests, has been removed. - The makefiles and contributing guide have been updated to run these. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/6912 GitOrigin-RevId: 67bbe2941bba31793f63d04a9a693779d4463ee1
2022-11-17 15:55:05 +03:00
cabal run graphql-engine:test:graphql-engine-tests
.PHONY: test-integration-mssql
## test-integration-mssql: run MS SQL Server integration tests
test-integration-mssql: remove-tix-file
docker compose up -d --wait sqlserver{,-healthcheck,-init}
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
HASURA_MSSQL_CONN_STR='$(TEST_MSSQL_CONNECTION_STRING)' \
cabal run graphql-engine:test:graphql-engine-test-mssql
server: Split the integration tests out into their own directories. We currently have a fairly intricate way of running our PostgreSQL and MSSQL integration tests (not the API tests). By splitting them out, we can simplify this a lot. Most prominently, we can rely on Cabal to be our argument parser instead of writing our own. We can also simplify how they're run in CI. They are currently (weirdly) run alongside the Python integration tests. This breaks them out into their own jobs for better visibility, and to avoid conflating the two. The changes are as follows: - The "unit" tests that rely on a running PostgreSQL database are extracted out to a new test directory so they can be run separately. - Most of the `Main` module comes with them. - We now refer to these as "integration" tests instead. - Likewise for the "unit" tests that rely on a running MS SQL Server database. These are a little simpler and we can use `hspec-discover`, with a `SpecHook` to extract the connection string from an environment variable. - Henceforth, these are the MS SQL Server integration tests. - New CI jobs have been added for each of these. - There wasn't actually a job for the MS SQL Server integration tests. It's pretty amazing they still run well. - The "haskell-tests" CI job, which used to run the PostgreSQL integration tests, has been removed. - The makefiles and contributing guide have been updated to run these. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/6912 GitOrigin-RevId: 67bbe2941bba31793f63d04a9a693779d4463ee1
2022-11-17 15:55:05 +03:00
.PHONY: test-integration-postgres
## test-integration-postgres: run PostgreSQL integration tests
test-integration-postgres: remove-tix-file
docker compose up -d --wait postgres
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
HASURA_GRAPHQL_DATABASE_URL='$(TEST_POSTGRES_URL)' \
cabal run graphql-engine:test:graphql-engine-test-postgres
[tooling] add `make py-tests` command PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7196 GitOrigin-RevId: 1507285bb42734a04bfb130f0cd1a0c28be2f3ca
2022-12-07 17:11:43 +03:00
rename naqi to logimo part 1 PR-URL: https://github.com/hasura/graphql-engine-mono/pull/8037 GitOrigin-RevId: 4839410ba836d4b69fd1ee30875bca9b46decc66
2023-02-21 16:45:12 +03:00
.PHONY: test-logical-models
## test-logical-models: run all tests for the Logical Model feature
test-logical-models:
feat(logical models): Add validation of types and parameters PR-URL: https://github.com/hasura/graphql-engine-mono/pull/8267 GitOrigin-RevId: 827852edf074eb72c95ac379fe3ac5d095fd26ab
2023-03-13 21:13:56 +03:00
cabal build exe:graphql-engine
feature(server): metadata for SQLServer logical model PR-URL: https://github.com/hasura/graphql-engine-mono/pull/8444 GitOrigin-RevId: 86cfd7adbf326560a0ec72034de3dcd9dcb5124c
2023-03-22 20:09:55 +03:00
docker compose up -d --wait postgres citus sqlserver-healthcheck
rename naqi to logimo part 1 PR-URL: https://github.com/hasura/graphql-engine-mono/pull/8037 GitOrigin-RevId: 4839410ba836d4b69fd1ee30875bca9b46decc66
2023-02-21 16:45:12 +03:00
HSPEC_MATCH=LogicalModels make test-unit
Handle `docker` when running `make test-logical-models` PR-URL: https://github.com/hasura/graphql-engine-mono/pull/8177 GitOrigin-RevId: 25faf2c94c5a605c49495e4da848683ae32c1927
2023-03-02 19:33:39 +03:00
HASURA_TEST_BACKEND_TYPE=Postgres \
HSPEC_MATCH=LogicalModels \
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PATH) \
cabal run api-tests:exe:api-tests
feature(server): metadata for SQLServer logical model PR-URL: https://github.com/hasura/graphql-engine-mono/pull/8444 GitOrigin-RevId: 86cfd7adbf326560a0ec72034de3dcd9dcb5124c
2023-03-22 20:09:55 +03:00
HASURA_TEST_BACKEND_TYPE=Citus \
HSPEC_MATCH=LogicalModels \
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PATH) \
cabal run api-tests:exe:api-tests
HASURA_TEST_BACKEND_TYPE=BigQuery \
Logical Models for BigQuery PR-URL: https://github.com/hasura/graphql-engine-mono/pull/8447 Co-authored-by: Daniel Harvey <4729125+danieljharvey@users.noreply.github.com> Co-authored-by: Nicolas Beaussart <7281023+beaussan@users.noreply.github.com> Co-authored-by: Antoine Leblanc <1618949+nicuveo@users.noreply.github.com> Co-authored-by: Varun Choudhary <68095256+Varun-Choudhary@users.noreply.github.com> Co-authored-by: ananya-2410 <107847554+ananya-2410@users.noreply.github.com> Co-authored-by: Matthew Goodwin <49927862+m4ttheweric@users.noreply.github.com> Co-authored-by: Abhijeet Khangarot <26903230+abhi40308@users.noreply.github.com> Co-authored-by: Puru Gupta <32328846+purugupta99@users.noreply.github.com> Co-authored-by: Gil Mizrahi <8547573+soupi@users.noreply.github.com> Co-authored-by: Rob Dominguez <24390149+robertjdominguez@users.noreply.github.com> GitOrigin-RevId: ddef9d54bfad6b7d5dc51251dbe47eac43995da3
2023-03-24 18:15:24 +03:00
HSPEC_MATCH=LogicalModel \
feature(server): metadata for SQLServer logical model PR-URL: https://github.com/hasura/graphql-engine-mono/pull/8444 GitOrigin-RevId: 86cfd7adbf326560a0ec72034de3dcd9dcb5124c
2023-03-22 20:09:55 +03:00
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PATH) \
cabal run api-tests:exe:api-tests
HASURA_TEST_BACKEND_TYPE=SQLServer \
HSPEC_MATCH=Metadata.LogicalModel \
GRAPHQL_ENGINE=$(GRAPHQL_ENGINE_PATH) \
cabal run api-tests:exe:api-tests
[tooling] add `make py-tests` command PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7196 GitOrigin-RevId: 1507285bb42734a04bfb130f0cd1a0c28be2f3ca
2022-12-07 17:11:43 +03:00
.PHONY: py-tests
## py-tests: run the python-based test suite
py-tests:
make: Don't stop test database containers after running tests. The tests no longer need a fresh, clean database, so we don't need to spend the time spinning them up and shutting them down again. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7732 GitOrigin-RevId: f2b412f4a8c762ee6699bd1bec1eef89f7682712
2023-01-31 19:58:43 +03:00
./server/tests-py/run-new.sh
Reference in New Issue Copy Permalink