hasura/graphql-engine
1
0
Fork 0
mirror of https://github.com/hasura/graphql-engine.git synced 2024-12-15 17:31:56 +03:00
Code Issues Projects Releases Wiki Activity
68100c440c
graphql-engine/scripts/make/test-infrastructure.mk

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

40 lines
1.5 KiB
Makefile
Raw Normal View History

server/api-tests: Add a Docker Compose file for the API tests. We were previously using the Docker Compose file in the root directory for manual testing _and_ the server API tests. This splits them so we can e.g. add Yugabyte for easy manual testing. In the future, this will also allow us to use ephemeral ports for API test databases, while keeping the fixed ports for manual testing. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7524 GitOrigin-RevId: 7244e296b0ed0ace9782b6f44f321933a9d9a49d
2023-01-16 19:42:45 +03:00
API_TESTS_DOCKER_COMPOSE = docker compose --project-directory=./server/lib/api-tests
feat(postgres data connector): Adding initial support for /Schema PR-URL: https://github.com/hasura/graphql-engine-mono/pull/9018 Co-authored-by: Philip Lykke Carlsen <358550+plcplc@users.noreply.github.com> GitOrigin-RevId: 4330c1201bac790b370d3d53d915f8ffe00ba0c9
2023-05-04 00:11:12 +03:00
DC_POSTGRES_DOCKER_COMPOSE = docker compose --project-directory=./pro/dc-agents/postgres/
GDC Mysql integration tests PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7603 Co-authored-by: Daniel Chambers <1214352+daniel-chambers@users.noreply.github.com> GitOrigin-RevId: 651bc2fb59a46449e2a4325a4c7af57592e53845
2023-02-16 09:29:19 +03:00
API_PRO_TESTS_DOCKER_COMPOSE = docker compose --project-directory=./pro/server/lib/api-tests
server/api-tests: Add a Docker Compose file for the API tests. We were previously using the Docker Compose file in the root directory for manual testing _and_ the server API tests. This splits them so we can e.g. add Yugabyte for easy manual testing. In the future, this will also allow us to use ephemeral ports for API test databases, while keeping the fixed ports for manual testing. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7524 GitOrigin-RevId: 7244e296b0ed0ace9782b6f44f321933a9d9a49d
2023-01-16 19:42:45 +03:00
PYTHON_TESTS_DOCKER_COMPOSE = docker compose --project-directory=./server/tests-py
server/tests-hspec: Simplifying the steps required to run these on macOS on aarch64. This makes a few changes to the test scripts and makefiles in order to make things simpler for the average Apple user. First of all, we change the `wait_for_mysql` function to use "localhost", not "127.0.0.1", as this fixed an issue on my system when attempting to connect to the MySQL server. Secondly, we split the SQL Server test image into two: * The first is the server itself, which now automatically uses `azure-sql-edge` as the image if you are on an aarch64 chip and using the `make` commands. * The second is the initialization script. Because `sqlcmd` is not available in the `azure-sql-edge` image on aarch64, we use a separate container based on `mssql-tools` to initialize the server. The README has been updated. Tested on both macOS/aarch64 (with other changes) and Linux/x86_64. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5986 GitOrigin-RevId: b16e079861dcbcc66773295c47d715e443b67eea
2022-09-21 19:47:11 +03:00
# Use the Azure SQL Edge image instead of the SQL Server image on arm64.
# The latter doesn't work yet.
ifeq ($(shell uname -m),arm64)
MSSQL_IMAGE=mcr.microsoft.com/azure-sql-edge
server: Get `make test-backends` working and somewhat speedy. * Fix `make start-sqlserver` so it can find `sqlcmd`. * Start the DC reference agent when testing all backends. * Start backends in parallel so it doesn't take so long to spin them up. This is achieved by splitting all `start-*` tasks into `spawn-*` and `wait-for-*`. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5176 GitOrigin-RevId: ea483a755daa3fa6a8701f9d3dd0f393bc56510f
2022-07-27 16:29:06 +03:00
else
server/tests-hspec: Simplifying the steps required to run these on macOS on aarch64. This makes a few changes to the test scripts and makefiles in order to make things simpler for the average Apple user. First of all, we change the `wait_for_mysql` function to use "localhost", not "127.0.0.1", as this fixed an issue on my system when attempting to connect to the MySQL server. Secondly, we split the SQL Server test image into two: * The first is the server itself, which now automatically uses `azure-sql-edge` as the image if you are on an aarch64 chip and using the `make` commands. * The second is the initialization script. Because `sqlcmd` is not available in the `azure-sql-edge` image on aarch64, we use a separate container based on `mssql-tools` to initialize the server. The README has been updated. Tested on both macOS/aarch64 (with other changes) and Linux/x86_64. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5986 GitOrigin-RevId: b16e079861dcbcc66773295c47d715e443b67eea
2022-09-21 19:47:11 +03:00
MSSQL_IMAGE= # allow the Docker Compose file to set the image
server: Get `make test-backends` working and somewhat speedy. * Fix `make start-sqlserver` so it can find `sqlcmd`. * Start the DC reference agent when testing all backends. * Start backends in parallel so it doesn't take so long to spin them up. This is achieved by splitting all `start-*` tasks into `spawn-*` and `wait-for-*`. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5176 GitOrigin-RevId: ea483a755daa3fa6a8701f9d3dd0f393bc56510f
2022-07-27 16:29:06 +03:00
endif
server/tests-hspec: Simplifying the steps required to run these on macOS on aarch64. This makes a few changes to the test scripts and makefiles in order to make things simpler for the average Apple user. First of all, we change the `wait_for_mysql` function to use "localhost", not "127.0.0.1", as this fixed an issue on my system when attempting to connect to the MySQL server. Secondly, we split the SQL Server test image into two: * The first is the server itself, which now automatically uses `azure-sql-edge` as the image if you are on an aarch64 chip and using the `make` commands. * The second is the initialization script. Because `sqlcmd` is not available in the `azure-sql-edge` image on aarch64, we use a separate container based on `mssql-tools` to initialize the server. The README has been updated. Tested on both macOS/aarch64 (with other changes) and Linux/x86_64. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5986 GitOrigin-RevId: b16e079861dcbcc66773295c47d715e443b67eea
2022-09-21 19:47:11 +03:00
export MSSQL_IMAGE
server: Get `make test-backends` working and somewhat speedy. * Fix `make start-sqlserver` so it can find `sqlcmd`. * Start the DC reference agent when testing all backends. * Start backends in parallel so it doesn't take so long to spin them up. This is achieved by splitting all `start-*` tasks into `spawn-*` and `wait-for-*`. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5176 GitOrigin-RevId: ea483a755daa3fa6a8701f9d3dd0f393bc56510f
2022-07-27 16:29:06 +03:00
server: Split the integration tests out into their own directories. We currently have a fairly intricate way of running our PostgreSQL and MSSQL integration tests (not the API tests). By splitting them out, we can simplify this a lot. Most prominently, we can rely on Cabal to be our argument parser instead of writing our own. We can also simplify how they're run in CI. They are currently (weirdly) run alongside the Python integration tests. This breaks them out into their own jobs for better visibility, and to avoid conflating the two. The changes are as follows: - The "unit" tests that rely on a running PostgreSQL database are extracted out to a new test directory so they can be run separately. - Most of the `Main` module comes with them. - We now refer to these as "integration" tests instead. - Likewise for the "unit" tests that rely on a running MS SQL Server database. These are a little simpler and we can use `hspec-discover`, with a `SpecHook` to extract the connection string from an environment variable. - Henceforth, these are the MS SQL Server integration tests. - New CI jobs have been added for each of these. - There wasn't actually a job for the MS SQL Server integration tests. It's pretty amazing they still run well. - The "haskell-tests" CI job, which used to run the PostgreSQL integration tests, has been removed. - The makefiles and contributing guide have been updated to run these. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/6912 GitOrigin-RevId: 67bbe2941bba31793f63d04a9a693779d4463ee1
2022-11-17 15:55:05 +03:00
TEST_MSSQL_CONNECTION_STRING = Driver={ODBC Driver 18 for SQL Server};Server=localhost,65003;Uid=sa;Pwd=Password!;Encrypt=optional
TEST_POSTGRES_URL = postgres://hasura:hasura@localhost:65002/hasura
Split the Docker Compose files into pieces. With the vague idea that we can eventually avoid publishing ports at all, at least in CI, while still having the flexibility to publish ports locally. If we can get there, it should help with the issues we're seeing on CI, where ports are already allocated from previous runs and containers aren't properly cleaned up. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/6836 GitOrigin-RevId: 1d636c73ae889e45e80ad52042c56daa1b9d5838
2022-11-14 15:38:19 +03:00
.PHONY: build-backends
## build-backends: build Docker images for any backends that need them
build-backends:
server/api-tests: Add a Docker Compose file for the API tests. We were previously using the Docker Compose file in the root directory for manual testing _and_ the server API tests. This splits them so we can e.g. add Yugabyte for easy manual testing. In the future, this will also allow us to use ephemeral ports for API test databases, while keeping the fixed ports for manual testing. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7524 GitOrigin-RevId: 7244e296b0ed0ace9782b6f44f321933a9d9a49d
2023-01-16 19:42:45 +03:00
$(API_TESTS_DOCKER_COMPOSE) build
server: Get `make test-backends` working and somewhat speedy. * Fix `make start-sqlserver` so it can find `sqlcmd`. * Start the DC reference agent when testing all backends. * Start backends in parallel so it doesn't take so long to spin them up. This is achieved by splitting all `start-*` tasks into `spawn-*` and `wait-for-*`. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5176 GitOrigin-RevId: ea483a755daa3fa6a8701f9d3dd0f393bc56510f
2022-07-27 16:29:06 +03:00
Fun improvements to Makefiles, with the intent of re-using test-infrastructure.mk. I intend to use the Make targets around starting and stopping backend databases in order to wrap the Python integration tests in targets. To that end, I have: 1. Factored out test infrastructure targets into _test-infrastructure.mk_. 2. Actually run the functions from _util.sh_; previously we were just running a bash script with no explicit commands. _util.sh_ must be `source`d and then you invoke the relevant function. 3. Run `docker-compose` through Nix if possible. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5136 GitOrigin-RevId: d7a01958045a82199c969ec3f88387d7d76d254b
2022-07-22 13:56:03 +03:00
.PHONY: start-backends
Correct the names and references of various DC SQLite make targets. `spawn-dc-sqlite-agent` was incorrectly named, and the `start-dc-sqlite-agent` target was missing. In addition, we usually only make the `start-xyz` target public in `make help`, and so only that needs a comment. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5804 GitOrigin-RevId: 8064ce148d004ef73dbd8570ef30435423ede0a1
2022-09-08 10:47:30 +03:00
## start-backends: start all known backends in Docker and wait for them to be ready
Split the Docker Compose files into pieces. With the vague idea that we can eventually avoid publishing ports at all, at least in CI, while still having the flexibility to publish ports locally. If we can get there, it should help with the issues we're seeing on CI, where ports are already allocated from previous runs and containers aren't properly cleaned up. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/6836 GitOrigin-RevId: 1d636c73ae889e45e80ad52042c56daa1b9d5838
2022-11-14 15:38:19 +03:00
start-backends: build-backends
server/api-tests: Add a Docker Compose file for the API tests. We were previously using the Docker Compose file in the root directory for manual testing _and_ the server API tests. This splits them so we can e.g. add Yugabyte for easy manual testing. In the future, this will also allow us to use ephemeral ports for API test databases, while keeping the fixed ports for manual testing. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7524 GitOrigin-RevId: 7244e296b0ed0ace9782b6f44f321933a9d9a49d
2023-01-16 19:42:45 +03:00
$(API_TESTS_DOCKER_COMPOSE) up --detach --wait
Fun improvements to Makefiles, with the intent of re-using test-infrastructure.mk. I intend to use the Make targets around starting and stopping backend databases in order to wrap the Python integration tests in targets. To that end, I have: 1. Factored out test infrastructure targets into _test-infrastructure.mk_. 2. Actually run the functions from _util.sh_; previously we were just running a bash script with no explicit commands. _util.sh_ must be `source`d and then you invoke the relevant function. 3. Run `docker-compose` through Nix if possible. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5136 GitOrigin-RevId: d7a01958045a82199c969ec3f88387d7d76d254b
2022-07-22 13:56:03 +03:00
.PHONY: stop-everything
## stop-everything: tear down test databases
stop-everything:
server/api-tests: Add a Docker Compose file for the API tests. We were previously using the Docker Compose file in the root directory for manual testing _and_ the server API tests. This splits them so we can e.g. add Yugabyte for easy manual testing. In the future, this will also allow us to use ephemeral ports for API test databases, while keeping the fixed ports for manual testing. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7524 GitOrigin-RevId: 7244e296b0ed0ace9782b6f44f321933a9d9a49d
2023-01-16 19:42:45 +03:00
$(API_TESTS_DOCKER_COMPOSE) down --volumes
GDC Mysql integration tests PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7603 Co-authored-by: Daniel Chambers <1214352+daniel-chambers@users.noreply.github.com> GitOrigin-RevId: 651bc2fb59a46449e2a4325a4c7af57592e53845
2023-02-16 09:29:19 +03:00
$(API_PRO_TESTS_DOCKER_COMPOSE) down --volumes
server/api-tests: Add a Docker Compose file for the API tests. We were previously using the Docker Compose file in the root directory for manual testing _and_ the server API tests. This splits them so we can e.g. add Yugabyte for easy manual testing. In the future, this will also allow us to use ephemeral ports for API test databases, while keeping the fixed ports for manual testing. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/7524 GitOrigin-RevId: 7244e296b0ed0ace9782b6f44f321933a9d9a49d
2023-01-16 19:42:45 +03:00
$(PYTHON_TESTS_DOCKER_COMPOSE) down --volumes
chore(postgres-agent): introspect table names from database PR-URL: https://github.com/hasura/graphql-engine-mono/pull/9042 GitOrigin-RevId: de2412ee2511d4cd0b72a660a85ac26a3214d735
2023-05-04 16:10:23 +03:00
$(DC_POSTGRES_DOCKER_COMPOSE) down --volumes
Fun improvements to Makefiles, with the intent of re-using test-infrastructure.mk. I intend to use the Make targets around starting and stopping backend databases in order to wrap the Python integration tests in targets. To that end, I have: 1. Factored out test infrastructure targets into _test-infrastructure.mk_. 2. Actually run the functions from _util.sh_; previously we were just running a bash script with no explicit commands. _util.sh_ must be `source`d and then you invoke the relevant function. 3. Run `docker-compose` through Nix if possible. PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5136 GitOrigin-RevId: d7a01958045a82199c969ec3f88387d7d76d254b
2022-07-22 13:56:03 +03:00
.PHONY: remove-tix-file
remove-tix-file:
tests: add Postgres 14 and Postgres 15 pytests PR-URL: https://github.com/hasura/graphql-engine-mono/pull/5968 GitOrigin-RevId: 6569e58b89f014268152cfe7bf1f6c11233fbe49
2022-10-06 12:44:49 +03:00
@ find . -name '*.tix' -delete
Reference in New Issue Copy Permalink