graphql-engine/server/tests-py
2019-11-15 10:39:46 -06:00
..
pgdump add an api to dump postgres schema (close #1939) (#1967) 2019-04-30 14:04:08 +05:30
queries Merge pull request #3356 from jberryman/issue-3312-dev.sh-support-python-3.7 2019-11-15 10:39:46 -06:00
test_tests Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
webhook/insecure apply update permissions for upsert mutations (#628) 2018-12-15 21:40:29 +05:30
.gitignore run graphql tests on both http and websocket; add parallelism (close #1868) (#1921) 2019-04-08 12:52:38 +05:30
conftest.py add few x-forwarded- headers (close #2572) (#3347) 2019-11-13 14:25:11 -06:00
context.py In tests/dev.sh: upgrade ruamel to support python 3.7. Closes #3312 2019-11-14 18:53:33 -05:00
graphql_server.py add few x-forwarded- headers (close #2572) (#3347) 2019-11-13 14:25:11 -06:00
pytest.ini Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
README.md Add local development swiss army knife script scripts/dev.sh 2019-07-26 01:17:35 -04:00
requirements-top-level.txt In tests/dev.sh: upgrade ruamel to support python 3.7. Closes #3312 2019-11-14 18:53:33 -05:00
requirements.txt In tests/dev.sh: upgrade ruamel to support python 3.7. Closes #3312 2019-11-14 18:53:33 -05:00
super_classes.py fix validation of null values, closes #1981 (#2057) 2019-04-24 13:19:39 +05:30
test_allowlist_queries.py keep allowed queries in sync when collections are changed, fix #2221 (#2230) 2019-05-20 15:59:32 +05:30
test_apis_disabled.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_compat.py rename access-key to admin-secret (close #1347) (#1540) 2019-02-14 15:07:47 +05:30
test_compression.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_config_api.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_cookie_webhook.py read cookie while initialising websocket connection (fix #1660) (#1668) 2019-03-04 13:16:53 +05:30
test_cors.py add support for multiple domains in cors config (close #1436) (#1536) 2019-02-14 11:28:38 +05:30
test_events.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_graphql_introspection.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_graphql_mutations.py Fix result ordering in some incorrect tests 2019-11-05 15:15:25 -06:00
test_graphql_queries.py computed fields in export/import metadata, other fixes (#3211) 2019-11-07 20:09:48 +05:30
test_horizontal_scale.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_inconsistent_meta.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_jwt.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_logging.py server: Fix flaky logging test (#3081) 2019-10-10 08:40:19 -05:00
test_pg_dump.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_schema_stitching.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_subscriptions.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_tests.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_v1_queries.py add read_only to run_sql metadata api (#3191) 2019-11-14 18:20:18 -06:00
test_v1alpha1_endpoint.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_validation.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_version.py Add local development swiss army knife script scripts/dev.sh 2019-07-26 01:17:35 -04:00
test_webhook_insecure.py Tests for server with access control, and some more tests (#710) 2018-10-28 23:57:49 +05:30
test_websocket_init_cookie.py read cookie while initialising websocket connection (fix #1660) (#1668) 2019-03-04 13:16:53 +05:30
validate.py In tests/dev.sh: upgrade ruamel to support python 3.7. Closes #3312 2019-11-14 18:53:33 -05:00
webhook.py allow authentication webhook with POST (close #1138) (#1147) 2018-12-03 16:49:08 +05:30
webserver.py run graphql tests on both http and websocket; add parallelism (close #1868) (#1921) 2019-04-08 12:52:38 +05:30

Running tests

The easiest way to run the test suite is to do:

$ scripts/dev.sh test

This should install python dependencies if required, and run in isolation.

Tests Structure

  • Tests are grouped as test classes in test modules (names starting with test_)

  • The configuration files (if needed) for the tests in a class are usually kept in one folder.

    • The folder name is usually either the dir variable or the dir() function
  • Some tests (like in test_graphql_queries.py) requires a setup and teardown per class.

    • Here we are extending the DefaultTestSelectQueries class.
    • This class defines a fixture which will run the configurations in setup.yaml and teardown.yaml once per class
    • Extending test class should define a function name dir(), which returns the configuration folder
  • For mutation tests (like in test_graphql_mutations.py)

    • We need a schema_setup and schema_teardown per class
    • And values_setup and values_teardown per test
    • Doing schema setup and teardown per test is expensive.
    • We are extending the DefaultTestMutations class for this.
    • This class defines a fixture which will run the configuration in setup.yaml and teardown.yaml once per class.
    • Another fixture defined in this class runs the configuration in values_setup.yaml and values_teardown.yaml once per class.