graphql-engine/server/tests-py
Vamshi Surabhi b84db36ebb
allow custom mutations through actions (#3042)
* basic doc for actions

* custom_types, sync and async actions

* switch to graphql-parser-hs on github

* update docs

* metadata import/export

* webhook calls are now supported

* relationships in sync actions

* initialise.sql is now in sync with the migration file

* fix metadata tests

* allow specifying arguments of actions

* fix blacklist check on check_build_worthiness job

* track custom_types and actions related tables

* handlers are now triggered on async actions

* default to pgjson unless a field is involved in relationships, for generating definition list

* use 'true' for action filter for non admin role

* fix create_action_permission sql query

* drop permissions when dropping an action

* add a hdb_role view (and relationships) to fetch all roles in the system

* rename 'webhook' key in action definition to 'handler'

* allow templating actions wehook URLs with env vars

* add 'update_action' /v1/query type

* allow forwarding client headers by setting `forward_client_headers` in action definition

* add 'headers' configuration in action definition

* handle webhook error response based on status codes

* support array relationships for custom types

* implement single row mutation, see https://github.com/hasura/graphql-engine/issues/3731

* single row mutation: rename 'pk_columns' -> 'columns' and no-op refactor

* use top level primary key inputs for delete_by_pk & account select permissions for single row mutations

* use only REST semantics to resolve the webhook response

* use 'pk_columns' instead of 'columns' for update_by_pk input

* add python basic tests for single row mutations

* add action context (name) in webhook payload

* Async action response is accessible for non admin roles only if
  the request session vars equals to action's

* clean nulls, empty arrays for actions, custom types in export metadata

* async action mutation returns only the UUID of the action

* unit tests for URL template parser

* Basic sync actions python tests

* fix output in async query & add async tests

* add admin secret header in async actions python test

* document async action architecture in Resolve/Action.hs file

* support actions returning array of objects

* tests for list type response actions

* update docs with actions and custom types metadata API reference

* update actions python tests as per #f8e1330

Co-authored-by: Tirumarai Selvan <tirumarai.selvan@gmail.com>
Co-authored-by: Aravind Shankar <face11301@gmail.com>
Co-authored-by: Rakesh Emmadi <12475069+rakeshkky@users.noreply.github.com>
2020-02-13 23:08:23 +05:30
..
pgdump add an api to dump postgres schema (close #1939) (#1967) 2019-04-30 14:04:08 +05:30
queries allow custom mutations through actions (#3042) 2020-02-13 23:08:23 +05:30
test_tests Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
webhook/insecure apply update permissions for upsert mutations (#628) 2018-12-15 21:40:29 +05:30
.gitignore run graphql tests on both http and websocket; add parallelism (close #1868) (#1921) 2019-04-08 12:52:38 +05:30
conftest.py allow custom mutations through actions (#3042) 2020-02-13 23:08:23 +05:30
context.py allow custom mutations through actions (#3042) 2020-02-13 23:08:23 +05:30
graphql_server.py add few x-forwarded- headers (close #2572) (#3347) 2019-11-13 14:25:11 -06:00
jwk_server.py fix parsing JWK expiry time from headers on startup (fix #3655) (#3779) 2020-02-05 12:37:30 +05:30
pytest.ini run default tests in test_server_upgrade (#3718) 2020-02-13 14:44:02 +05:30
README.md Add local development swiss army knife script scripts/dev.sh 2019-07-26 01:17:35 -04:00
requirements-top-level.txt remove brotli from packaging and CI images (#3673) 2020-01-10 15:15:47 -06:00
requirements.txt remove brotli from packaging and CI images (#3673) 2020-01-10 15:15:47 -06:00
super_classes.py fix validation of null values, closes #1981 (#2057) 2019-04-24 13:19:39 +05:30
test_actions.py allow custom mutations through actions (#3042) 2020-02-13 23:08:23 +05:30
test_allowlist_queries.py run default tests in test_server_upgrade (#3718) 2020-02-13 14:44:02 +05:30
test_apis_disabled.py disable explain end-points when metadata API is disabled, fix #3717 (#3751) 2020-01-22 16:20:49 +05:30
test_compat.py remove usage of deprecated 'pytest.config' (#3434) 2019-11-29 10:44:26 +05:30
test_compression.py run default tests in test_server_upgrade (#3718) 2020-02-13 14:44:02 +05:30
test_config_api.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_cookie_webhook.py read cookie while initialising websocket connection (fix #1660) (#1668) 2019-03-04 13:16:53 +05:30
test_cors.py remove usage of deprecated 'pytest.config' (#3434) 2019-11-29 10:44:26 +05:30
test_events.py run default tests in test_server_upgrade (#3718) 2020-02-13 14:44:02 +05:30
test_graphql_introspection.py run default tests in test_server_upgrade (#3718) 2020-02-13 14:44:02 +05:30
test_graphql_mutations.py allow custom mutations through actions (#3042) 2020-02-13 23:08:23 +05:30
test_graphql_queries.py run default tests in test_server_upgrade (#3718) 2020-02-13 14:44:02 +05:30
test_horizontal_scale.py remove usage of deprecated 'pytest.config' (#3434) 2019-11-29 10:44:26 +05:30
test_inconsistent_meta.py Test result ordering, add --accept test mode to automatically accept changed test cases 2019-11-05 15:15:25 -06:00
test_jwk.py read cache control header to refresh JWK (fix #3301) (#3446) 2019-12-03 14:56:59 -06:00
test_jwt.py remove usage of deprecated 'pytest.config' (#3434) 2019-11-29 10:44:26 +05:30
test_logging.py remove usage of deprecated 'pytest.config' (#3434) 2019-11-29 10:44:26 +05:30
test_pg_dump.py run default tests in test_server_upgrade (#3718) 2020-02-13 14:44:02 +05:30
test_schema_stitching.py run default tests in test_server_upgrade (#3718) 2020-02-13 14:44:02 +05:30
test_subscriptions.py run default tests in test_server_upgrade (#3718) 2020-02-13 14:44:02 +05:30
test_tests.py run default tests in test_server_upgrade (#3718) 2020-02-13 14:44:02 +05:30
test_v1_queries.py run default tests in test_server_upgrade (#3718) 2020-02-13 14:44:02 +05:30
test_v1alpha1_endpoint.py run default tests in test_server_upgrade (#3718) 2020-02-13 14:44:02 +05:30
test_validation.py run default tests in test_server_upgrade (#3718) 2020-02-13 14:44:02 +05:30
test_version.py Add local development swiss army knife script scripts/dev.sh 2019-07-26 01:17:35 -04:00
test_webhook_insecure.py run default tests in test_server_upgrade (#3718) 2020-02-13 14:44:02 +05:30
test_websocket_init_cookie.py remove usage of deprecated 'pytest.config' (#3434) 2019-11-29 10:44:26 +05:30
validate.py run default tests in test_server_upgrade (#3718) 2020-02-13 14:44:02 +05:30
webhook.py allow authentication webhook with POST (close #1138) (#1147) 2018-12-03 16:49:08 +05:30
webserver.py run graphql tests on both http and websocket; add parallelism (close #1868) (#1921) 2019-04-08 12:52:38 +05:30

Running tests

The easiest way to run the test suite is to do:

$ scripts/dev.sh test

This should install python dependencies if required, and run in isolation.

Tests Structure

  • Tests are grouped as test classes in test modules (names starting with test_)

  • The configuration files (if needed) for the tests in a class are usually kept in one folder.

    • The folder name is usually either the dir variable or the dir() function
  • Some tests (like in test_graphql_queries.py) requires a setup and teardown per class.

    • Here we are extending the DefaultTestSelectQueries class.
    • This class defines a fixture which will run the configurations in setup.yaml and teardown.yaml once per class
    • Extending test class should define a function name dir(), which returns the configuration folder
  • For mutation tests (like in test_graphql_mutations.py)

    • We need a schema_setup and schema_teardown per class
    • And values_setup and values_teardown per test
    • Doing schema setup and teardown per test is expensive.
    • We are extending the DefaultTestMutations class for this.
    • This class defines a fixture which will run the configuration in setup.yaml and teardown.yaml once per class.
    • Another fixture defined in this class runs the configuration in values_setup.yaml and values_teardown.yaml once per class.