graphql-engine/server
nizar-m a40bf10b9f run graphql tests on both http and websocket; add parallelism (close #1868) (#1921)
Examples 
1)  `
pytest --hge-urls "http://127.0.0.1:8080" --pg-urls "postgresql://admin@127.0.0.1:5432/hge_tests" -vv
`
2)  `pytest --hge-urls "http://127.0.0.1:8080"   "http://127.0.0.1:8081" --pg-urls "postgresql://admin@127.0.0.1:5432/hge_tests"  "postgresql://admin@127.0.0.1:5432/hge_tests2" -vv
`
### Solution and Design
<!-- How is this issue solved/fixed? What is the design? -->
<!-- It's better if we elaborate -->
#### Reducing execution time of tests
- The Schema setup and teardown, which were earlier done per test method, usually takes around 1 sec. 
- For mutations, the model has now been changed to only do schema setup and teardown once per test class.
-  A data setup and teardown will be done once per test instead (usually takes ~10ms).
- For the test class to get this behaviour, one can can extend the class `DefaultTestMutations`. 
    - The function  `dir()` should be define which returns the location of the configuration folder.
    - Inside the configuration folder, there should be 
        - Files `<conf_dir>/schema_setup.yaml` and `<conf_dir>/schema_teardown.yaml`, which has the metadata query executed during schema setup and teardown respectively
        - Files named `<conf_dir>/values_setup.yaml` and `<conf_dir>/values_teardown.yaml`. These files are executed to setup and remove data from the tables respectively. 

#### Running Graphql queries on both http and websockets
- Each GraphQL query/mutation is run on the both HTTP and websocket protocols
- Pytests test parameterisation is used to achieve this
- The errors over websockets are slightly different from that on HTTP
   - The code takes care of converting the errors in HTTP to errors in websockets

#### Parallel executation of tests.
- The plugin pytest-xdist helps in running tests on parallel workers.
- We are using this plugin to group tests by file and run on different workers.
- Parallel test worker processes operate on separate postgres databases(and separate graphql-engines connected to these databases). Thus tests on one worker will not affect the tests on the other worker.
- With two workers, this decreases execution times by half, as the tests on event triggers usually takes a long time, but does not consume much CPU.
2019-04-08 12:52:38 +05:30
..
packaging bump haskell-docker-packager version (#1870) 2019-03-26 15:26:15 +05:30
src-exec fix input argument types for custom SQL functions (close #1952) (#1953) 2019-04-08 12:28:56 +05:30
src-lib fix update_event_trigger query not persisting the changes (#1950) 2019-04-05 17:50:46 +05:30
src-rsr fix input argument types for custom SQL functions (close #1952) (#1953) 2019-04-08 12:28:56 +05:30
test allow renaming tables, columns and relationships (close #79) (#1542) 2019-03-01 14:47:22 +05:30
tests-py run graphql tests on both http and websocket; add parallelism (close #1868) (#1921) 2019-04-08 12:52:38 +05:30
.dockerignore update packages (#251) 2018-08-08 13:10:13 +05:30
.gitignore adds basic support for remote schemas/schema stitching (#952) 2018-11-23 18:32:46 +05:30
.stylish-haskell.yaml refactor to remove warnings especially with orphan instances (#1163) 2018-12-13 12:56:15 +05:30
CONTRIBUTING.md run graphql tests on both http and websocket; add parallelism (close #1868) (#1921) 2019-04-08 12:52:38 +05:30
graphql-engine.cabal refactor graphql query execution logic (#1855) 2019-03-25 23:55:25 +05:30
Makefile bump haskell-docker-packager version (#1870) 2019-03-26 15:26:15 +05:30
Setup.hs move raven into graphql-engine repo 2018-06-28 00:32:00 +05:30
stack-nightly.yaml bump stackage to lts 13 and refer to hasura's pg-client-hs (#1747) 2019-03-14 20:25:33 +05:30
stack.yaml bump stackage to lts 13 and refer to hasura's pg-client-hs (#1747) 2019-03-14 20:25:33 +05:30