chia-blockchain/tests
Kyle Altendorf a20ee08fce
only compile clvm for developers (#13478)
* only compile clvm for developers

* retain existing behavior for backwards compatibility

* tests/check_clvm.py becomes tools/manage_clvm.py check (and add build subcommand)

* trigger recompilation in pytest runs
2022-09-27 11:21:54 -05:00
..
blockchain remove soft fork logic at height 2300000 (#12563) 2022-08-01 17:32:53 -05:00
clvm Add .clvm.hex pre-commit check (#12050) 2022-09-12 16:08:55 -05:00
core make DBWrapper2 handle more connection setup (#13510) 2022-09-26 11:17:20 -05:00
db make DBWrapper2 handle more connection setup (#13510) 2022-09-26 11:17:20 -05:00
farmer_harvester server|tests: Delay the harvester -> farmer connection in some tests (#12862) 2022-08-10 04:57:34 -05:00
generator Implement generator_for_single_coin() in python instead of clvm and apply quex' optimization to only computing the puzzle hash if the parent and amount matches (#13237) 2022-08-30 16:30:34 -05:00
plot_sync RpcApiProtocol and RpcServiceProtocol (#11522) 2022-09-21 22:49:01 -05:00
plotting setup|plotting: chiapos==1.0.11 + drop invalid cache entries (#13502) 2022-09-23 17:30:30 -05:00
pools pools: Make PoolWallet a dataclass (#13426) 2022-09-16 16:01:47 -05:00
simulation Merge commit '105f02993f943f758b8f3276b94c9d0781006877' into checkpoint/long_lived_atari_from_main_105f02993f943f758b8f3276b94c9d0781006877 2022-08-23 13:59:19 +01:00
tools No network type (#12783) 2022-08-05 13:53:02 -05:00
util Confirm equality of client and server RPC routes (#11765) 2022-09-26 11:18:46 -05:00
wallet Drop redundant RPC server instances in DataLayer related RPC tests (#13518) 2022-09-26 11:16:25 -05:00
weight_proof Move simulator test requirements over to new module (#12521) 2022-07-25 14:07:38 -05:00
__init__.py Added tests, improved serialization 2019-08-05 14:38:16 +09:00
build-init-files.py Merge commit with main (9ff3fc993f) (#11137) 2022-04-14 12:02:42 -07:00
build-job-matrix.py configurable ci test job duplicates (#12956) 2022-08-17 17:52:27 -05:00
check_pytest_monitor_output.py add stress tests with malicious generators (#8570) 2021-09-29 11:41:49 -07:00
check_sql_statements.py Merge commit with main (9ff3fc993f) (#11137) 2022-04-14 12:02:42 -07:00
chia-start-sim Rename src to chia. 2021-04-04 21:41:39 -07:00
conftest.py Drop redundant RPC server instances in DataLayer related RPC tests (#13518) 2022-09-26 11:16:25 -05:00
connection_utils.py Move simulator test requirements over to new module (#12521) 2022-07-25 14:07:38 -05:00
README.md Improve style consistency in root directory docs files (#4493) 2021-05-12 13:12:30 -07:00
setup_nodes.py Drop redundant RPC server instances in DataLayer related RPC tests (#13518) 2022-09-26 11:16:25 -05:00
setup_services.py Merge commit '8bc1cc41a5f532765c09c975c515d649ee89ac0e' into checkpoint/main_from_release_1.6.0_8bc1cc41a5f532765c09c975c515d649ee89ac0e 2022-09-02 18:28:57 +01:00
testconfig.py reusable workflow for a single test workflow (#11722) 2022-06-03 16:56:52 -05:00

Test CI Job generation

The CI jobs for these tests are managed by build-workflows.py.

If you add a test file, or move one to another directory, please run build-workflows.py. Tests are recognized by the file glob test_*.py. Changing the contents of a file does not require running build-workflows.py.

We currently use github actions. Default runners have two vcpus. The workflows are located in ../.github/workflows/.

The inputs to build-workflows.py are the templates in runner-templates, the file testconfig.py in this directory, and the optional config.py files in some test subdirectories. Files in the template directory ending in include.yml are included in jobs based on the per-directory settings.

The generated workflows are output to ../.github/workflows/.

Each subdirectory below the directories root_test_dirs in testconfig.py becomes a job in the github workflow matrix. If your jobs run too long, simply move some tests into new subdirectories and run build-workflows.py. A workflow built from a parent directory does not include the tests in its subdirectories. The subdirectory jobs do not include the tests from their parents.

testconfig.py

In the top tests directory, testconfig.py contains the application settings and the per-directory default settings.

config.py

Each directory has an optional config.py file, which can override the per-directory default settings.

Per directory settings defaults:

parallel = False
checkout_blocks_and_plots = True
install_timelord = True
job_timeout = 30

Parallel test execution

If you are certain that all the tests in a directory can run in parallel, set parallel = True in config.py inside that directory.

Optional job stages

Set checkout_blocks_and_plots to False to omit checking out the test-cache repo.

Set install_timelord to False to omit the step of installing a Time Lord for your directory's job.

Job Timeout

Set job_timeout to the number of minutes you want the CI system to wait before it kills your job. Add two or three minutes to allow for job setup.