chia-blockchain/tests
Arvid Norberg 952c2d33a5
extend tests being parametrised by soft-fork (#15977)
* Make more tests parameterized by conftest.Mode (used for testing forks)

* limit test cases to save CI time

* bump timeouts

* run cat_wallet tests in parallel

* mypy type annotation fix in test_daemon.py

* Bump some wait_for_wallets_synced timeouts.

* remove unused test fixture

* address review comments

* bump datalayer timeout

* disable test_dusted_wallet() test

---------

Co-authored-by: Amine Khaldi <amine.khaldi@reactos.org>
2023-09-08 00:22:09 -05:00
..
blockchain extend tests being parametrised by soft-fork (#15977) 2023-09-08 00:22:09 -05:00
clvm various typing fixes (#15899) 2023-08-17 19:10:40 -05:00
cmds DataLayer fingerprint control (#16132) 2023-08-30 13:27:01 -05:00
core extend tests being parametrised by soft-fork (#15977) 2023-09-08 00:22:09 -05:00
db remove leading newlines from indented code blocks (#14653) 2023-02-23 21:53:48 -06:00
farmer_harvester Farmer now returns missing signage points (#15765) 2023-07-18 21:04:03 -05:00
fee_estimation fix checking of matrix.configuration.checkout_blocks_and_plots (#15454) 2023-06-29 20:48:50 -05:00
generator Parallel CI (#16071) 2023-08-17 12:16:26 -05:00
plot_sync fix flake8 warnings (#15897) 2023-07-31 09:46:49 -05:00
plotting @pytest.mark.limit_consensus_modes (#16148) 2023-08-28 16:59:48 -05:00
pools extend tests being parametrised by soft-fork (#15977) 2023-09-08 00:22:09 -05:00
simulation @pytest.mark.limit_consensus_modes (#16148) 2023-08-28 16:59:48 -05:00
timelord Timelord peak change (#15856) 2023-09-01 13:13:22 -05:00
tools Typecheck tests/tools/test_full_sync.py (#14947) 2023-05-23 19:53:20 -05:00
util various typing fixes (#15899) 2023-08-17 19:10:40 -05:00
wallet extend tests being parametrised by soft-fork (#15977) 2023-09-08 00:22:09 -05:00
weight_proof tests: Fix a BlockCache instance in test_weight_proof_extend_new_ses (#16217) 2023-09-05 08:47:11 -05:00
__init__.py Added tests, improved serialization 2019-08-05 14:38:16 +09:00
build-init-files.py improve ignore handling in __init__.py creation script (#15093) 2023-04-24 12:52:51 -06:00
build-job-matrix.py increase windows pytest threads to 3 (#16139) 2023-08-28 18:03:52 -05:00
check_pytest_monitor_output.py configure isort to add the future annotations import (#13327) 2022-09-30 03:40:22 -05:00
check_sql_statements.py Make sql pre-commit check work when pre-commit hooks are in non-standard locations (#14955) 2023-03-31 15:42:17 -05:00
chia-start-sim Rename src to chia. 2021-04-04 21:41:39 -07:00
conftest.py extend tests being parametrised by soft-fork (#15977) 2023-09-08 00:22:09 -05:00
connection_utils.py Add support for multi node farmers (#15444) 2023-07-28 14:48:32 -05:00
README.md Improve style consistency in root directory docs files (#4493) 2021-05-12 13:12:30 -07:00
testconfig.py Parallel CI (#16071) 2023-08-17 12:16:26 -05:00

Test CI Job generation

The CI jobs for these tests are managed by build-workflows.py.

If you add a test file, or move one to another directory, please run build-workflows.py. Tests are recognized by the file glob test_*.py. Changing the contents of a file does not require running build-workflows.py.

We currently use github actions. Default runners have two vcpus. The workflows are located in ../.github/workflows/.

The inputs to build-workflows.py are the templates in runner-templates, the file testconfig.py in this directory, and the optional config.py files in some test subdirectories. Files in the template directory ending in include.yml are included in jobs based on the per-directory settings.

The generated workflows are output to ../.github/workflows/.

Each subdirectory below the directories root_test_dirs in testconfig.py becomes a job in the github workflow matrix. If your jobs run too long, simply move some tests into new subdirectories and run build-workflows.py. A workflow built from a parent directory does not include the tests in its subdirectories. The subdirectory jobs do not include the tests from their parents.

testconfig.py

In the top tests directory, testconfig.py contains the application settings and the per-directory default settings.

config.py

Each directory has an optional config.py file, which can override the per-directory default settings.

Per directory settings defaults:

parallel = False
checkout_blocks_and_plots = True
install_timelord = True
job_timeout = 30

Parallel test execution

If you are certain that all the tests in a directory can run in parallel, set parallel = True in config.py inside that directory.

Optional job stages

Set checkout_blocks_and_plots to False to omit checking out the test-cache repo.

Set install_timelord to False to omit the step of installing a Time Lord for your directory's job.

Job Timeout

Set job_timeout to the number of minutes you want the CI system to wait before it kills your job. Add two or three minutes to allow for job setup.