chia-blockchain/tests
Chris Marslender cbbdb6510a
Adding additional data to RPCs for metrics (#9945)
* Add "metrics" as an additional destination for get_blockchain_state changes

* Add compact/uncompact blocks to get_blockchain_state

* Add total mempool cost to blockchain state

* Add hint count to blockchain state

* Add info about max cost, block_cost, and block_fees

* Add mempool min fee to blockchain state

* Add dict for mempool fee estimates

* dont start key with number

* Move max block cost to blockchain state

* Add generic exception logging util

* Catch/log any exceptions in counting hints

* Fix inconsistent key

* Assert row is not none

* Move block count metrics to a new endpoint

* report on block instead of unfinished_block for metrics

* Mark the block event with bool for if transaction block or not

* Add some basic tests for counting hints

* Add some basic tests on counting compact/uncompact blocks

* Fix lint

* Add k-size

* Add timestamp

* Add header_hash + height
2022-01-27 18:42:49 -08:00
..
blockchain Move BLS validation to other processes during sync (#9746) 2022-01-20 14:50:41 -08:00
clvm Add remaining offer code to main (#9886) 2022-01-20 14:49:31 -08:00
core Adding additional data to RPCs for metrics (#9945) 2022-01-27 18:42:49 -08:00
farmer_harvester farmer|server|tests: Fix for farmer service crash if the keychain is empty (#9515) 2021-12-14 18:03:59 -08:00
generator simplify cost calculation. It's already computed in rust (#9931) 2022-01-26 09:07:22 -08:00
plotting tests: Fix and improve plot manager caching tests (#9785) 2022-01-13 17:41:15 -08:00
pools Set pools CI test timeout to 45 minutes (#9817) 2022-01-15 16:31:54 -08:00
runner_templates Use native concurrency settings to cancel duplicate in progress jobs rather than waiting for the job to start to cancel (#9963) 2022-01-26 11:20:31 -06:00
simulation extend more tests to run with both v1 and v2 blockchain database schema (#9656) 2022-01-10 20:55:40 -08:00
tools simplify run_block() (#9962) 2022-01-26 16:44:30 -08:00
util revert allow-upgrades configuration option. It makes it significantly more complicated to do proper database migrations (#9768) 2022-01-13 14:53:27 -08:00
wallet move member function get_memos() out of SpendBundle and into a free-function living in the wallet code. It does not belong to the full node. Also rename it to indicate that it's expensive (and dangerous) to call (#9907) 2022-01-23 21:45:41 -08:00
weight_proof chia|tests|pre-commit: Add missing __init__.py files (#8758) 2021-12-16 18:52:46 -08:00
__init__.py Added tests, improved serialization 2019-08-05 14:38:16 +09:00
block_tools.py tests: Fix plot creation if exclude_final_dir is set (#9646) 2022-01-13 17:41:44 -08:00
build-init-files.py chia|tests|pre-commit: Add missing __init__.py files (#8758) 2021-12-16 18:52:46 -08:00
build-workflows.py chia|tests|pre-commit: Add missing __init__.py files (#8758) 2021-12-16 18:52:46 -08:00
check_pytest_monitor_output.py add stress tests with malicious generators (#8570) 2021-09-29 11:41:49 -07:00
chia-start-sim Rename src to chia. 2021-04-04 21:41:39 -07:00
conftest.py extend more tests to run with both v1 and v2 blockchain database schema (#9656) 2022-01-10 20:55:40 -08:00
connection_utils.py Fullnode related changes from wallet protocol and unharded derivation (#8522) 2021-09-18 10:27:34 -07:00
pytest.ini WARNING py.test 2021-02-07 20:13:01 +09:00
README.md Improve style consistency in root directory docs files (#4493) 2021-05-12 13:12:30 -07:00
setup_nodes.py Merge standalone wallet into main (#9793) 2022-01-13 12:08:32 -08:00
testconfig.py tests|github|pre-commit: Improve build-workflows.py and make it a pre-commit hook (#8728) 2021-11-09 10:57:40 -08:00
time_out_assert.py Timed assertion output simplification (#9290) 2021-11-19 11:14:18 -08:00
wallet_tools.py Make the sized bytes types hint compatible (#9369) 2021-12-02 09:43:39 -08:00

Test CI Job generation

The CI jobs for these tests are managed by build-workflows.py.

If you add a test file, or move one to another directory, please run build-workflows.py. Tests are recognized by the file glob test_*.py. Changing the contents of a file does not require running build-workflows.py.

We currently use github actions. Default runners have two vcpus. The workflows are located in ../.github/workflows/.

The inputs to build-workflows.py are the templates in runner-templates, the file testconfig.py in this directory, and the optional config.py files in some test subdirectories. Files in the template directory ending in include.yml are included in jobs based on the per-directory settings.

The generated workflows are output to ../.github/workflows/.

Each subdirectory below the directories root_test_dirs in testconfig.py becomes a job in the github workflow matrix. If your jobs run too long, simply move some tests into new subdirectories and run build-workflows.py. A workflow built from a parent directory does not include the tests in its subdirectories. The subdirectory jobs do not include the tests from their parents.

testconfig.py

In the top tests directory, testconfig.py contains the application settings and the per-directory default settings.

config.py

Each directory has an optional config.py file, which can override the per-directory default settings.

Per directory settings defaults:

parallel = False
checkout_blocks_and_plots = True
install_timelord = True
job_timeout = 30

Parallel test execution

If you are certain that all the tests in a directory can run in parallel, set parallel = True in config.py inside that directory.

Optional job stages

Set checkout_blocks_and_plots to False to omit checking out the test-cache repo.

Set install_timelord to False to omit the step of installing a Time Lord for your directory's job.

Job Timeout

Set job_timeout to the number of minutes you want the CI system to wait before it kills your job. Add two or three minutes to allow for job setup.