Commit Graph

474 Commits

Author SHA1 Message Date
Chris Marslender
a983c4a90b
Upload CLI RPMS to s3, create checksums, etc (#11316) 2022-04-26 13:27:14 -05:00
Kyle Altendorf
f976c07c54
also m1 and arm64 for wheel checks (#11277)
* also m1 and arm64 for wheel checks

* account for self-hosted and pre-setup-python of m1 and arm64 runners

* &&

* python3

* report python version

* use docker on arm64 to get multiple python versions

* flush

* report more system information

* except pycryptodome for now

* more variables, simpler logic

* corrections

* switch to [macos, arm64]

* add python version to job name

* separate os and arch matrix axes

* reorder matrixing

* drop workflow name from job name

* oops

* skip python setup in docker cases

* drop the containers

* Update check_dependency_artifacts.py
2022-04-26 10:48:04 -07:00
Chris Marslender
fd7c3c6363
Update names of installer workflows so they get grouped together in the workflow listing (#11310) 2022-04-26 09:01:21 -06:00
Chris Marslender
d750c901b9
Fix targeting for arm64 to not land on native arm64 mac runners (#11309) 2022-04-25 16:50:38 -05:00
Kyle Altendorf
e584513c70
Add Linux Mint to test matrix (#11295)
* add Linux Mint to test matrix

* : -> / for linux mint dockers

* Prepare Linux Mint

* stop testing linux mint 21 since it reports 20.3

* names, comment, and add 19.2

* mint

* manually install requests

* trailing whitespace
2022-04-25 09:20:08 -07:00
Kyle Altendorf
8460a35466
Debian bookworm now uses 3.10, update the comment (#11278) 2022-04-23 20:11:09 -07:00
Kyle Altendorf
3c48224551
check dependency artifacts (#11243)
* check dependency artifacts

* remove commented out code

* find root path relative to script

* fixup stringy pathy mixup

* Update check_dependency_artifacts.py
2022-04-21 17:00:28 -07:00
Kyle Altendorf
aaf3fbc160
generate file lists for workflows instead of wildcard patterns (#11117) 2022-04-21 16:58:07 -07:00
Chris Marslender
527b30e917
Add cli only rpm (#11236)
* Add cli only rpm

* Ensure rvm (fpm) is loaded before running fpm

* Use full path to fpm, since GHA seems to mess up the PATH in the container

* Add back source and add use ruby-3

* Call rpm script with bash, to see if the rvm script works

* Add --depends for libcrypt.so.1
2022-04-20 21:39:51 -07:00
dustinface
25ab0c90cb
github: Fix plot_sync workflows after #10940 merge (#11241) 2022-04-20 15:27:59 -07:00
Gene Hoffman
797a2fb5fe
Remove 3.9.11 for Windows Installer (#11226)
And replace with just 3.9.x
2022-04-20 11:44:52 -07:00
dependabot[bot]
efbac6a05f
Bump actions/upload-artifact from 2 to 3 (#11144)
* Bump actions/upload-artifact from 2 to 3

Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 2 to 3.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](https://github.com/actions/upload-artifact/compare/v2...v3)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* Also update runner_templates

* Mark the github workspace as safe (#11159)

* Mark the github workspace as safe

* Move the git config step after git is installed in the test containers

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Gene Hoffman <hoffmang@hoffmang.com>
Co-authored-by: Chris Marslender <chrismarslender@gmail.com>
2022-04-20 11:40:51 -07:00
Kyle Altendorf
5b044ea497
locate pyinstaller in dev deps rather than build scripts (#11118) 2022-04-20 11:16:53 -07:00
Kyle Altendorf
93da3b727b
Up Windows installer build timeout to 50 minutes (#11107)
Recent runs are mostly low 30s but some are close to 40 and one just timed out.
2022-04-20 11:14:20 -07:00
Kyle Altendorf
b9c9727b75
--module pytest (#10940) 2022-04-20 11:11:08 -07:00
Chris Marslender
7a123afddb
Fix install.sh test for bookworm (#11227) 2022-04-19 15:43:06 -07:00
Chris Marslender
337dbd4e5c
Revert "Revert "Pin mac intel installer to 10.15 (#11209)" (#11210)" (#11211)
This reverts commit d3e73a75ab.
2022-04-19 12:53:59 -06:00
Chris Marslender
d3e73a75ab
Revert "Pin mac intel installer to 10.15 (#11209)" (#11210)
This reverts commit 93a61eece1.
2022-04-18 15:42:09 -06:00
Chris Marslender
93a61eece1
Pin mac intel installer to 10.15 (#11209) 2022-04-18 15:34:27 -06:00
Chris Marslender
7567b4ea9c
Fix filename of latest intel dev installer (#11203) 2022-04-18 10:18:59 -05:00
Chris Marslender
2fbe062e78
Build cli only version of debs (#11166)
* Build cli only version of debs

* Export the vars needed by j2

* Fix paths

* Add symlink to chia in /usr/local/bin/

* Upload the cli only debs to s3

* Add init.py

* Ensure SHA is on the dev build for amd64
2022-04-14 19:32:26 -05:00
Chris Marslender
3ea3a4dc0c
Use get latest release endpoint for plotters, so that we ignore any pre-releases that could be returned by listReleases (#11165) 2022-04-13 18:06:50 -05:00
Chris Marslender
b3a9459fea
Mark the github workspace as safe (#11159)
* Mark the github workspace as safe

* Move the git config step after git is installed in the test containers
2022-04-13 09:35:42 -06:00
Kyle Altendorf
2d4045b9d2
only check the version once in installer build workflows (#11099) 2022-04-08 13:49:21 -07:00
Kyle Altendorf
e6f60c572e
git -C and consistent activation in installer builds (#11098) 2022-04-08 09:59:59 -07:00
Kyle Altendorf
13512be2b2
consistently name installer github actions artifact zips (#11096) 2022-04-08 09:59:36 -07:00
Kyle Altendorf
415236bf67
can we get by without dead snakes? (#11070)
* can we get by without dead snakes?

* Update install-timelord.sh

* Revert "Update install-timelord.sh"

This reverts commit cba3250b09.

* do not install python dev package for timelords build in ci

it is already there...

* more quotes for sh
2022-04-08 09:58:46 -07:00
Mariano Sorgente
2f9e718073
Ms.fast test blockchain (#11051)
* more work on test blockchain

* Optimize test_blockchain.py

* Fix weight proof bug

* Rename variable

* first rc_sub_slot hash bug

* New plots

* try with a new ID

* Run without cache

* Address test blocks and plots preparation.

* Update constant in test_compact_protocol().

* Update this constant too.

* Revert accidental altering of the gui submodule in ae7e3295f280a591e76c4dffdea75fb74ea5de6f.

* Fix benchmark test

* Revert mozilla-ca change

* Rebase on main

Co-authored-by: almog <almogdepaz@gmail.com>
Co-authored-by: Amine Khaldi <amine.khaldi@reactos.org>
2022-04-08 09:57:59 -07:00
Kyle Altendorf
02a880fbac
rebuild workflows (#11092) 2022-04-07 20:43:27 -07:00
Chris Marslender
c7a89fc425
Add wallentx as additional assignee on mozilla CA update PRs (#11089) 2022-04-07 19:43:14 -05:00
dustinface
ded9f68583
chia|tests|github: Implement, integrate and test plot sync protocol (#9695)
* protocols|server: Define new harvester plot refreshing protocol messages

* protocols: Bump `protocol_version` to `0.0.34`

* tests: Introduce `setup_farmer_multi_harvester`

Allows to run a test setup with 1 farmer and mutiple harvesters.

* plotting: Add an initial plot loading indication to `PlotManager`

* plotting|tests: Don't add removed duplicates to `total_result.removed`

`PlotRefreshResult.removed` should only contain plots that were loaded
properly before they were removed. It shouldn't contain e.g. removed
duplicates or invalid plots since those are synced in an extra sync step
and not as diff but as whole list every time.

* harvester: Reset `PlotManager` on shutdown

* plot_sync: Implement plot sync protocol

* farmer|harvester: Integrate and enable plot sync

* tests: Implement tests for the plot sync protocol

* farmer|tests: Drop obsolete harvester caching code

* setup: Add `chia.plot_sync` to packages

* plot_sync: Type hints in `DeltaType`

* plot_sync: Drop parameters in `super()` calls

* plot_sync: Introduce `send_response` helper in `Receiver._process`

* plot_sync: Add some parentheses

Co-authored-by: Kyle Altendorf <sda@fstab.net>

* plot_sync: Additional hint for a `Receiver.process_path_list` parameter

* plot_sync: Force named parameters in `Receiver.process_path_list`

* test: Fix fixtures after rebase

* tests: Fix sorting after rebase

* tests: Return type hint for `plot_sync_setup`

* tests: Rename `WSChiaConnection` and move it in the outer scope

* tests|plot_sync: More type hints

* tests: Rework some delta tests

* tests: Drop a `range` and iterate over the list directly

* tests: Use the proper flags to overwrite

* test: More missing duplicates tests

* tests: Drop `ExpectedResult.reset`

* tests: Reduce some asserts

* tests: Add messages to some `assert False` statements

* tests: Introduce `ErrorSimulation` enum in `test_sync_simulated.py`

* tests: Use `secrects` instead of `Crypto.Random`

* Fixes after rebase

* Import from `typing_extensions` to support python 3.7

* Drop task name to support python 3.7

* Introduce `Sender.syncing`, `Sender.connected` and a log about the task

* Add `tests/plot_sync/config.py`

* Align the multi harvester fixture with what we do in other places

* Update the workflows

Co-authored-by: Kyle Altendorf <sda@fstab.net>
2022-04-07 17:10:44 -07:00
Kyle Altendorf
c0d346d428
Remove dead snakes usage from benchmark tests (#11053) 2022-04-07 09:18:15 -07:00
dependabot[bot]
42245d74eb
Bump github/super-linter from 4.9.1 to 4.9.2 (#11067)
Bumps [github/super-linter](https://github.com/github/super-linter) from 4.9.1 to 4.9.2.
- [Release notes](https://github.com/github/super-linter/releases)
- [Changelog](https://github.com/github/super-linter/blob/main/docs/release-process.md)
- [Commits](https://github.com/github/super-linter/compare/v4.9.1...v4.9.2)

---
updated-dependencies:
- dependency-name: github/super-linter
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-04-07 09:17:53 -07:00
Amine Khaldi
6026d734cf
Significantly speedup preparing test blocks and plots by opting for a release download instead of a shallow git clone, and also by putting a caching layer on top of that. (#11065) 2022-04-06 20:15:10 -07:00
Kyle Altendorf
45e4c7c156
Checkout test blocks and plots for benchmarks workflow (#11068) 2022-04-05 17:16:38 -05:00
William Allen
6ed61bfbe5
Adding clean-workspace step to benchmarks (#11063) 2022-04-05 15:28:33 -05:00
Amine Khaldi
a2fa8dda01
Prepare test blocks and plots only for tests that need them. This saves us a couple more hours of CI running time. (#10975) 2022-04-05 10:34:57 -07:00
dustinface
4a4b14b78b
github: Drop unused BUILD_VDF_CLIENT variables (#11050)
From my understanding this is only used by `chiavdf` source builds which 
happen only if `install-timelord.sh` gets called but it doesn't in the 
addressed cases.
2022-04-04 18:43:51 -07:00
Adam Kelly
22edd73331
Force apt to install the things we asked it to (#11047)
* Force apt to install the things we asked it to

* Update .github/workflows/benchmarks.yml

Co-authored-by: dustinface <35775977+xdustinface@users.noreply.github.com>

Co-authored-by: dustinface <35775977+xdustinface@users.noreply.github.com>
2022-04-04 17:43:31 -07:00
Gene Hoffman
8cbf96d73c
Non Hobo patch the winstaller for CVE-2022-0778 (#10995) 2022-04-01 16:31:00 -07:00
dependabot[bot]
fc1d52de6a
Bump peter-evans/create-pull-request from 3 to 4 (#10950)
Bumps [peter-evans/create-pull-request](https://github.com/peter-evans/create-pull-request) from 3 to 4.
- [Release notes](https://github.com/peter-evans/create-pull-request/releases)
- [Commits](https://github.com/peter-evans/create-pull-request/compare/v3...v4)

---
updated-dependencies:
- dependency-name: peter-evans/create-pull-request
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-31 23:04:48 -07:00
Arvid Norberg
a571c78899
limit test output on CI by dropping -s and -v. Also, only print the 10 slowest tests, instead of all (#10959) 2022-03-31 23:01:50 -07:00
Arvid Norberg
bf15087c79
run more tests in parallel on CI (#10960)
* run more tests in parallel on CI

* fix test_farmer_get_harvesters to wait for plots to be loaded before asking about them
2022-03-31 08:23:59 -07:00
Mariano Sorgente
02bf8489d2
Ms.parallel pool t (#10966)
* Try parallel pool tests

* Also change workflow files

* Run less combinations

* Todo for bad test

* Try lower n
2022-03-31 08:23:34 -07:00
dependabot[bot]
817ebe7d6d
Bump actions/cache from 2.1.6 to 3 (#10846)
* Bump actions/cache from 2.1.6 to 3

Bumps [actions/cache](https://github.com/actions/cache) from 2.1.6 to 3.
- [Release notes](https://github.com/actions/cache/releases)
- [Commits](https://github.com/actions/cache/compare/v2.1.6...v3)

---
updated-dependencies:
- dependency-name: actions/cache
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update actions in templates also

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Gene Hoffman <hoffmang@hoffmang.com>
2022-03-29 10:35:06 -07:00
dependabot[bot]
81c60993f6
Bump actions/setup-node from 2.4.1 to 3 (#10506)
Bumps [actions/setup-node](https://github.com/actions/setup-node) from 2.4.1 to 3.
- [Release notes](https://github.com/actions/setup-node/releases)
- [Commits](https://github.com/actions/setup-node/compare/v2.4.1...v3)

---
updated-dependencies:
- dependency-name: actions/setup-node
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-29 10:34:48 -07:00
dependabot[bot]
9a0d4775ae
Bump actions/github-script from 4 to 6 (#10246)
* Bump actions/github-script from 4 to 6

Bumps [actions/github-script](https://github.com/actions/github-script) from 4 to 6.
- [Release notes](https://github.com/actions/github-script/releases)
- [Commits](https://github.com/actions/github-script/compare/v4...v6)

---
updated-dependencies:
- dependency-name: actions/github-script
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update to github.rest.* for calls to API for compat w/ github-script@v5+

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Marslender <chrismarslender@gmail.com>
2022-03-29 10:34:12 -07:00
Kyle Altendorf
fb68bebfc3
fixup workflow template merge env duplication (#10925) 2022-03-28 19:50:42 -07:00
Kyle Altendorf
36bee1b8ca
run tests in CI via coverage (#9704)
* Add coverage (without collection)

* Separate test_block_compression() to avoid coverage-related hangs

* Revert "Separate test_block_compression() to avoid coverage-related hangs"

This reverts commit ebad3d0017.

* multiprocessing.set_start_method("spawn")

* multiprocessing.set_start_method() in conftest.py

* hand hold cc wallet tests

* lint

* spawn for running chia as well

* handle already set start method case

* a bit more timeout for test_multiple_writers

* more timeout for test_writer_lock_blocked_by_readers

* 45 minute tieout for tests/pools/

* 45 minute tieout for tests/pools/

* some more hand holding sleeps

* report coverage in each workflow

only really useful to make sure it is capturing something

* oops

* complete the job name and the JOB_NAME

* better coverage result file names

* reset worker process titles

* rebuild workflows

* rebuild workflows

* black

* black

* rebuild workflows

* push timeouts

* actually include the updated workflows...

* push more workflow timeouts

* parallel=True

* rebuild workflows
2022-03-28 13:22:23 -07:00
Kyle Altendorf
219e815fc4
set CHIA_ROOT in tests instead of symlinking (#10682)
* attempt to checkout test-cache directly to desired location

* rebuild workflows

* maybe we can use CHIA_ROOT

* use CHIA_ROOT to find blocks and plots for tests

* oops

* more informational printing

* oops

* --capture no for debugging

* flake8

* import os

* undo some unrelated changes now covered elsewhere

* undo some debug changes

* rebuild workflows
2022-03-28 13:15:24 -07:00