Commit Graph

607 Commits

Author SHA1 Message Date
William Allen
9e57773c50
Using gh-cli instead of curl for API calls to avoid rate-limiting (#14519)
* Using gh-cli, instead of curl to make API calls to GitHub to avoid rate-limiting

* Adding token to env for gh-cli steps
2023-02-08 19:44:32 -06:00
Kyle Altendorf
563af03244
Add diff-cover report (#14140)
* Add diff-cover report

* also dump diff-cover as markdown to github run summary

* add diff-cover html report
2023-02-04 14:10:48 -06:00
Kyle Altendorf
523a5d4cf5
Add support for Python 3.11 (#11407)
* Add Python 3.11 to CI

* 3.11 in the install scripts

* ${{ format('{0}.0-alpha - {0}.X', matrix.python) }}

* bump chiavdf and chiabip158 for releases with 3.11 wheels

* also bump blspy and clvm-tools-rs

* drop the extra .X for the python setup version

* chia_rs==0.1.13

* Update install.sh

* pyinstaller==5.5

* less mutable defaults

* memory_profiler

* assert sqlite3.threadsafety >= 1

* create tasks for stopping services

(cherry picked from commit 3384714f2e3e0bdc8c3d3741027e9e4fb69a6002)

* psutil==5.9.4

* drop memory_profiler transitive dep since it now supports 3.11

* drop redundant pre-release python getting incantation

* watchdog==2.2.0

* black for py311
2023-01-27 17:16:03 -06:00
William Allen
e3ec9484b0
Setting actions version to latest (#14361)
* Setting actions version to latest

* Fix decode-base64-into-file-action version

Cannot use normal versioning as https://github.com/kitek/decode-base64-into-file-action does not use semver and GHA cannot interpret the version without the exact version specified.

* Satisfying new version shellcheck linting test

Co-authored-by: Zachary Brown <z.brown@chia.net>
2023-01-19 17:00:41 -06:00
William Allen
9db6073351
Fixing snyk secret check (#14363) 2023-01-19 14:42:59 -06:00
Patrick Maslana
7b660956db
Add a workflow for scanning python deps for chia-blockchain (#13973)
* Add a workflow for scanning python deps for chia-blockchain

Signed-off-by: wallentx <william.allentx@gmail.com>

* Add a blank line to separate steps and move the test secret step

Signed-off-by: wallentx <william.allentx@gmail.com>

Signed-off-by: wallentx <william.allentx@gmail.com>
2023-01-18 00:17:59 -06:00
Kyle Altendorf
8ef43dcb30
make PR template headings actual markdown headings (#14240) 2023-01-06 16:55:40 -06:00
Kyle Altendorf
e0fc98661f
include windows coverage (#13587)
* try out proposed windows coverage combining fix

* Add [paths]

* diagnostics

* more complete paths section

* --only core.cmds

* Update test.yml

* Update test.yml

* --debug=pathmap

* ini-form

* Remove [paths]

* remove some debug

* remove --only core/cmds

* Update setup.py

* coverage[toml]==7.0.0b1

* coverage[toml]~=7.0
2023-01-06 16:55:07 -06:00
Kyle Altendorf
6cbf6f3c63
Use Chia-Network/actions/check-commit-signing (#13923)
* Use Chia-Network/actions/check-commit-signing

* @add_check_commit_signing

* use @main

* move check commit signing to a dedicated workflow

* Update check-commit-signing.yml
2023-01-06 16:54:11 -06:00
William Allen
f3a709e5e8
Fix GITHUB_OUTPUT in build workflows (#14276) 2023-01-05 00:38:59 -06:00
Kyle Altendorf
026d4671af
add cache to speed up manage_clvm/clvm_hex pre-commit check (#14177)
* add cache to speed up manage_clvm/clvm_hex pre-commit check

* Update tools/manage_clvm.py

* add version to cache along with handling of incorrect versions

* force skipping the cache in ci
2023-01-03 14:59:09 -06:00
William Allen
8bf2d2ff3f
Updating PR template & adding exclusion tags (#14055)
* Updating PR template & adding exclusion tags

* Updating PR Template, and additional release note filtering label
2022-12-21 11:31:51 -06:00
Amine Khaldi
1d363dd70d
Merge commit '0eed79bad4f71874ca54755b758ca7c698d013b6' into checkpoint/main_from_release_1.6.2_0eed79bad4f71874ca54755b758ca7c698d013b6 2022-12-14 13:10:26 +01:00
Chris Marslender
0eed79bad4
Ensure bladebit is always included when installers are built for mac (#14092) 2022-12-08 23:42:36 -06:00
Amine Khaldi
7ec8022340
Merge commit '15e657723a4fce5a754c57afc17b24d476fcbfbd' into checkpoint/main_from_release_1.7.0_15e657723a4fce5a754c57afc17b24d476fcbfbd 2022-12-07 16:20:11 +01:00
Kyle Altendorf
15e657723a
also upload the -cli .deb and .rpm packages to GitHub releases (#14049) 2022-12-06 16:20:57 -06:00
dustinface
b916275540
tools: Implement and test tools/legacy_keyring.py (#13947)
* Add `-l` option to `install.sh` and use it for linux tests on CI

* Implement and test `tools/legacy_keyring.py`

* Update install.sh

Co-authored-by: Jeff <paninaro@gmail.com>

Co-authored-by: Jeff <paninaro@gmail.com>
2022-12-03 23:31:51 -06:00
Kyle Altendorf
bcd64f949b
Check wheel availability on macOS 10.14 (#14031)
* Check wheel availability on macOS 10.14

* update pip etc (in an env)

* force-pyenv: true

* Update check_wheel_availability.yaml

* Update check_wheel_availability.yaml

* Update check_wheel_availability.yaml
2022-12-03 21:15:01 -06:00
William Allen
7b3502d66d
Revert "Add a workflow for scanning python deps" (#13959) 2022-11-18 18:05:51 -06:00
Patrick Maslana
3635df1d2f
Add a workflow for scanning python deps (#13227)
* Add a workflow for scanning python deps

* Removed the requirements.txt file from the commit

* Change to any pull request for running the workflow

* Remove some wording and fix concurrency

* Change python version

* Add a step to pip install requirements.

* Adding skip unresolved when pip installing requirements.txt

* Pip install ignore installed

* Adding a step to update pip

* Fix spacing

* Running each line for the pip install.

* Adding continue-on-error when pip installing

* using skip-unresolved with when monitoring with snyk.

* Remove pip install step and add names to steps

* Removed leading line and set "Cancel-in-progress" for concurrency to true

* Change when the workflow runs to pushes and PRs

* Update .github/workflows/snyk-python-scan.yml

Co-authored-by: Kyle Altendorf <sda@fstab.net>
2022-11-18 10:42:15 -06:00
Kyle Altendorf
22a1d1b1c2
use aws-actions/configure-aws-credentials@v1-node16 to clear warnings (#13950)
https://github.com/aws-actions/configure-aws-credentials/issues/489#issuecomment-1278145876
2022-11-18 03:25:30 -06:00
Kyle Altendorf
a76336435f
pre-commit -> timeout-minutes: 20 (#13949)
https://github.com/Chia-Network/chia-blockchain/actions/runs/3492945647/jobs/5847234861

Found a hung run that had been going for 5 hours.  A quick look suggests 2-6 minutes is normal with an outlier as high as 11 minutes.  But that was a _quick_ look.
2022-11-18 03:25:02 -06:00
William Allen
282fe9c6ef
Update workflows to use GITHUB_OUTPUT (signed commits) (#13911)
* Update build-windows-installer.yml

Use GITHUB_OUTPUT instead of set-output.

Use PowerShell syntax for PowerShell, Bash Syntax for Bash.

Why?
GitHub is deprecating set-output as per their blog:

https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Signed-off-by: wallentx <william.allentx@gmail.com>

* Use GITHUB_OUTPUT in workflows

Use GITHUB_OUTPUT in workflows instead of set-output.

Why?
GitHub is deprecating set-output as per their blog:

https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Signed-off-by: wallentx <william.allentx@gmail.com>

* Workflow dispatch added to MacOS and Linux ARM

Signed-off-by: wallentx <william.allentx@gmail.com>

* Fix Tests for Windows

Use PowerShell syntax for Windows, Bash for others.

Signed-off-by: wallentx <william.allentx@gmail.com>

* Use setup-python@v4

Update to resolve the set-output warnings

Signed-off-by: wallentx <william.allentx@gmail.com>

* Fix Tests and Benchmarks for Windows

Signed-off-by: wallentx <william.allentx@gmail.com>

* Update test.yml

Fix missed setup-python@v2

Signed-off-by: wallentx <william.allentx@gmail.com>

* Use Chia setup-python wrapper

Signed-off-by: wallentx <william.allentx@gmail.com>

* Revert "Fix Tests and Benchmarks for Windows"

This reverts commit 4fbc6d354b.

Signed-off-by: wallentx <william.allentx@gmail.com>

* Revert "Fix Tests for Windows"

This reverts commit 5860048344.

Signed-off-by: wallentx <william.allentx@gmail.com>

* Use bash for all OS to get pip cache dir

Signed-off-by: wallentx <william.allentx@gmail.com>

* Fixing windows workflow error

* Replacing instances of Out-File

* Fixing ps1 -> bash

* Fixing path when ps1 -> bash

* Escaping Windows path when using bash

* Escaping Windows path when using bash

Signed-off-by: wallentx <william.allentx@gmail.com>
Co-authored-by: zcomputerwiz <zcomputerwiz@users.noreply.github.com>
2022-11-17 21:44:12 -06:00
Chris Marslender
c9758cc476
Trigger sync tests for all release types (#13942)
* Trigger sync tests for all release types

* Temporary fix unit test

Co-authored-by: ytx1991 <t.yu@chia.net>
2022-11-17 20:18:56 -06:00
Kyle Altendorf
26171c2a7f
retryAfter: 5 (24x) for conflict check (#13422)
* retryAfter: 2 for conflict check

* two minutes

* Use 'Chia-Network/actions/label-conflict@main' for conflict check action

Co-authored-by: ChiaMineJP <admin@chiamine.jp>
2022-11-17 03:23:34 -06:00
Chris Marslender
966e67e81b
Set up commit signing for the mozilla CA updates (#13935) 2022-11-16 20:05:17 -06:00
Kyle Altendorf
fe04df9f68
less pip install and activate for windows build (#13845) 2022-11-15 18:47:24 -06:00
William Allen
e29fcaaa01
Adding new PR template, release note config, label exclusion (#13802)
* Adding new templates

* Scoping permissions of third party action

* Modifying label names

* 'Mojifying job name

* Cant parse emojis 😭

* Modified -> Changed

* Update .github/PULL_REQUEST_TEMPLATE.md

Co-authored-by: Jeff <jeff@chia.net>

* Adjusting PR template format

* Adding merging notes to PR template

* Fixing whitespace

Co-authored-by: Jeff <jeff@chia.net>
2022-11-10 23:03:26 -06:00
Kyle Altendorf
15111cf196
use install action in checks and upload workflow (#13846)
* use install action in checks and upload workflow

* correct python version specification
2022-11-10 14:05:37 -06:00
William Allen
304f7ef447
Fixing test Arch install (#13850) 2022-11-07 12:00:38 -06:00
Amine Khaldi
14ab6a3388
Merge commit '0759bc7d4c3cebf211b14e796f6af153b1ed6022' into checkpoint/main_from_release_1.6.1_0759bc7d4c3cebf211b14e796f6af153b1ed6022 2022-11-05 20:50:17 +01:00
William Allen
63fcfd8000
Fix missing bladebit install for DMG build job (#13829) 2022-11-04 21:01:43 -05:00
William Allen
0759bc7d4c
Adding missing env value for osx torrent creation (#13813) 2022-11-03 19:12:31 -05:00
Kyle Altendorf
e882061648
Add 🚨 to the dependency review workflow (#13782) 2022-11-01 15:44:12 -05:00
Kyle Altendorf
3c255f17c4
always use Chia-Network/actions/setup-python (#13779) 2022-11-01 15:43:54 -05:00
William Allen
2eebd6c448
Fix CI publishing (#13725)
* Fix ref check to github.ref instead of github.event.ref, so its always present (#13661)

* Fixing s3 upload conditional for windows builds (#13658)

Co-authored-by: Chris Marslender <chrismarslender@gmail.com>
2022-10-27 12:26:46 -05:00
Kyle Altendorf
51b951e957
simpler python exclusions (#13667)
* Revert "Set up json files for python versions, to run a more restricted set on private testing repos (#13641)"

This reverts commit aff3cf5c10.

* hard coded poc

* ${{ 'limited' }}

* env.MATRIX_MODE

* via a the existing configure step

* and ad the parameter

* also define the output

* conditional on not being the main repo
2022-10-23 13:59:08 -05:00
Kyle Altendorf
2ab1c4a65f
Create PRETTY_GOOD_PRACTICES.md (#13600)
* Create PRETTY_GOOD_PRACTICES.md

* trim trailing whitespace

* typo touchups

* correct dataclasses heading format

* correct inheritance heading

* drop nft dataclass conversion example

* consume

* manager

* Update CODEOWNERS

* tab ... ?

* Update PRETTY_GOOD_PRACTICES.md

* Update PRETTY_GOOD_PRACTICES.md
2022-10-20 16:08:18 -04:00
William Allen
2f3bd49d71
Fixing s3 upload conditional for windows builds (#13658) 2022-10-19 14:17:58 -05:00
Chris Marslender
1f19ac2de5
Fix ref check to github.ref instead of github.event.ref, so its always present (#13661) 2022-10-19 14:00:53 -05:00
Chris Marslender
aff3cf5c10
Set up json files for python versions, to run a more restricted set on private testing repos (#13641) 2022-10-19 11:51:26 -05:00
Chris Marslender
440b70a152
Fix secret check (#13597)
* Fix secret check for windows/mac (which have more granular checks because of different secret types)

* Make all the workflows use granular secret checks

* Fix whitespace issues
2022-10-04 17:11:21 -05:00
Chris Marslender
be4ada9b24
Add Bladebit prerelease to prerelease mac builds (#13540)
* Add bladebit for pre-release mac builds. Update pyinstaller to include bladebit if the file exists

* Make plotter inclusion conditional based on if they are present for the build or not

* temp: always get pre-release bladebit plotter for testing

* Only include bladebit on pre-release
2022-09-26 18:35:33 -05:00
William Allen
3023daf435
Changing conditional of start-release (#13501) 2022-09-23 17:31:28 -05:00
Kyle Altendorf
199d989352
Avoid the auto-naming mess by saying more about the coverage job in its name (#13492)
```
Coverage (🐧, ubuntu, Ubuntu, ubuntu-latest, 3.9, 3.9, 3.9, 3.9, 3.9)
```
to
```
🐧 Coverage 3.9
```
2022-09-21 22:50:40 -05:00
William Allen
357075235a
Wallentx/prerelease (#13460)
* Adding workflows to support prerelease

Signed-off-by: wallentx <william.allentx@gmail.com>

* Update installer-version.py

Signed-off-by: wallentx <william.allentx@gmail.com>

* using gh cli to upload release artifact

Signed-off-by: wallentx <william.allentx@gmail.com>

* Fixing whitespace

* Adding gh cli workflow uploads

* Removing CLI artifact upload to release page

* Adding separate release artifact upload for Windows

* Fixing windows installer envar

* Moving torrent release upload step

* Adding needed env for artifact upload

* Removing windows installer conditional for installing AWS CLI

Signed-off-by: wallentx <william.allentx@gmail.com>
2022-09-21 14:11:11 -05:00
Kyle Altendorf
a9cce0f6e0
add final coverage handling (#11778)
* add final coverage handling

* switch to development coverage

* correct url

* only run one directory for now

* only 3.10

* delete windows data for now

* drop the 35% failure point

* recover full test matrix

* Use regular coverage

* Update test.yml

* put coverage reporting into an artifact

* oops

* oopsy

* pytest-cov

* maybe

* maybe help out flakes

* farm the spend bundle...

* some more

* more funds for the did test?

* more...

* report chia/ and tests/ separately

* job_timeout = 45 for core

* tidy and disable diff-cover

* remove job_timeout = 45

* --rcfile=.coveragerc

* Update .github/workflows/test.yml

* revert time and blocks

* assert spend is in mempool, lower times and block count

* remove sleep

* lint

* up timeout

* cat test - farm blocks until spend is included

* add spend check for nft endpoints

* fix nft endpoint test

* remove unused code

* 4

Co-authored-by: almog <almogdepaz@gmail.com>
2022-09-16 14:36:37 -05:00
Kyle Altendorf
c02e57c4aa
Update to conflict check v2.0.1 (#13424)
https://github.com/eps1lon/actions-label-merge-conflict/compare/v2.0.0..v2.0.1
2022-09-12 18:37:26 -05:00
Kyle Altendorf
8aa0e7da90
Update test-single.yml (#13419)
Even the blocks and plots cache appears to finish in its entirety in 15 seconds, so the 1 minute 'segment' (not sure exactly what that means) timeout seems reasonable.

https://github.com/actions/cache/issues/810
2022-09-12 16:52:46 -05:00
Kyle Altendorf
789ee4f415
Add .clvm.hex pre-commit check (#12050)
* Add .clvm.hex pre-commit check

* report all results

* stuff

* maybe pass

* add todo

* explicitly define suffixes

* check for (and remove) extra hex and hash files

* remove garbage failure hex and hash files

* provide runner scripts

* matrix pre-commit checks

* maybe now

* more cross platform

* move it

* oops

* shell:

* maybe

* more configurable

* explicitly specify powershell

* tidy

* remove other stuff

* tidy

* remove existing pytest clvm hex etc checker

* add a trailing newline to decompress_block_spends.clvm.hex.sha256tree

* Update activated.ps1

* git config --global core.autocrlf false

* Update pre-commit.yml

* only check `chia/`

* typing_extensions

* typing_extensions

* removing unused typing import

* move top_level out of the rglob

* catchup dl clvm hex files

* Revert "catchup dl clvm hex files"

This reverts commit cd3d4f70b8.

* now
2022-09-12 16:08:55 -05:00