scorecard/e2e
Gabriela Gutierrez 383e5566d0
🐛 Add go installs to Pinned-Dependencies score (#3424)
* feat: Add go install to pinned dependencies score

Signed-off-by: Gabriela Gutierrez <gabigutierrez@google.com>

* test: Fix info logs count

Considering the new go installs dependencies in Pinned-Dependencies score, there are some changes. Now, all tests generate one more Info log for "go installs are all pinned".

Signed-off-by: Gabriela Gutierrez <gabigutierrez@google.com>

* test: Fix "download then run pinned debug and warn"

Considering the new go installs dependencies in Pinned-Dependencies score, there are some changes. Now, all tests have to weight 7 scores instead of 6.

For "download then run pinned debug and warn", we have a 0 for 2 groups, `dockerDownloadScore` and `scriptScore`. Previously, it scored 4/6 =~ 6, and now it scores 5/7 =~ 7.

Signed-off-by: Gabriela Gutierrez <gabigutierrez@google.com>

* test: Fix "various warnings"

Considering the new go installs dependencies in Pinned-Dependencies score, there are some changes. Now, all tests have to weight 7 scores instead of 6.

For "various warnings", we have a 0 for 4 groups, `pipScore`, `dockerDownloadScore`, `scriptScore` and `dockerFromScore`. Previously, it scored 2/6 =~ 3, and now it scores 3/7 =~ 4.

Signed-off-by: Gabriela Gutierrez <gabigutierrez@google.com>

* test: Fix "Validate various warnings and info"

Considering the new go installs dependencies in Pinned-Dependencies score, there are some changes. Now, all tests have to weight 7 scores instead of 6.

For "Validate various warnings and info", we have a 0 for 4 groups, `pipScore`, `dockerDownloadScore`, `scriptScore` and `dockerFromScore`. Previously, it scored 2/6 =~ 3, and now it scores 3/7 =~ 4.

Signed-off-by: Gabriela Gutierrez <gabigutierrez@google.com>

* test: Fix "ossf-tests/scorecard-check-pinned-dependencies-e2e"

Considering the new go installs dependencies in Pinned-Dependencies score, there are some changes. The repo being tested, `ossf-tests/scorecard-check-pinned-dependencies-e2e`, has third-party GitHub actions pinned, no npm installs, multiple go installs all pinned, and all other dependencies types are unpinned. This gives us 8 for actionScore, 10 for npm score, 10 for goScore, and 0 for all other scores. Previously the total score was 18/6 =~ 3, and now the total score is 28/7 =~ 4. Since all go installs are pinned, there's an additional info log for "go installs are pinned".

Signed-off-by: Gabriela Gutierrez <gabigutierrez@google.com>

* test: Unpinned go install score

When having one unpinned go install and all other dependencies pinned, the score should be 60/7 =~ 8. Also, it should raise 1 warning for the unpinned go install, 7 infos saying the other dependency types are pinned (2 for GHAs, 2 for dockerfile image and downdloads, 1 for script downdloads, 1 for pip installs and 1 for npm installs), and 0 debug logs since the go install dependency does not have an error message.

Signed-off-by: Gabriela Gutierrez <gabigutierrez@google.com>

---------

Signed-off-by: Gabriela Gutierrez <gabigutierrez@google.com>
2023-08-25 09:53:22 -07:00
..
attestor_policy_test.go 🌱 Re-enable skipped e2e tests. Switch to smaller code review repo. (#3144) 2023-06-09 11:44:34 -07:00
binary_artifacts_test.go Use new project name in Copyright notices (#2505) 2022-12-01 15:08:48 -08:00
branch_protection_test.go Add support for RequiresLastPushReview in Branch Protection for GitHub (#2492) 2022-12-14 10:48:38 -08:00
ci_tests_test.go 🌱 Re-enable skipped e2e tests. Switch to smaller code review repo. (#3144) 2023-06-09 11:44:34 -07:00
cii_best_practices_test.go Use new project name in Copyright notices (#2505) 2022-12-01 15:08:48 -08:00
code_review_test.go Disable GitLab code review tests (#3222) 2023-06-28 12:25:34 -04:00
contributors_test.go 🌱 Gitlab: Move tests that connect to gitlab.com out of unit-tests (#3221) 2023-06-29 15:11:05 -04:00
dangerous_workflow_test.go Use new project name in Copyright notices (#2505) 2022-12-01 15:08:48 -08:00
dependency_update_tool_test.go [experimental] Probe support for security policy check (#3241) 2023-08-04 04:52:15 +00:00
dependencydiff_test.go 🌱 Ignore deprecation warning for dependencydiff tests. (#3136) 2023-06-07 13:44:44 -07:00
e2e_suite_test.go GitLab: Security Policy check (#2754) 2023-03-16 19:18:32 +00:00
fuzzing_test.go [experimental] Probe support for fuzzing check (#3230) 2023-08-21 17:50:20 +00:00
license_test.go 🐛 Licenses: Get License SPDXId from GitLab API (#3413) 2023-08-23 17:03:20 +00:00
maintained_test.go Gitlab: Add projects to cron (#2936) 2023-05-24 17:43:36 -04:00
packaging_test.go Use new project name in Copyright notices (#2505) 2022-12-01 15:08:48 -08:00
permissions_test.go Structured results for permissions (#2584) 2023-01-30 18:41:36 -08:00
pinned_dependencies_test.go 🐛 Add go installs to Pinned-Dependencies score (#3424) 2023-08-25 09:53:22 -07:00
sast_test.go Use local files instead of search for SAST CodeQL check (#2839) 2023-04-12 15:50:36 -07:00
searchCommits_test.go 🌱 Improve search commit e2e tests (#3295) 2023-07-24 15:46:14 +00:00
security_policy_test.go switch security policy e2e test to ossf-tests repo. (#3090) 2023-05-31 07:36:40 -05:00
signedreleases_test.go Use new project name in Copyright notices (#2505) 2022-12-01 15:08:48 -08:00
vulnerabilities_test.go ⚠️ OSV scanner integration (#2509) 2022-12-12 16:46:43 -08:00
workflow_test.go 🌱 Improve e2e workflow tests (#3282) 2023-07-21 02:29:03 +00:00