scorecard/CONTRIBUTING.md

Contributing to Security Scorecards

Thank you for contributing your time and expertise to the Security Scorecards project. This document describes the contribution guidelines for the project.

Note: Before you start contributing, you must read and abide by our Code of Conduct.

• Contributing code
  • Getting started
  • Environment Setup
• Contributing steps
• How to build scorecard locally
• PR Process
• What to do before submitting a pull request
• Permission for GitHub personal access tokens
• Where the CI Tests are configured
• dailyscore-cronjob
  • Deploying the cron job
• How do I add additional GitHub repositories to be scanned by scorecard dailyscore?
• Adding New Checks
  • Updating Docs

Contributing code

Getting started

1. Create a GitHub account
2. Create a personal access token
3. Set up your development environment

Environment Setup

You must install these tools:

1. git: For source control

2. go: You need go version v1.16 or higher.

3. docker: v18.9 or higher.

Contributing steps

1. Submit an issue describing your proposed change to the repo in question.
2. The repo owners will respond to your issue promptly.
3. Fork the desired repo, develop and test your code changes.
4. Submit a pull request.

How to build scorecard locally

Note that, by building the scorecard from the source code we are allowed to test the changes made locally.

1. Run the following command to clone your fork of the project locally

git clone git@github.com:<user>/scorecard.git $GOPATH/src/github.com/<user>/scorecard.git

1. Ensure you activate module support before continue ($ export GO111MODULE=on)
2. Run the command make build to build the source code

PR Process

Every PR should be annotated with an icon indicating whether it's a:

• Breaking change: ⚠️ (:warning:)
• Non-breaking feature: ✨ (:sparkles:)
• Patch fix: 🐛 (:bug:)
• Docs: 📖 (:book:)
• Infra/Tests/Other: 🌱 (:seedling:)
• No release note: 👻 (:ghost:)

Use 👻 (no release note) only for the PRs that change or revert unreleased changes, which don't deserve a release note. Please don't abuse it.

You can also use the equivalent emoji directly, since GitHub doesn't render the :xyz: aliases in PR titles.

Individual commits should not be tagged separately, but will generally be assumed to match the PR. For instance, if you have a bugfix in with a breaking change, it's generally encouraged to submit the bugfix separately, but if you must put them in one PR, you should mark the whole PR as breaking.

What to do before submitting a pull request

Following the targets that can be used to test your changes locally.

Command	Description	Is called in the CI?
make all	Runs go test,golangci lint checks, fmt, go mod tidy	yes
make e2e	Runs e2e tests	yes

Permission for GitHub personal access tokens

The personal access token need the following scopes:

• repo:status - Access commit status
• repo_deployment - Access deployment status
• public_repo - Access public repositories

Where the CI Tests are configured

1. See the action files to check its tests, and the scripts used on it.

dailyscore-cronjob

scorecard scans https://github.com/ossf/scorecard/blob/main/cron/projects.txt repositories in GCP k8s and publishes the results in GCS bucket ossf-scorecards.

The cron definition ./scorecard/cron/cron.sh and the k8s for the cron is in ./scorecard/cron/k8s/cron.yaml

The logs for the cron are available at https://console.cloud.google.com/kubernetes/cronjob/us-central1-c/openssf/default/daily-score/logs?project=openssf

Deploying the cron job

The cronjob can be deployed into k8s by running kubectl apply -f ./scorecard/cron/k8s/cron.yaml. This will deploy a k8s cron job.

Any updates to the ./scorecard/cron/cron.sh will be deployed by the docker container ./scorecard/Dockerfile.gsutil

How do I add additional GitHub repositories to be scanned by scorecard dailyscore?

Scorecard maintains the list of repositories in a file https://github.com/ossf/scorecard/blob/main/cron/projects.txt

Submit a PR for this file and scorecard would start scanning in subsequent runs.

Adding New Checks

Each check is currently just a function of type CheckFn. The signature is:

type CheckFn func(*c.Checker) CheckResult

Checks are registered in an init function:

const codeReviewStr = "Code-Review"

//nolint:gochecknoinits
func init() {
	registerCheck(codeReviewStr, DoesCodeReview)
}

Updating Docs

The docs need to be updated for the checks. A summary needs to be included in the README.md and also /checks/checks.yaml and checks/checks.md needs to be updated.

The /checks/checks.md is auto generated by running ./checks/main/main.go

Currently only one set of checks can be run. In the future, we'll allow declaring multiple suites and configuring which checks get run.