Commit Graph

192 Commits

Author SHA1 Message Date
Azeem Shaikh
4d6f2b606b
Relax releasetest constraints (#1330)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-12-01 18:30:14 +00:00
Azeem Shaikh
5025299eb6
Fix issues with CII client (#1309)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-11-19 18:24:43 +00:00
Azeem Shaikh
08a78762da
Run Dangerous-Workflow in release tests (#1301)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-11-18 21:46:32 +00:00
Azeem Shaikh
89b316c64d
Use blob-based CII client in cron job (#1284)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-11-19 08:02:06 +11:00
Azeem Shaikh
9878c4e61e
Randomize the repos tested during release test (#1299)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-11-18 17:04:07 +00:00
Azeem Shaikh
2375ae2812
Add a OssFuzzRepoClient (#1280)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-11-17 03:04:37 +00:00
Azeem Shaikh
71e8698617
Add a cron job to copy CII badges data (#1278)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-11-16 04:23:00 +00:00
asraa
1050b1cd60
Add dangerous workflow check with untrusted code checkout pattern (#1168)
* add dangerous workflow check with untrusted code checkout pattern

Signed-off-by: Asra Ali <asraa@google.com>

* update

Signed-off-by: Asra Ali <asraa@google.com>

* add env var

Signed-off-by: Asra Ali <asraa@google.com>

* fix comment

Signed-off-by: Asra Ali <asraa@google.com>

* add repos git checks.yaml

Signed-off-by: Asra Ali <asraa@google.com>

* update checks.md

Signed-off-by: Asra Ali <asraa@google.com>

* address comments

Signed-off-by: Asra Ali <asraa@google.com>

* fix merge

Signed-off-by: Asra Ali <asraa@google.com>

* add delete

Signed-off-by: Asra Ali <asraa@google.com>

* update docs

Signed-off-by: Asra Ali <asraa@google.com>

Co-authored-by: Naveen <172697+naveensrinivasan@users.noreply.github.com>
2021-11-15 20:18:10 +00:00
Azeem Shaikh
6223b6620a
Add CIIClient interface (#1262)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-11-15 02:46:41 +00:00
Eng Zer Jun
177502552a
🌱 Move from io/ioutil to io and os packages (#1250)
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil. This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.

Signed-off-by: Eng Zer Jun <zerjun@eta-hd.com>

Co-authored-by: laurentsimon <64505099+laurentsimon@users.noreply.github.com>
2021-11-12 19:34:46 +00:00
laurentsimon
a6d298a60a
Use checks.yaml to store which repo types are supported by each check (#1195)
* draft

* draft 2

* remove enum

* update

* mock doc

* fix
2021-11-02 01:43:22 +00:00
naveen
ff316e1f97 🐛 Removed the Binary Artifact
Remove the binary artifact
2021-10-31 21:27:27 -05:00
Azeem Shaikh
69f9774b93
Store metadata in BigQuery (#1197) 2021-10-30 00:01:25 +00:00
Azeem Shaikh
83649a799e
Remove repos package (#1191)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-10-29 16:07:46 +00:00
dependabot[bot]
148446bb83
🌱 Bump distroless/base in /cron/controller (#1192)
Bumps distroless/base from `56d73a6` to `46d4514`.

---
updated-dependencies:
- dependency-name: distroless/base
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Naveen <172697+naveensrinivasan@users.noreply.github.com>
Co-authored-by: Azeem Shaikh <azeemshaikh38@gmail.com>
2021-10-29 15:12:22 +00:00
dependabot[bot]
52ce50c2b5
🌱 Bump distroless/base in /cron/worker (#1193)
Bumps distroless/base from `56d73a6` to `46d4514`.

---
updated-dependencies:
- dependency-name: distroless/base
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Naveen <172697+naveensrinivasan@users.noreply.github.com>
2021-10-29 13:56:09 +00:00
dependabot[bot]
ed2ef299f1
🌱 Bump distroless/base in /cron/webhook (#1177)
Bumps distroless/base from `56d73a6` to `46d4514`.

---
updated-dependencies:
- dependency-name: distroless/base
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Azeem Shaikh <azeemshaikh38@gmail.com>
2021-10-29 05:25:57 +00:00
Azeem Shaikh
138552848d
Remove Repo CPU runtime stat logging (#1186)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-10-29 04:37:44 +00:00
Azeem Shaikh
1db0f9745f
Sanitized repo URLs ~1M (#1182)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-10-28 21:00:57 -07:00
Azeem Shaikh
b08a4a8ca7
Increase worker replicas (#1173)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-10-29 03:40:16 +00:00
Azeem Shaikh
87359619c7
Update shard naming to allow for 1M+ shards (#1170)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-10-28 18:54:36 +00:00
Azeem Shaikh
c73c5628ea
Fix GitHub workflows failing (#1172)
Co-authored-by: Azeem Shaikh <azeems@google.com>
Co-authored-by: laurentsimon <64505099+laurentsimon@users.noreply.github.com>
2021-10-28 18:42:55 +00:00
laurentsimon
d9e35cda2a
🐛 Fix flaky tests in cron/data/add (#1185)
* fix

* naming
2021-10-28 11:18:35 -07:00
Azeem Shaikh
53ae583096
Remove obviously invalid URLs from porjects.csv (#1165)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-10-27 05:25:08 +00:00
Carlos Tadeu Panato Junior
3d9c599769
🌱 fix TestGetRepoURLs tests (#1158)
* tests: fix TestGetRepoURLs tests

Signed-off-by: Carlos Panato <ctadeu@gmail.com>

* close test file

Signed-off-by: Carlos Panato <ctadeu@gmail.com>
2021-10-25 11:03:02 -05:00
laurentsimon
950e0e3d2d
Add support for file-based repo URIs (#1113)
* draft

* draft

* docker file

* error

* fix

* fix

* fixa

* bug

* comments

* missing merge

* fix

* fix rebase

* merge issue

* fix

* validate format early

* fix

* fix2

* comments

* fix
2021-10-21 20:08:56 +00:00
Azeem Shaikh
0d299c2965
Increase number of workers and 600k repos (#1150)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-10-20 21:18:42 +00:00
Azeem Shaikh
b8eba248ac
Improve logging messages (#1140)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-10-18 15:08:15 -07:00
Azeem Shaikh
146dc8579f
Use token server in prod cron job (#1135)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-10-17 08:27:44 -07:00
Azeem Shaikh
5ec7b26e20
Fix connection refused errors (#1134)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-10-15 22:29:00 +00:00
Azeem Shaikh
89cae3a62a
Use GitHub auth server in cron release test (#1133)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-10-15 10:24:31 -07:00
Azeem Shaikh
66f864022c
Add GitHub token server (#1132)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-10-15 03:03:51 +00:00
Naveen
6c1c789dc5
🌱 v3 upgrade changes (#1118)
v3 go.mod changes
2021-10-07 18:16:01 -05:00
Azeem Shaikh
6935be8110
Disable all monitoring temporarily (#1110)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-10-06 18:39:00 +00:00
laurentsimon
4eb5b34932
update v2 BQ table (#1111)
> LGTM. Will merge it when I rename the BQ table successfully.

Done. Merging now.
2021-10-05 19:33:09 -07:00
naveen
42fd97fa60 🐛Incomplete regular expression for hostnames
This regular expression has an unescaped dot before 'com', so it might match more hosts than
expected when used.

This addresses the code scanning alert.
2021-10-05 15:30:20 -04:00
dependabot[bot]
2020ccaee9
🌱 Bump distroless/base in /cron/worker (#1078)
Bumps distroless/base from `a74f307` to `3e771f1`.

---
updated-dependencies:
- dependency-name: distroless/base
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Azeem Shaikh <azeemshaikh38@gmail.com>
2021-10-01 03:39:40 +00:00
dependabot[bot]
c10ac4bcb8
🌱 Bump distroless/base in /cron/webhook (#1076)
Bumps distroless/base from `a74f307` to `3e771f1`.

---
updated-dependencies:
- dependency-name: distroless/base
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Azeem Shaikh <azeemshaikh38@gmail.com>
2021-09-30 16:45:55 +00:00
dependabot[bot]
d2f58ab8b7
🌱 Bump distroless/base in /cron/controller (#1077)
Bumps distroless/base from `a74f307` to `3e771f1`.

---
updated-dependencies:
- dependency-name: distroless/base
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Azeem Shaikh <azeemshaikh38@gmail.com>
2021-09-30 16:19:05 +00:00
Azeem Shaikh
cf3550711e
200k projects (#1091)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-09-30 15:45:51 +00:00
Azeem Shaikh
3cbe7b26f7
Consistent -ldflags across go build (#1070)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-09-27 14:42:39 -05:00
Azeem Shaikh
2c16597b51
Fix GitVersion in cron job (#1065)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-09-27 15:32:14 +10:00
laurentsimon
5655cbb10d
Add aggregate score to cron JSON (#1050)
* change JSON cron

* linter

* linter

* comments
2021-09-22 17:00:08 -07:00
Azeem Shaikh
075cf0ca5b
150k+ repos and num_dependents_deps.dev metadata (#1052)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-09-22 19:03:11 +00:00
laurentsimon
ea77ab7d67
fix prev PR (#1033) 2021-09-16 20:57:23 +00:00
laurentsimon
34b97e37b3
Update k8's transfer releasetest-v2 (#1023)
* release-v1 transfer

* v2 fix
2021-09-16 12:29:14 -07:00
laurentsimon
617820706c
Update cron's JSON format (#1001)
* JSON2 for cron

* fixes

* linter

* fix
2021-09-13 21:55:06 +00:00
Azeem Shaikh
e730e911e6
sce.Create -> sce.WithMessage for wrapcheck (#995)
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-09-10 15:50:33 +00:00
neil465
5476b878bd
Removed unnecessary linters (#969)
* gomnd
* prealloc
* dupl
2021-09-07 10:45:12 -04:00
dependabot[bot]
f2209240a7 🌱 Bump distroless/base in /cron/worker
Bumps distroless/base from `19d927c` to `a74f307`.

---
updated-dependencies:
- dependency-name: distroless/base
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2021-09-06 12:28:54 -05:00