laurentsimon
6718939a08
✨ Cleanup errors and log ( #782 )
...
* cleanup
* text
* add errors
* fixes
* more
* fixes
* linnter
* comments
* name
2021-08-02 22:38:42 +00:00
Azeem Shaikh
6368c25f54
More linter issues ( #794 )
...
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-08-01 03:42:14 +00:00
Azeem Shaikh
83e9f52501
Enable revive linters which are used in google3 ( #793 )
...
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-07-31 22:31:34 +00:00
Naveen
4d7fb5d748
🌱 Fix the go.mod with v2 upgrade ( #716 )
...
The go.mod and the related files weren't t updated with the v2 upgrade.
https://github.com/ossf/scorecard/issues/711
This fix will address the issue.
2021-07-26 13:01:25 -05:00
laurentsimon
45ea97e502
✨ Add more github token names for env variable ( #694 )
...
* draft
* commit 1
* dead code
* comments
* merge fix
* typo
2021-07-19 18:56:42 +00:00
Azeem Shaikh
ef2830ea98
Re-enable CensusTransport
2021-07-19 12:15:55 -05:00
naveen
885bdde5f0
🌱 Remove gitcache folder
2021-07-13 09:40:17 -05:00
naveen
219404e0b7
🌱 Removing gitcache
...
Removing gitcache
2021-07-13 01:03:21 -05:00
Azeem Shaikh
aab6c217cc
Add monitoring to measure remaining Github tokens ( #652 )
...
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-07-04 14:42:21 -07:00
Azeem Shaikh
96ea5577d1
Update documentation ( #583 )
...
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-06-16 21:05:46 -07:00
Azeem Shaikh
bf4db8577b
Update how we record cached requests ( #585 )
...
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-06-16 19:48:41 -07:00
Chris McGehee
6b63f3f963
🌱 Fix lint issues: Replace golint with revive ( #493 )
...
* Fix lint issues: Replace golint with revive
golint is deprecated and recommended to be replaced with revive
* Updating comments to be more accurate
* Updating comments again
Co-authored-by: Azeem Shaikh <azeemshaikh38@gmail.com>
2021-05-24 11:34:33 -07:00
Chris McGehee
61ecad3151
Add new linter: gci ( #498 )
2021-05-23 20:51:52 -07:00
Azeem Shaikh
0c636b0f5f
Fix bug in GitHub token access ( #490 )
...
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-05-22 11:24:53 -07:00
Azeem Shaikh
05ae13bc18
Fix bugs in stat collection logic ( #489 )
...
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-05-21 22:04:04 -07:00
Azeem Shaikh
715a2eb718
Add HTTP stats ( #484 )
...
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-05-21 13:10:27 -07:00
Azeem Shaikh
b7e38b8e0c
Refactor roundtripper code ( #471 )
...
Co-authored-by: Azeem Shaikh <azeems@google.com>
2021-05-19 06:34:20 +00:00
Chris McGehee
dca5e39996
Fix lint issues: thelper linter ( #447 )
...
Co-authored-by: Naveen <172697+naveensrinivasan@users.noreply.github.com>
2021-05-13 12:09:32 +00:00
Chris McGehee
727bb58911
🌱 Fix lint issues: govet linter ( #395 )
...
* Fix lint issues: govet linter
The fieldalignment analyzer informs you when structs would take up less
memory with their fields reordered.
* CheckResult.Details was not omitted as intended
Found by govet linter
* Removing possible breaking change
Co-authored-by: Naveen <172697+naveensrinivasan@users.noreply.github.com>
Co-authored-by: Azeem Shaikh <azeemshaikh38@gmail.com>
2021-05-11 06:52:52 -07:00
Chris McGehee
9424c915ae
Fix lint issues: tparallel linter
2021-05-08 23:15:06 -05:00
Chris McGehee
a4e8751d73
Fix intermittent test failure
2021-05-02 14:13:48 -05:00
nathannaveen
f5185e4bd6
🌱 included copyright headers.
2021-04-01 21:36:10 -05:00
naveen
5b9991e3c4
chore - remove debug log for roundtripper
...
Remove the debug log for the roundtripper which is flooding.
2021-03-18 10:49:13 -04:00
Naveen
7ff09db2ed
Fix-Using Roundrobin tokens across multiple calls ( #284 )
...
The GitHub tokens are picked from a list for each call using Roundrobin approach.
2021-03-17 21:41:29 +00:00
naveen
cab29a2747
Feat- Use cloud buckets for caching
...
Use cloud buckets for httpcache.
The implementation uses https://github.com/google/go-cloud for it to be
cloud vendor agnostic.
2021-02-24 11:17:50 -05:00
naveen
9510d3e0d7
Fix - default disk cache size
...
The default disk cache size is 100mb. Changed the default disk cache to
10gb.
2021-02-22 18:19:56 -05:00
Naveen
db81680172
Feat-Implement httpcache middleware for GitHub API ( #203 )
...
The GitHub API supports conditional requests
https://docs.github.com/en/rest/overview/resources-in-the-rest-api#conditional-requests
https://github.com/google/go-github supports Conditional requests
https://github.com/google/go-github#conditional-requests
As we are scaling more and more projects this would add a lot of value.
Initial run fetches information using `httpcache` as a middleware,
which caches the HTTP response initially in a large disk (PVC),
probably move to Redis later as a cache instead of disk.
Subsequent `cron runs` will utilize the `httpcache` for checking content modification and
load it from the cache if it isn't modified, which reduces the hitting the
Rate Limit of the GitHub API.
2021-02-22 17:18:28 +00:00
Edoardo Tenani
efd18c84a1
roundtripper: ignore gosec G101 error
...
As per issue #172 this is not an issue, as there is no real GitHub token
in the constant.
2021-02-19 08:23:57 -05:00
dlorenc
738f152a6c
Add support for multiple auth tokens to round robin requests through. ( #87 )
2020-12-02 07:59:43 -06:00
Abhishek Arya
f35a1a36f5
Fix typo. ( #73 )
2020-11-16 11:30:30 -06:00
dlorenc
24fa4cca5e
Add support for and hookup app based authentication for higher rate limiting. ( #69 )
...
This also configures it in our nightly cron cluster.
2020-11-13 11:06:46 -06:00
Abhishek Arya
81eab9d2d8
Add license header and code of conduct files. ( #34 )
...
* Add license header and code of conduct files.
* Fill missing field.
2020-10-26 15:22:13 -05:00
Dan Lorenc
bdb1aba90e
Fix rate limit.
2020-10-13 14:43:12 -05:00
Dan Lorenc
c9596cd09d
Add better logging.
2020-10-13 11:29:29 -05:00
Kim Lewandowski
812b3f46f6
fixing lock logic ( #4 )
...
Co-authored-by: Kim Lewandowski <klewandowski@google.com>
2020-10-12 11:09:58 -05:00
Dan Lorenc
3ee3c748e9
Initial commit.
2020-10-09 10:08:43 -05:00