scorecard/cron/data
Caleb Brown ff28594eda
🌱 [cron] generalize some of the transfer logic so it is easy to build new transfer agents (#2454)
* Generalize the transfer logic so it is easy to build new transfer agents

This change moves code that reads shards and produces summaries into the
data package so that it can be reused to create new transfer agents,
similar to the BigQuery transfer agent in cron/internal/bq.

Signed-off-by: Caleb Brown <calebbrown@google.com>

* Lint fix and commentary.

Signed-off-by: Caleb Brown <calebbrown@google.com>

Signed-off-by: Caleb Brown <calebbrown@google.com>
2022-11-16 18:34:50 +00:00
..
testdata 🌱 [cron] generalize some of the transfer logic so it is easy to build new transfer agents (#2454) 2022-11-16 18:34:50 +00:00
blob_test.go 🌱 cron: support reading prefix from file for controller input files (7/n) (#2445) 2022-11-09 15:43:46 -08:00
blob.go 🌱 cron: generalize and expose worker (6/n) (#2317) 2022-10-19 21:01:42 +00:00
format_test.go 🌱 cron: generalize and expose worker (6/n) (#2317) 2022-10-19 21:01:42 +00:00
format.go 🌱 cron: generalize and expose worker (6/n) (#2317) 2022-10-19 21:01:42 +00:00
iterator_test.go 🌱 cron: generalize and expose worker (6/n) (#2317) 2022-10-19 21:01:42 +00:00
iterator.go 🌱 cron: generalize and expose worker (6/n) (#2317) 2022-10-19 21:01:42 +00:00
metadata.pb.go 🌱 cron: generalize and expose worker (6/n) (#2317) 2022-10-19 21:01:42 +00:00
metadata.proto 🌱 cron: generalize and expose worker (6/n) (#2317) 2022-10-19 21:01:42 +00:00
README.md 🌱 cron: generalize and expose worker (6/n) (#2317) 2022-10-19 21:01:42 +00:00
request.pb.go 🌱 cron: generalize and expose worker (6/n) (#2317) 2022-10-19 21:01:42 +00:00
request.proto 🌱 cron: generalize and expose worker (6/n) (#2317) 2022-10-19 21:01:42 +00:00
summary_test.go 🌱 [cron] generalize some of the transfer logic so it is easy to build new transfer agents (#2454) 2022-11-16 18:34:50 +00:00
summary.go 🌱 [cron] generalize some of the transfer logic so it is easy to build new transfer agents (#2454) 2022-11-16 18:34:50 +00:00
writer_test.go 🌱 cron: generalize and expose worker (6/n) (#2317) 2022-10-19 21:01:42 +00:00
writer.go 🌱 cron: generalize and expose worker (6/n) (#2317) 2022-10-19 21:01:42 +00:00

Generating proto files

Installation

Follow instructions here to install necessary binaries.

Compile

Run make build-proto to compile proto.