kiteco-public/airflow/README.md
2021-12-31 23:54:19 -08:00

33 lines
813 B
Markdown

Kite Airflow
============
UI
-------------
Airflow is deploy to https://airflow.kite.dev. Requires VPN.
How to Deploy
-------------
Requirements:
* AWS CLI
* JQ (https://stedolan.github.io/jq/download/)
* Docker
Deployment:
* Login to AWS ECR: make docker_login
* Deploy: make build deploy
* Confirm Terraform deploy by type "yes"
To see deployment status:
* make show_containers
Adding metrics to kite status 1d
--------------------------------
* Ensure the field is in dags/files/kite_status.schema.yaml.
* Add the aggregation to dags/templates/athena/queries/kite_status_1d.tmpl.sql.
* Deploy.
* Manually trigger the DAG "update_kite_status_schema": http://XXXXXXX:8080/admin/airflow/tree?dag_id=update_kite_status_schema
* Let the kite_status_1d jobs run at their normally-scheduled time.