mirror of
https://github.com/kiteco/kiteco-public.git
synced 2024-09-11 13:38:04 +03:00
.. | ||
conf/prod | ||
containers/monetizable | ||
kite_airflow | ||
terraform | ||
.dockerignore | ||
.gitignore | ||
.pep8 | ||
docker-compose.yaml | ||
Dockerfile | ||
Makefile | ||
MANIFEST.in | ||
README.md | ||
requirements.txt | ||
setup.py | ||
unittests.cfg |
Kite Airflow
UI
Airflow is deploy to https://airflow.kite.dev. Requires VPN.
How to Deploy
Requirements:
- AWS CLI
- JQ (https://stedolan.github.io/jq/download/)
- Docker
Deployment:
- Login to AWS ECR: make docker_login
- Deploy: make build deploy
- Confirm Terraform deploy by type "yes"
To see deployment status:
- make show_containers
Adding metrics to kite status 1d
- Ensure the field is in dags/files/kite_status.schema.yaml.
- Add the aggregation to dags/templates/athena/queries/kite_status_1d.tmpl.sql.
- Deploy.
- Manually trigger the DAG "update_kite_status_schema": http://XXXXXXX:8080/admin/airflow/tree?dag_id=update_kite_status_schema
- Let the kite_status_1d jobs run at their normally-scheduled time.