daml/ci
Gary Verhaegen 818a52b094
simplify docs cron (#6817)
simplify docs cron

This commit changes the "live state" to be that all versions are there
on S3, most of them hidden the way snapshots currently are, and only
displays in the drop-down the list of "supported" versions, i.e. stable
and >= 1.0.0.

The docs cron will now:

- Get list of versions from GitHub (as it does now)
- Get list of versions from S3 (as it does now: versions.json +
  snapshots.json, though it assumes we'll have a follow-up PR to change
  the latter to hidden.json)
- Compare; if the sets of versions are the same, stop there. (Note: this
  "set of versions" here includes the notion of which versions are shown,
  not just which ones exist. See the Versions data type in the code.)
- If there is a new hidden version, just build that, push it, change
  nothing else. No need to download any of the existing versions or mess
  around with anything else (except updating `hidden.json`, otherwise
  we're going to be doing this way too often.)
- If there is a new visible version:
  - check if we have it locally (i.e. from the previous step: it's a
    version we just added)
  - figure out the old and new default versions, and then apply the diff
    to the top-level directory. Basically download the two folders, list
    files that exist in the old one and not in the new one, delete those
    from S3, then push the new one to the top-level on S3.
- update versions.json & hidden.json (and for now snapshots.json)

This means that:

- we never mess with the existing versions; we don't need to download
  them, we don't need to change them, we don't clean them up. Old links
  keep working forever.
- The running time for the docs cron is roughly constant, in that it
  should very rarely have to either build or upload (or download) more
  than 2 versions per run, and if those instances happen they'd be
  accidents (we made 3 actual releases in an hour), not build-up over
  time.
2020-07-24 14:40:32 +02:00
..
cron simplify docs cron (#6817) 2020-07-24 14:40:32 +02:00
da-ghc-lib Fix reference to return produced by ApplicativeDo (#6821) 2020-07-22 10:09:23 +00:00
docker/daml-sdk Add /etc/nsswitch.conf to our Dockerfile (#5882) 2020-05-07 09:44:44 +02:00
patch_bazel_windows Update Bazel 2.1.0 --> 3.3.1 (#6761) 2020-07-23 09:46:04 +02:00
build-unix.yml Split sandbox code into separate packages (#6695) 2020-07-17 17:06:06 +02:00
build-windows.yml Revert "refactor ci jobs: add setvar to ci/lib.sh (#6708)" (#6732) 2020-07-14 23:53:49 +02:00
check-changelog.sh enable patch releases (#5584) 2020-04-16 17:50:55 +02:00
clear-shared-segments-macos.yml document shared memory segment issue (#6546) 2020-06-30 17:48:14 +02:00
compatibility_ts_libs.yml Include create-daml-app tests in compatibility tests (#5945) 2020-05-13 10:39:51 +02:00
compatibility-windows.yml Include create-daml-app tests in compatibility tests (#5945) 2020-05-13 10:39:51 +02:00
compatibility.yml Include create-daml-app tests in compatibility tests (#5945) 2020-05-13 10:39:51 +02:00
configure-bazel.sh Update Bazel 2.1.0 --> 3.3.1 (#6761) 2020-07-23 09:46:04 +02:00
daily_tell_slack.yml fix error message on daily compat failure (#6337) 2020-06-14 22:52:57 +02:00
dev-env-install.sh Fix nix installation (#6400) 2020-06-18 10:34:08 +02:00
dev-env-push.py replace DAML Authors with DA in copyright headers (#5228) 2020-03-27 01:26:10 +01:00
postgresql.conf CI: Increase the PostgreSQL connections from 100 to 200. (#6647) 2020-07-08 10:49:11 +00:00
report-end.yml Revert "refactor ci jobs: add setvar to ci/lib.sh (#6708)" (#6732) 2020-07-14 23:53:49 +02:00
report-start.yml Revert "refactor ci jobs: add setvar to ci/lib.sh (#6708)" (#6732) 2020-07-14 23:53:49 +02:00
slack_user_ids Notify Sofia on #team-daml-ci (#5487) 2020-04-08 09:31:54 +00:00
tell-slack-failed.yml fix tell-slack-failed CI "function" (#5670) 2020-04-22 15:21:04 +02:00
windows-diagnostics.ps1 windows: CI agent diagnostics (#1146) 2019-05-15 11:59:56 +02:00