Andrey Lushnikov
e2d4379489
devops: use proper tags for self-hosted runner ( #4480 )
...
Turns out github already has a reserved bot label called `ubuntu-18.04`,
so marking our self-hosted bot this way was adding it to the pool of
machines that are used here.
2020-11-18 11:02:49 -08:00
Andrey Lushnikov
33a168e5cf
devops: build firefox on self-hosted ubuntu 18.04 runner ( #4478 )
2020-11-18 08:33:53 -08:00
Andrey Lushnikov
05bb149d79
devops: teach self-hosted runner to install dependencies ( #4475 )
2020-11-17 20:46:16 -08:00
Andrey Lushnikov
80446aaf41
devops: use labels instead of self-hosted runner name ( #4474 )
2020-11-17 20:01:39 -08:00
Andrey Lushnikov
497a99deef
devops: try building webkit on a self-hosted ubuntu 18.04 runner ( #4473 )
2020-11-17 19:40:44 -08:00
Andrey Lushnikov
f9a407f10d
devops: remove bigsur buildbot ( #4457 )
2020-11-17 19:27:12 -08:00
Andrey Lushnikov
52147b3046
devops: fix flakiness upload on windows ( #4415 )
2020-11-12 09:30:09 -08:00
Andrey Lushnikov
5d39eae509
devops: actually export secrets into webkit building workflow ( #4354 )
2020-11-05 03:13:34 -08:00
Andrey Lushnikov
db8332b811
devops: checkout, build, and upload webkit-mac-11 ( #4353 )
2020-11-05 02:48:46 -08:00
Andrey Lushnikov
bba8c98c69
devops: try building webkit on gha ( #4351 )
2020-11-05 01:01:18 -08:00
Pavel Feldman
6cafdc5a0e
infra: fix the headful bit on the bots ( #4261 )
2020-10-27 13:14:27 -07:00
Andrey Lushnikov
163cf1befd
devops: collect test reports for all bots ( #4246 )
...
Drive-by: make sure to upload flakiness even if tests fail.
2020-10-26 17:46:13 -07:00
Andrey Lushnikov
d5fbe3a662
devops: start uploading test reports to flakiness dashboard ( #4239 )
2020-10-26 13:46:26 -07:00
Max Schmitt
ebf207b7a1
chore: add support for macOS Big Sur (11.0) ( #4149 )
...
macOS 11.0 Big Sur was released as a preview on GitHub Actions: https://github.com/actions/virtual-environments/issues/1781#event-3879790130
Closes #2789
Relates #2793
2020-10-19 10:02:35 -07:00
Pavel Feldman
9daedaca08
chore: roll test fixtures, replace trace w/ video ( #4129 )
2020-10-13 13:18:36 -07:00
Pavel Feldman
5804131c99
chore: bump folio to 0.3.9, use fixture timeout ( #4118 )
2020-10-13 12:17:23 -07:00
Dmitry Gozman
46b14bc740
chore: roll folio to 0.3.6 ( #4110 )
2020-10-12 09:16:02 -07:00
Dmitry Gozman
fe41bbd303
test: enable videos on tracing bots ( #3930 )
2020-09-24 04:38:01 -07:00
Max Schmitt
967f3b7505
devops(docker): push focal images to CR ( #3950 )
...
This will end up in the following Docker tags:
- focal <- new
- bionic < old as before
- latest <- old as before, keep bionic for now until EOL is reached
- v1.4 <- old as before, is bionic
- v1.4-focal <- new, is focal
Depends on https://github.com/aslushnikov/devops.aslushnikov.com/pull/3 to ensure it works.
Relates to https://github.com/microsoft/playwright/issues/3791 .
2020-09-23 15:10:43 -07:00
Pavel Feldman
2d1cabdd3f
test: roll test runner to 0.3.18 ( #3949 )
2020-09-22 12:52:39 -07:00
Max Schmitt
becdccdf03
devops(docker): added Dockerfile for Ubuntu 20 focal ( #3891 )
...
Each Ubuntu and Debian release has a code name. Ubuntu 18(bionic), Ubuntu 20(focal). This adds the Dockerfile for Ubuntu20.
Next steps and follow up changes:
- add it to the devops site, so we are sure all tests are passing, locally they did
- deploy it to the MCR, naming needs to be clarified, probably just as "focal".
This naming schema allows us in the future to add Debian support too. But we should wait until Headless WK is fixed.
Relates #3791
Relates #2758
Closes #3338
2020-09-21 08:47:44 -07:00
Andrey Lushnikov
84a0066c9f
devops: align release publishing of docker image with dev releases ( #3725 )
...
This patch starts using the same approach to docker publishing that we
currently use to publish canary docker images.
2020-09-02 23:33:09 -07:00
Andrey Lushnikov
b7f6a98deb
devops: use a helper script to tag and push docker images ( #3737 )
...
It turns out that the new `docker push --all-tags` is not yet available
in the latest docker distribution on Ubuntu 20.04.
This provides a helper script to tag and publish the docker image.
2020-09-02 14:28:01 -07:00
Andrey Lushnikov
df12264655
devops: use ubuntu 20.04 to build & publish docker releases ( #3736 )
...
We rely on `docker push --all-tags` flag that exists only in the
new version of docker.
The PR to docker with the flag: https://github.com/docker/cli/pull/2220
2020-09-02 11:46:24 -07:00
Andrey Lushnikov
216db2c9b3
devops: use microsoft/playwright-github-action@v1 everywhere ( #3735 )
...
Since we launch browsers as part of the `npm run build`, we need
to prepare environment.
2020-09-02 11:32:59 -07:00
Andrey Lushnikov
9d999ae1f0
devops: push all tags to docker registry ( #3732 )
...
Instead of pushing one specific tag, push repository itself.
This should push all the associated tags.
2020-09-02 10:33:54 -07:00
Yury Semikhatsky
fc29623508
feat(screencast): use system ffmpeg on linux ( #3724 )
2020-09-02 08:47:43 -07:00
Andrey Lushnikov
47ea1e07ba
devops: another attempt to figure out docker publishing ( #3721 )
2020-09-01 17:32:16 -07:00
Andrey Lushnikov
1de4f7fa4c
devops: trigger docker devrelease when github action itself changes ( #3719 )
2020-09-01 16:59:03 -07:00
Andrey Lushnikov
2dc57c5b3d
chore: fix yaml syntax in the github action ( #3718 )
2020-09-01 16:54:05 -07:00
Andrey Lushnikov
1f93fb72d7
chore: fix devrelease workflow names ( #3717 )
2020-09-01 16:51:32 -07:00
Andrey Lushnikov
ba7093cbe8
devops: try to use azure/docker-login instead of manual login ( #3714 )
...
Manual login appeared to be successful, but rejected docker push.
References #2926
2020-09-01 14:24:42 -07:00
Andrey Lushnikov
ef5c87ccea
devops: switch docker publishing to a bash script ( #3704 )
...
It turns out Github Actions have docker pre-installed.
This patch unifies the codepaths that we use to build docker image
locally and to publish it from CI.
As a result, there's no extra `--prepare-context` argument in
`//docs/docker/build.sh` that was used solely on CI.
References #2926
2020-09-01 11:33:19 -07:00
Max Schmitt
1877c29834
devops: remove autoroll ( #3684 )
...
We have it in a own dedicated devops repo now.
2020-08-31 17:00:07 -07:00
Joel Einbinder
3cc91093a1
chore(testrunner): move out of the repo ( #3687 )
2020-08-29 08:27:32 -07:00
Pavel Feldman
555a8d0d10
fix(testrunner): include fixture teardown into timeout, add global timeout ( #3685 )
2020-08-28 19:27:49 -07:00
Dmitry Gozman
e5ff283a40
fix(trace): only enable on separate tracing bots ( #3677 )
2020-08-28 13:50:06 -07:00
Pavel Feldman
6ffdd4dfa1
feat(testrunner): allow unexpected passes ( #3665 )
2020-08-28 00:32:00 -07:00
Pavel Feldman
15ec87dbcc
feat(testrunner): support --retries, flaky tests ( #3649 )
2020-08-26 16:32:47 -07:00
Pavel Feldman
adc2a44113
infra: simplify test results collection ( #3623 )
2020-08-25 15:46:42 -07:00
Pavel Feldman
06dcf967ba
feat(testrunner): allow external reporters ( #3603 )
2020-08-24 19:16:20 -07:00
Joel Einbinder
012f9425bf
chore(test-runner): move into its own folder and typescript project ( #3548 )
2020-08-20 16:04:27 -07:00
Pavel Feldman
30f4c0c9fe
test runner: remove dependencies on playwright ( #3539 )
2020-08-19 17:47:24 -07:00
Max Schmitt
e679b82339
fix(devops): auto roll tests ( #3536 )
2020-08-19 15:04:52 -07:00
Max Schmitt
8ea280090d
devops: first implementation of browser auto-roll bot ( #3455 )
...
Relates #3258
After a chat with @aslushnikov we add this in two iterations. The first one (this PR) is about scheduled runs for testing the latest tip-of-tree version of the browsers daily and the next PR is about opening an automated PRs once its passing (not sure if its worth to add for failing too) or sending Telegram/Slack notifications.
Current status is that Firefox (around 2 hours) and WebKit (around 3-4 hours) works.
Known issues which I fix before we merge:
- ~~Changes in `test/base.fixture.ts` will get extracted in #3453~~
Feel free to review, current blockers are before we can merge:
- ~~#3453~~
- potential git clone optimisation by aslushnikov
2020-08-17 11:23:46 -07:00
Pavel Feldman
262e886940
test: organize golden files under __snapshots__ folder ( #3494 )
2020-08-16 19:19:52 -07:00
Dmitry Gozman
9b52ca8676
chore: remove unused non-rpc code, test options, infra, bots ( #3444 )
2020-08-13 16:00:23 -07:00
Dmitry Gozman
84ca0120f8
test: upload output from headful bots ( #3439 )
2020-08-13 09:33:43 -07:00
Joel Einbinder
d3677357b8
feat(testrunner): take the first argument as the test root dir ( #3423 )
2020-08-12 20:01:13 -07:00
Yury Semikhatsky
f0fcdc8f51
test(firefox): make headful screencast tests work under xvfb ( #3421 )
2020-08-12 16:07:01 -07:00
