Andrey Lushnikov
26da1cc2cd
devops: further enhance workflow syntax ( #11416 )
2022-01-14 17:32:40 -08:00
Andrey Lushnikov
6895e61a4f
devops: fix docker publishing for prereleases ( #11400 )
2022-01-14 06:04:40 -08:00
Andrey Lushnikov
62095b000b
devops: split release workflow into many ( #11310 )
...
This way we can restart independent parts of the release independently.
References #11292
2022-01-10 14:05:48 -08:00
Pavel Feldman
a0aeaeb929
test: expose repeatEachIndex ( #11158 )
2022-01-03 17:29:54 -08:00
Andrey Lushnikov
056d310e20
feat(ffmpeg): roll ffmpeg to 1007 ( #11081 )
...
This build:
- Includes a native build for Mac Arm64
- Changes executable name for the linux arm64 build
2021-12-29 20:10:29 -08:00
Andrey Lushnikov
c27a27d561
devops: move docker tests to internal ( #11137 )
...
We'll re-use M1 hardware to run Ubuntu arm64 smoke tests.
2021-12-29 19:14:15 -08:00
Andrey Lushnikov
fdf750522a
devops: attempt to use ubuntu 18.04 for docker tests ( #11093 )
...
Folks on the internet claim 18.04 never runs out of disk space for them
for github actions.
2021-12-23 22:08:44 -08:00
Andrey Lushnikov
db227e1059
devops: attempt to free space before running docker tests ( #11084 )
...
Docker runs fail with "No space left on device" error.
This patch follows advice given here: https://github.com/actions/virtual-environments/issues/2840#issuecomment-790492173
2021-12-22 18:13:07 -08:00
Andrey Lushnikov
bc78faba70
devops: bring back channel installation sanity test inside docker ( #11083 )
...
This was regressed in https://github.com/microsoft/playwright/pull/11079/files
2021-12-22 16:54:41 -08:00
Andrey Lushnikov
a58dda29c7
devops: disable docker tests workflow in forks ( #11082 )
2021-12-22 16:52:56 -08:00
Andrey Lushnikov
5fafd943cb
chore: fix workflow syntax
2021-12-22 17:26:37 -07:00
Andrey Lushnikov
3bce3444e2
devops: fix tests on Ubuntu 20.04 arm64 ( #11080 )
2021-12-22 16:19:47 -08:00
Andrey Lushnikov
a21dcf0184
devops: run tests on Ubuntu 20.04 arm64 ( #11079 )
...
Since our Docker images for Ubuntu 18.04 and Ubuntu 20.04 are almost
identical, we can avoid testing all permutations.
With this patch, we will run our test only under 2 docker
configurations:
- Ubuntu 20.04 arm64 + root user
- Ubuntu 18.04 x86_64 + pwuser
2021-12-22 16:13:32 -08:00
Max Schmitt
c81c927e23
chore: make PR template more accessible ( #10952 )
2021-12-15 11:20:30 -08:00
Pavel Feldman
e55f96d466
test: add component tests for html report ( #10900 )
2021-12-13 18:30:48 -08:00
Max Schmitt
05719dc24d
chore: add Pull Request template ( #10644 )
...
Co-authored-by: Pavel Feldman <pavel.feldman@gmail.com>
2021-12-08 15:41:46 -08:00
Max Schmitt
5ba7903ba0
devops: migrate from master to main branch ( #10303 )
2021-12-07 22:58:33 -08:00
Andrey Lushnikov
388918cf3d
devops: setup Docker Qemu for arm64 docker builds ( #10771 )
...
We might also need to install docker buildx if this is not enough.
References #10351
2021-12-07 16:17:30 -08:00
Andrey Lushnikov
6ea607ce2a
devops: move docker publishing logic to main repo ( #10768 )
...
This patch:
- moves docker publishing to main repo
- extracts all the logic from the GHA YML file to Bash
- starts using the script in both `publish_canary.yml` and
`publish_release.yml`
Fixes #10351
2021-12-07 15:28:47 -08:00
Max Schmitt
070b18e755
devops: fix Docker tests ( #10767 )
2021-12-07 15:23:20 -08:00
Max Schmitt
da13d025dc
chore: fix test-package-installation tests on Node.js 12 ( #10756 )
2021-12-07 10:15:21 -08:00
Max Schmitt
26e0c6122c
test: add test for installing Chrome&MSEdge on Docker ( #10617 )
2021-12-06 15:30:45 -08:00
Pavel Feldman
541248006c
chore: remove create-playwright, it is in monorepo by mistake ( #10654 )
2021-12-01 13:09:35 -08:00
Pavel Feldman
7eb3f76f49
feat(esm): allow running tests in type module projects ( #10503 )
2021-11-24 12:42:48 -08:00
Andrey Lushnikov
32bc83d322
chore: be on the safe side with publishing release candidate ( #10363 )
...
Make sure we never publish any other version that contains `rc`
as part of the version.
References #10334
2021-11-16 15:38:14 -08:00
Andrey Lushnikov
6904d6c7e6
chore: support release candidate publishing ( #10360 )
...
Fixes #10334
2021-11-16 14:28:34 -08:00
Marcus Felling
1794ebb3ba
chore: Slack -> GitHub discussions ( #10139 )
2021-11-11 12:25:24 +01:00
Andrey Lushnikov
7af0dc178b
devops: support beta deployment for Trace viewer ( #10201 )
...
Trace Viewer will have 3 deployments:
- Stable: https://trace.playwright.dev
- Beta (from release branch): https://trace.playwright.dev/beta
- Next (from master branch): https://trace.playwright.dev/next
2021-11-09 17:21:51 -08:00
Andrey Lushnikov
56521e2a49
chore: remove vtest bot ( #10202 )
...
Visual regression tests did not survive a week and got merged back.
Remove the bot since there are no tests to run.
2021-11-09 17:15:16 -08:00
Andrey Lushnikov
12c1716fcc
chore: move to a new docker publishing ( #10169 )
2021-11-09 15:58:18 -08:00
Max Schmitt
3d18b67ce8
devops: follow-up on Trace Viewer deployment ( #10154 )
2021-11-09 00:53:48 +01:00
Max Schmitt
51910b7a01
devops: add Trace Viewer deployment ( #10154 )
2021-11-09 00:27:54 +01:00
Max Schmitt
82ec09fc55
chore: fix create-playwright builds ( #10083 follow-up)
2021-11-08 23:31:41 +01:00
Max Schmitt
4b37990f9c
devops: use NPM 8 ( #10083 )
2021-11-08 23:06:03 +01:00
Andrey Lushnikov
7f1d6e4c16
devops: do not build Chromium with symbols for every commit ( #10103 )
...
Wastes a lot of compute for the thing we barely use.
2021-11-05 17:29:24 -07:00
Max Schmitt
95a5c5cb79
chore(create-playwright): make it Node.js 12 compatible ( #10081 )
2021-11-05 17:30:18 +01:00
Max Schmitt
b177e6450a
devops: make vrt CI pipeline faster ( #10082 )
2021-11-05 12:16:39 +01:00
Max Schmitt
583944f43e
devops: fix client side changes bot after monorepo ( #10025 )
2021-11-03 23:34:57 +01:00
Andrey Lushnikov
1a577ac344
chore: introduce docker integration dogfood ( #9998 )
...
This patch:
- rolls stable-test-runner to Nov 2, 2021 tip-of-tree
- introduces a new npm script, `npm run vtest`, to run Visual Regression
Tests for our HTML reporter
2021-11-03 15:26:18 -07:00
Andrey Lushnikov
1540d19947
devops: fix version for workflow_dispatch package publishing trigger ( #9966 )
2021-11-02 03:42:00 -07:00
Andrey Lushnikov
d91d58cbec
devops: trigger docker publishing as part of NPM publishing ( #9964 )
...
This way we can tag docker image with a matching NPM version.
2021-11-02 03:01:49 -07:00
Andrey Lushnikov
e26a722d23
devops: fix publishing @next versions ( #9963 )
...
This patch:
- removes the "is this upstream check?" when publishing daily version
- fixes the bug when manually triggered builds were pushed under @beta
tag
Drive-by: rename "tip-of-tree" flag to "next" for consistency.
2021-11-02 02:35:03 -07:00
Max Schmitt
96d611ed7d
devops: publish devrelease:npm to beta on release branches ( #9949 )
...
Co-authored-by: Andrey Lushnikov <aslushnikov@gmail.com>
2021-11-01 17:29:56 -07:00
Max Schmitt
a2c414cd88
chore: add Microsoft Edge Stable on Linux ( #9915 )
2021-11-01 22:03:51 +01:00
Andrey Lushnikov
b1e555889f
devops: build canary docker daily
2021-10-27 16:37:46 -07:00
Joel Einbinder
f2888395a6
fix: support even older node 12 ( #9718 )
2021-10-22 15:59:52 -04:00
Max Schmitt
94d1fcf835
chore: move create-playwright build to build.js infra ( #9687 )
...
Co-authored-by: Joel Einbinder <joel.einbinder@gmail.com>
2021-10-22 10:13:05 +02:00
Andrey Lushnikov
1f20b0470c
chore: run docker tests on every commit ( #9632 )
...
Otherwise, we run docker tests very rarely, and their failures don't
show up on the flakiness dashboard.
2021-10-20 11:53:28 +02:00
Andrey Lushnikov
083b54a64e
chore: fix docker tests upload ( #9643 )
2021-10-20 01:52:55 -07:00
Andrey Lushnikov
6264a70f70
chore: do not publish driver on every commit ( #9634 )
...
With this patch:
- one can trigger driver publish manually
- driver will be published once a day for master branch
- driver will be published for every commit of release branch
2021-10-20 01:41:39 -07:00
Max Schmitt
299d3d6074
devops: fix Docker test-result uploads
2021-10-14 13:55:13 +02:00
Max Schmitt
0450b20712
test: fix docker flakiness dashboard uploads
2021-10-11 22:10:17 +02:00
Joel Einbinder
c89d5a50dd
chore: migrate to monorepo ( #9421 )
2021-10-11 16:52:17 +02:00
Max Schmitt
0713cb3d39
devops: move Docker build to playwright-internal ( #9023 )
2021-10-07 23:42:44 +02:00
Max Schmitt
e674d873a3
feat(test-runner): add reuse context mode to share a single context between tests ( #9115 )
2021-10-01 09:16:03 +02:00
Max Schmitt
1a2aa0e2e5
devops: use Node.js 16 when rolling browsers
2021-09-27 15:32:07 +02:00
Max Schmitt
5b93df0bab
chore(docker): upgrade to NPM 7 ( #8915 )
2021-09-22 16:38:50 +02:00
Andrey Lushnikov
1b49eec96c
devops: enable manual publishing of canary docker ( #8959 )
2021-09-16 02:02:19 -07:00
Max Schmitt
5b1440e14a
devops: rework client side changes bot ( #8877 )
2021-09-13 22:46:57 +02:00
Max Schmitt
5eca7aa1d9
feat: add create-playwright package ( #8841 )
2021-09-13 22:05:38 +02:00
Max Schmitt
30591b0115
chore: #8377 follow-ups
2021-09-01 10:40:36 +02:00
Max Schmitt
74e6f2756a
devops: try running Android tests on MacOS 11 ( #8558 )
2021-08-31 20:03:22 +02:00
Max Schmitt
fd5c10e5d7
chore: have commit header in the client side changes issue title ( #8591 )
2021-08-31 19:48:18 +02:00
Max Schmitt
4bedf1aca4
devops(auto-roll): build project before creating PR
2021-08-30 17:46:32 +02:00
Max Schmitt
abc8cb01ea
chore: #8377 follow-ups
2021-08-28 00:06:49 +02:00
Michael Rienstra
8849a8cb80
template: minor grammatical change ( #8517 )
2021-08-27 13:59:08 -07:00
Max Schmitt
16a7de5dab
chore: move client side changes check to the push event
...
#8377 follow-ups
2021-08-27 12:22:49 +02:00
Max Schmitt
db36f40422
chore: create issue on PR merge with client side changes ( #8377 )
2021-08-25 13:36:57 +02:00
Dmitry Gozman
7818f5fa0b
test: add a tracing bot that collects a trace for most contexts ( #8316 )
2021-08-19 19:09:19 -07:00
Max Schmitt
93c0da6c07
devops: #8253 follow-up fixes
2021-08-18 10:15:36 +02:00
Max Schmitt
659b378184
devops: #8253 follow-up fixes
2021-08-17 14:36:44 +02:00
Max Schmitt
e72e49ecc4
devops: #8253 follow-up fixes
2021-08-17 14:32:53 +02:00
Max Schmitt
e92924221a
devops: add workflow to roll new browser into PW ( #8253 )
2021-08-17 14:23:40 +02:00
Andrey Lushnikov
156c5d48dc
devops: use win canary to roll chromium
2021-08-11 21:09:07 +03:00
Pavel Feldman
24fde5b13e
chore: titlecase regression issue title
2021-08-10 10:38:02 -07:00
Pavel Feldman
b0d3a69256
Revert "chore: add new GitHub issue templates ( #7477 )" ( #8118 )
2021-08-10 10:36:34 -07:00
Andrey Lushnikov
ca22055045
devops: rename chromium auto-roller workflow
2021-08-07 09:07:10 -07:00
Andrey Lushnikov
51fb19561c
devops: support npx playwright install --with-deps command ( #7194 )
...
The common pattern today is to have two commands to configure CI:
```sh
npx playwright install-deps chromium
npx playwright install chromium
```
With this patch, this becomes:
```sh
npx playwright install --with-deps chromium
```
Note: `--with-deps` might call `sudo`.
2021-08-07 03:53:33 -07:00
Max Schmitt
fcb8d5310a
devops: add bot to auto bump Chromium ( #7997 )
2021-08-06 13:58:39 +02:00
Andrey Lushnikov
09764a4423
chore: move msedge-dev workflow to secondary tests ( #7681 )
2021-07-16 21:40:13 +02:00
Andrey Lushnikov
865aff8c9d
feat: support msedge-dev installation ( #7679 )
...
Fixes #7677
2021-07-16 09:56:51 -07:00
Andrey Lushnikov
2c157796e6
devops: add manual trigger for chromium builders ( #7670 )
2021-07-16 02:45:29 -07:00
Max Schmitt
b6b96daa88
devops(GHA): move build-driver to secondary workflow ( #7522 )
2021-07-08 22:50:54 +02:00
Max Schmitt
50579ba27b
chore: add new GitHub issue templates ( #7477 )
2021-07-06 21:41:16 +02:00
Andrey Lushnikov
ec8d0629f3
feat: support msedge-beta channel ( #7442 )
...
Fixes #7232
2021-07-02 12:55:46 -07:00
Andrey Lushnikov
fe32d38414
feat: move browser fonts to tools section ( #7443 )
...
This way we not only fix Docker images, but also fix `npx playwright
install-deps` in virtual machines.
2021-07-02 02:09:31 -07:00
Andrey Lushnikov
d576b8bca8
devops: support explicit GitHub sha for chromium-with-symbols build ( #7367 )
2021-06-28 14:26:15 -07:00
Max Schmitt
0d36cec600
chore: remove Playwright GitHub Action mentions ( #7281 )
2021-06-23 23:15:00 +02:00
Max Schmitt
3106c822a7
devops: test Docker image on root user ( #7219 )
2021-06-18 11:07:15 -07:00
Andrey Lushnikov
34d151a1f9
devops: introduce Docker tests ( #7157 )
...
Fixes #7139
2021-06-15 23:59:20 -07:00
Andrey Lushnikov
cff04abb5e
devops: support manual trigger for chromium-with-symbols bubild
2021-06-15 00:36:15 -08:00
Andrey Lushnikov
bf9e9bece9
devops: trigger chromium-with-symbols release on every Release ( #7132 )
...
References #7130
2021-06-15 01:22:31 -07:00
Max Schmitt
a37056fe1c
chore: add dummy playwright-test package for GitHub Dependents ( #7134 )
2021-06-15 10:16:48 +02:00
Dmitry Gozman
1d6ca5284c
feat(test runner): add tests for playwright-specific fixtures ( #6952 )
2021-06-08 15:52:08 -07:00
Andrey Lushnikov
53d68bdb38
feat: firefox is stable by default ( #6953 )
...
This patch:
- rolls Firefox to v1269 which is now a firefox-stable build.
- introduces a new channel, `firefox-beta`, for our internal needs.
Fixes #6817
2021-06-08 09:34:17 -07:00
Andrey Lushnikov
d22fa8681d
devops: update trigger for firefox beta builder
2021-06-07 17:21:42 -07:00
Andrey Lushnikov
55da16d8cd
Revert "feat: switch to the Firefox Stable equivalent by default ( #6926 )" ( #6947 )
...
This reverts commit a25b11659be8887b700311180fcd3653aa9e472b.
In a discussion with Dmitry Gozman we decided to revert this and instead
proceed with the following approach:
- rename `//browser_patches/firefox` to `//browser_patches/firefox-beta`
- rename `//browser_patches/firefox-stable` folder to
`//browser_patches/firefox`
In all of the folders, we will keep the `BUILD_NUMBER` original so that
it doesn't clash on the CDN.
2021-06-07 15:55:01 -07:00
Andrey Lushnikov
a1e8d2d531
feat: switch to the Firefox Stable equivalent by default ( #6926 )
...
This patch:
- starts downloading Firefox Stable equivalent by default
- starts running Firefox-Stable on our smoke tests (tests-1)
- starts running Firefox-Beta on our CQ1 tests (tests-2)
Note: there's a little confusion right now with browser names:
- `firefox-stable` - firefox-stable equivalent
- `firefox`- firefox-beta equivalent
I'll rename `firefox` to `firefox-beta` in a follow-up.
Fixes #6817
2021-06-07 15:00:23 -07:00
Andrey Lushnikov
cfd49b5c01
feat: support npx playwright install msedge ( #6861 )
2021-06-07 00:23:22 -07:00
Dmitry Gozman
f745bf1fbc
chore: bring in folio source ( #6923 )
...
- Source now lives at `src/test`.
- Former folio tests live at `tests/playwright-test`.
- We use `src/test/internal.ts` that exposes base test without
Playwright fixtures for most tests (to avoid modifications for now).
- Test types live in `types/testFoo.d.ts`.
- Stable test runner is installed to `tests/config/test-runner` during `npm install`.
- All deps including test-only are now listed in `package.json`.
Non-test deps must also be listed in `build_package.js` to get included.
2021-06-06 17:09:53 -07:00
Andrey Lushnikov
401dcfdefd
chore: do not use a subshell hack when using XVFB ( #6884 )
...
This was originally introduced in 9caa61aed1
2021-06-03 15:28:57 -07:00
Andrey Lushnikov
f2cc439d8b
chore: move electron back from FYI bots to CQ1 bots ( #6883 )
...
This is according to the discussion at the meeting.
2021-06-03 15:03:10 -07:00
Andrey Lushnikov
b19b2dc3ad
devops: introduce manual @next NPM publishing ( #6881 )
2021-06-03 14:50:40 -07:00
Andrey Lushnikov
17b6f06b98
feat: install media pack on windows with npx playwright install-deps ( #6836 )
...
Chromium on Windows requires Media Pack to be installed. This patch
moves media pack installation under the `npx playwright install-deps`
umbrella.
2021-06-02 10:47:10 -07:00
Andrey Lushnikov
919d258356
feat: support npx playwright install chrome ( #6835 )
...
This will install latest-and-greatest chrome stable.
2021-06-01 23:16:55 -07:00
Andrey Lushnikov
c9613b36f9
devops: introduce "FYI" test bots ( #6834 )
...
The "FYI" bots never run on PRs - even when you put a "CQ1" label.
These tests are only run on commits to master / release branches and
their results are observed on the flakiness dashboard.
2021-06-01 18:45:45 -07:00
Andrey Lushnikov
cb4adb1446
feat: install chrome-beta via cli ( #6831 )
...
This patch starts introduces `npx playwright install chrome-beta`
command and switches our Chrome Beta tests to it.
2021-06-01 18:26:12 -07:00
Andrey Lushnikov
17585a369e
devops: do not run tests for docs changes ( #6825 )
2021-06-01 13:55:48 -07:00
Dmitry Gozman
8fefac9b8c
test: roll to folio@0.4.0-alpha21 ( #6789 )
2021-05-28 17:03:18 -07:00
Andrey Lushnikov
c60974d922
feat: do not rely on chocolatey to install Google Chrome Beta ( #6735 )
2021-05-25 17:32:08 -07:00
Andrey Lushnikov
2cdf1e122c
chore: add more logging while installing browsers ( #6688 )
2021-05-20 15:47:22 -07:00
Andrey Lushnikov
33a505b1e5
chore: add logging for installation steps ( #6565 )
...
This patch:
- adds debug logging
- sets up our workflows to use `DEBUG=pw:install` on CI
2021-05-18 17:38:02 -07:00
Manu Chambon
2697f8380f
devops(docker): upgrade to node 16 ( #6498 )
2021-05-12 09:23:38 -07:00
Andrey Lushnikov
a04c54ac28
devops: do not run workflows when all changes are browser-only ( #6520 )
...
Drive-by: rename primary/secondary tests to `tests 1` and `tests 2`
2021-05-11 17:25:05 -07:00
Andrey Lushnikov
bf81a284dd
devops: run less tests on each PR ( #6518 )
...
With this patch, we have the following behaviors:
- For PR's, we will run only Linux tests for Chromium, Firefox and
Webkit
- For commits to master and release-*, we'll run all the tests
To run all tests on PR, assign a "CQ1" label to the PR.
2021-05-11 17:01:02 -07:00
Dmitry Gozman
b01ccc282f
test: roll to folio@0.4.0-alpha11 ( #6496 )
2021-05-11 06:40:06 -07:00
Dmitry Gozman
573327b7b5
test: roll to folio@0.4.0-alpha8 ( #6451 )
2021-05-07 15:25:55 -07:00
Andrey Lushnikov
298b7aef2a
devops: install Google Chrome Beta testers ( #6389 )
2021-05-06 10:07:00 -07:00
Max Schmitt
2945daca7a
devops: fixed broken GitHub Actions workflow ( #6399 )
2021-05-04 12:19:50 +02:00
Andrey Lushnikov
4cd5673cc7
chore: add debugging information on bots to trace unzipping ( #6395 )
...
We occasionally stuble upon unzipping error: "end of central directory
record signature not found" that's coming from the underlying
unzip library.
This tracing should help us investigate what's going on here.
2021-05-03 16:52:54 -07:00
Max Schmitt
29164a625f
devops: use Node.js 12 on Windows bots ( #6377 )
2021-04-30 21:35:41 +02:00
Max Schmitt
a59a494e64
chore: drop support for Node.js 10 ( #6371 )
2021-04-30 07:49:10 -07:00
Dmitry Gozman
a4561310e8
test: set 20 minutes timeout for installation tests ( #6363 )
2021-04-29 11:12:03 -07:00
Max Schmitt
2333eb09a6
chore: adjust GitHub template envinfo command ( #6359 )
2021-04-29 09:43:41 -07:00
Andrey Lushnikov
23dfaf9e9b
feat: start downloading firefox-stable channel ( #6177 )
...
This patch adds support for downloading and running Playwright with
firefox-stable channel.
References #5993
2021-04-19 21:26:33 -07:00
Max Schmitt
6296d276f2
devops(gha): remove obsolete comment ( #6234 )
2021-04-19 13:02:32 -07:00
Andrey Lushnikov
27ed123a50
feat: remove core dumps from bots ( #6231 )
...
Turns out we haven't been uploading them as artifacts for quite some
time at least.
2021-04-19 13:02:06 -07:00
Andrey Lushnikov
2c34eaeaf9
devops: better upload flakiness dashboard upload script ( #6176 )
...
This patch moves some duplicated logic from YAML workflows to
the dashboard uploading script.
2021-04-19 08:39:10 -07:00
Yury Semikhatsky
e4ae6503d7
fix(inspector): fall back to custom executable path for UI ( #6214 )
2021-04-16 15:19:44 -07:00
Andrey Lushnikov
ad8b43467e
devops: trigger Firefox Stable builds ( #6174 )
...
References #5993
2021-04-09 22:27:02 -07:00
Dmitry Gozman
bd8433ba49
test: cleanup various testing env variables ( #6155 )
2021-04-09 07:59:09 -07:00
Dmitry Gozman
310692b101
test: run page tests on electron bot ( #6122 )
2021-04-08 10:26:26 -07:00
Dmitry Gozman
36a546999e
test: roll to folio 0.3.21-alpha ( #6108 )
2021-04-06 16:09:54 -07:00
Andrey Lushnikov
da3ddb07c0
devops: start uploading test reports from chrome stable runs ( #6092 )
2021-04-05 23:15:06 -07:00
Max Schmitt
6a767d1a9c
docs(docker): use focal by default ( #5746 )
2021-04-05 16:09:35 -07:00
Dmitry Gozman
5afe282fbb
test: move remaining files from old test/ directory ( #6081 )
2021-04-05 15:51:45 -07:00
Max Schmitt
af48a8a1f1
devops: use ubuntu focal on bots and docs ( #5951 )
...
- drive-by: updated NPM Action
- replaced ubuntu-latest by ubuntu-20 so its pinned
Extracted from #5746
2021-04-05 12:39:15 -07:00
Dmitry Gozman
4f7e7450e2
test: migrate last tests to new folio ( #6071 )
2021-04-05 09:18:56 -07:00
Dmitry Gozman
f21f47889e
test: migrate more page tests to folio ( #6062 )
2021-04-04 19:32:14 -07:00
Dmitry Gozman
0629922774
test: migrate page tests to new folio ( #6054 )
2021-04-02 14:23:42 -07:00
Dmitry Gozman
be79b3883b
test: bring new folio and migrate small amount of tests to it ( #5994 )
2021-04-01 16:35:26 -07:00
Ross Wollman
ca7cd7a677
devops: skip flakiness upload for forks ( #5978 )
...
Before this change, forks face a noise from pipeline
failures trying to upload to the flakiness dashboard.
Example: https://github.com/rwoll/playwright/runs/2199170557
2021-03-29 20:05:10 -07:00
Andrey Lushnikov
7678112242
tests: do not run video tests with Chrome Stable on Linux ( #5931 )
2021-03-23 22:18:49 -07:00
Pavel Feldman
1b802332d2
infra: remove shards from mac builds to remove 6 bots ( #5928 )
2021-03-23 14:23:23 -07:00
Pavel Feldman
ad5c028f37
test(android): run selected page tests on android ( #5879 )
2021-03-18 19:31:54 -07:00
Pavel Feldman
141583c79f
infra(chrome_stable): add more bots ( #5863 )
2021-03-17 17:24:01 -07:00
Andrey Lushnikov
ab4629af38
devops: add trigger workflow to deprecated webkit builds ( #5836 )
2021-03-16 01:31:32 -07:00
Pavel Feldman
ea32ad2b09
infra(channel): add edge stable bot ( #5825 )
2021-03-15 16:00:52 -07:00
Pavel Feldman
1dd6bd3316
infra(channel): wire release channel to all tests ( #5820 )
2021-03-15 08:07:57 -07:00
Pavel Feldman
a96d6a7dbb
feat: allow to pick stable channel ( #5817 )
2021-03-13 14:02:39 -08:00
Pavel Feldman
c4578f19f2
chore: organize per-browser dependencies ( #5787 )
2021-03-11 20:22:50 -08:00
Pavel Feldman
7fa59f6d94
infra(stable): add chrome stable bot ( #5768 )
2021-03-09 19:19:21 -08:00
Max Schmitt
7971bb0335
devops: verify clean tree on bots after build ( #5354 )
2021-02-16 13:38:09 -08:00
Andrey Lushnikov
e7b431d2f7
devops: fix test triggering ( #5458 )
2021-02-13 15:17:53 -08:00
Andrey Lushnikov
6326d6f3ac
devops: properly trigger tests on internal test runners ( #5453 )
2021-02-12 15:52:48 -08:00
Andrey Lushnikov
fa730bec78
devops: trigger internal tests on each commit
2021-02-12 00:41:51 -07:00
Andrey Lushnikov
9d2269dc75
devops: attempt to fix npm canary publishing
2021-02-11 18:26:25 -08:00
Andrey Lushnikov
009765d719
devops: upload flakiness dashboard for release branches too ( #5392 )
...
There are no reasons to not upload test results for release branches.
2021-02-10 09:19:10 -08:00
Andrey Lushnikov
1240dd48cb
devops: start publishing canary at midnight every day ( #5343 )
...
This patch:
- starts publishing canary NPM package at 00:10AM UTC
- canary version is published from default (`master`) branch and is
named with a date. E.g. for a version published on Feb 5, 2021, the
version would be `1.8.0-alpha-feb-5-2021`
- versions from release branches are still published on every commit and have the
regular commit timestamp suffix
2021-02-09 14:28:04 -08:00
Andrey Lushnikov
a370443a8a
devops: use repository dispatch to trigger builds for all applications ( #5104 )
2021-01-22 12:26:31 +03:00
Andrey Lushnikov
86775f06d9
devops: add workflow to trigger Chromium builds once revision changes
2021-01-22 12:06:32 +03:00
Dmitry Gozman
0d0a6e8f82
devops: update publish script to work for @next ( #5072 )
2021-01-20 13:38:03 -08:00
Dmitry Gozman
7ff86a848a
chore: add publish-driver-release workflow ( #5006 )
2021-01-13 17:01:46 -08:00
Dmitry Gozman
4ff7e1a419
chore: cleanup our build system ( #4903 )
...
- Consolidate our build and watch to a single build.js file.
- Update contributing docs.
- Remove unused scripts and package.json script entries.
2021-01-06 12:41:17 -08:00
Dmitry Gozman
d47fb6a780
feat(cli): build driver and upload to cdn ( #4841 )
2021-01-05 14:04:47 -08:00
Pavel Feldman
ae935a43d9
doc: further align docs w/ playwright.dev ( #4866 )
2021-01-03 08:47:29 -08:00
Yury Semikhatsky
a721ba5a8a
devops: give unique names to test shards ( #4756 )
2020-12-17 18:11:31 -08:00
Pavel Feldman
e02c54485c
chore(adb): make driver smaller ( #4713 )
2020-12-14 18:39:14 -08:00
Pavel Feldman
4799e8f20b
feat(adb): add screenshot ( #4701 )
2020-12-13 23:20:13 -08:00
Pavel Feldman
1596b53da2
test(adb): fix browser tests ( #4700 )
2020-12-13 22:33:00 -08:00
Max Schmitt
f4eff4dbe0
devops: add bot to test Android ( #4693 )
2020-12-13 14:13:50 -08:00
Max Schmitt
4f3f6267a8
chore: add dummy package.json's for GH dependents analysis ( #4666 )
...
Relates #4320
The support suggest something like that.
(does not close because we want to verify it works before)
2020-12-10 06:35:29 -08:00
Andrey Lushnikov
bab16a5ce7
devops: remove self-hosted runners ( #4524 )
...
Turns out there's a way to abuse these self-hosted runners through pull-requests that mess with the YML files.
We'll move them to the private repo.
2020-11-25 08:24:54 -08:00
Pavel Feldman
e72d9a4185
chore: add websocket connection mode ( #4510 )
2020-11-20 15:19:39 -08:00
Andrey Lushnikov
2d16953e0a
devops: start Chromium mirroring from GHA ( #4492 )
2020-11-19 13:44:00 -08:00
Andrey Lushnikov
e2d4379489
devops: use proper tags for self-hosted runner ( #4480 )
...
Turns out github already has a reserved bot label called `ubuntu-18.04`,
so marking our self-hosted bot this way was adding it to the pool of
machines that are used here.
2020-11-18 11:02:49 -08:00
Andrey Lushnikov
33a168e5cf
devops: build firefox on self-hosted ubuntu 18.04 runner ( #4478 )
2020-11-18 08:33:53 -08:00
Andrey Lushnikov
05bb149d79
devops: teach self-hosted runner to install dependencies ( #4475 )
2020-11-17 20:46:16 -08:00
Andrey Lushnikov
80446aaf41
devops: use labels instead of self-hosted runner name ( #4474 )
2020-11-17 20:01:39 -08:00
Andrey Lushnikov
497a99deef
devops: try building webkit on a self-hosted ubuntu 18.04 runner ( #4473 )
2020-11-17 19:40:44 -08:00
Andrey Lushnikov
f9a407f10d
devops: remove bigsur buildbot ( #4457 )
2020-11-17 19:27:12 -08:00
Andrey Lushnikov
52147b3046
devops: fix flakiness upload on windows ( #4415 )
2020-11-12 09:30:09 -08:00
Andrey Lushnikov
5d39eae509
devops: actually export secrets into webkit building workflow ( #4354 )
2020-11-05 03:13:34 -08:00
Andrey Lushnikov
db8332b811
devops: checkout, build, and upload webkit-mac-11 ( #4353 )
2020-11-05 02:48:46 -08:00
Andrey Lushnikov
bba8c98c69
devops: try building webkit on gha ( #4351 )
2020-11-05 01:01:18 -08:00
Pavel Feldman
6cafdc5a0e
infra: fix the headful bit on the bots ( #4261 )
2020-10-27 13:14:27 -07:00
Andrey Lushnikov
163cf1befd
devops: collect test reports for all bots ( #4246 )
...
Drive-by: make sure to upload flakiness even if tests fail.
2020-10-26 17:46:13 -07:00
Andrey Lushnikov
d5fbe3a662
devops: start uploading test reports to flakiness dashboard ( #4239 )
2020-10-26 13:46:26 -07:00
Max Schmitt
ebf207b7a1
chore: add support for macOS Big Sur (11.0) ( #4149 )
...
macOS 11.0 Big Sur was released as a preview on GitHub Actions: https://github.com/actions/virtual-environments/issues/1781#event-3879790130
Closes #2789
Relates #2793
2020-10-19 10:02:35 -07:00
Pavel Feldman
9daedaca08
chore: roll test fixtures, replace trace w/ video ( #4129 )
2020-10-13 13:18:36 -07:00
Pavel Feldman
5804131c99
chore: bump folio to 0.3.9, use fixture timeout ( #4118 )
2020-10-13 12:17:23 -07:00
Dmitry Gozman
46b14bc740
chore: roll folio to 0.3.6 ( #4110 )
2020-10-12 09:16:02 -07:00
Dmitry Gozman
fe41bbd303
test: enable videos on tracing bots ( #3930 )
2020-09-24 04:38:01 -07:00
Max Schmitt
967f3b7505
devops(docker): push focal images to CR ( #3950 )
...
This will end up in the following Docker tags:
- focal <- new
- bionic < old as before
- latest <- old as before, keep bionic for now until EOL is reached
- v1.4 <- old as before, is bionic
- v1.4-focal <- new, is focal
Depends on https://github.com/aslushnikov/devops.aslushnikov.com/pull/3 to ensure it works.
Relates to https://github.com/microsoft/playwright/issues/3791 .
2020-09-23 15:10:43 -07:00
Pavel Feldman
2d1cabdd3f
test: roll test runner to 0.3.18 ( #3949 )
2020-09-22 12:52:39 -07:00
Max Schmitt
becdccdf03
devops(docker): added Dockerfile for Ubuntu 20 focal ( #3891 )
...
Each Ubuntu and Debian release has a code name. Ubuntu 18(bionic), Ubuntu 20(focal). This adds the Dockerfile for Ubuntu20.
Next steps and follow up changes:
- add it to the devops site, so we are sure all tests are passing, locally they did
- deploy it to the MCR, naming needs to be clarified, probably just as "focal".
This naming schema allows us in the future to add Debian support too. But we should wait until Headless WK is fixed.
Relates #3791
Relates #2758
Closes #3338
2020-09-21 08:47:44 -07:00
Andrey Lushnikov
84a0066c9f
devops: align release publishing of docker image with dev releases ( #3725 )
...
This patch starts using the same approach to docker publishing that we
currently use to publish canary docker images.
2020-09-02 23:33:09 -07:00
Andrey Lushnikov
b7f6a98deb
devops: use a helper script to tag and push docker images ( #3737 )
...
It turns out that the new `docker push --all-tags` is not yet available
in the latest docker distribution on Ubuntu 20.04.
This provides a helper script to tag and publish the docker image.
2020-09-02 14:28:01 -07:00
Andrey Lushnikov
df12264655
devops: use ubuntu 20.04 to build & publish docker releases ( #3736 )
...
We rely on `docker push --all-tags` flag that exists only in the
new version of docker.
The PR to docker with the flag: https://github.com/docker/cli/pull/2220
2020-09-02 11:46:24 -07:00
Andrey Lushnikov
216db2c9b3
devops: use microsoft/playwright-github-action@v1 everywhere ( #3735 )
...
Since we launch browsers as part of the `npm run build`, we need
to prepare environment.
2020-09-02 11:32:59 -07:00
Andrey Lushnikov
9d999ae1f0
devops: push all tags to docker registry ( #3732 )
...
Instead of pushing one specific tag, push repository itself.
This should push all the associated tags.
2020-09-02 10:33:54 -07:00
Yury Semikhatsky
fc29623508
feat(screencast): use system ffmpeg on linux ( #3724 )
2020-09-02 08:47:43 -07:00
Andrey Lushnikov
47ea1e07ba
devops: another attempt to figure out docker publishing ( #3721 )
2020-09-01 17:32:16 -07:00
Andrey Lushnikov
1de4f7fa4c
devops: trigger docker devrelease when github action itself changes ( #3719 )
2020-09-01 16:59:03 -07:00
Andrey Lushnikov
2dc57c5b3d
chore: fix yaml syntax in the github action ( #3718 )
2020-09-01 16:54:05 -07:00
Andrey Lushnikov
1f93fb72d7
chore: fix devrelease workflow names ( #3717 )
2020-09-01 16:51:32 -07:00
Andrey Lushnikov
ba7093cbe8
devops: try to use azure/docker-login instead of manual login ( #3714 )
...
Manual login appeared to be successful, but rejected docker push.
References #2926
2020-09-01 14:24:42 -07:00
Andrey Lushnikov
ef5c87ccea
devops: switch docker publishing to a bash script ( #3704 )
...
It turns out Github Actions have docker pre-installed.
This patch unifies the codepaths that we use to build docker image
locally and to publish it from CI.
As a result, there's no extra `--prepare-context` argument in
`//docs/docker/build.sh` that was used solely on CI.
References #2926
2020-09-01 11:33:19 -07:00
Max Schmitt
1877c29834
devops: remove autoroll ( #3684 )
...
We have it in a own dedicated devops repo now.
2020-08-31 17:00:07 -07:00
Joel Einbinder
3cc91093a1
chore(testrunner): move out of the repo ( #3687 )
2020-08-29 08:27:32 -07:00
Pavel Feldman
555a8d0d10
fix(testrunner): include fixture teardown into timeout, add global timeout ( #3685 )
2020-08-28 19:27:49 -07:00
Max Schmitt
c2cd963407
chore: added envinfo to the bug issue template ( #2237 )
...
* chore: added envinfo to the bug issue template
* Update bug.md
Co-authored-by: Arjun Attam <arjunattam@gmail.com>
2020-08-28 16:24:42 -07:00
Dmitry Gozman
e5ff283a40
fix(trace): only enable on separate tracing bots ( #3677 )
2020-08-28 13:50:06 -07:00
Pavel Feldman
6ffdd4dfa1
feat(testrunner): allow unexpected passes ( #3665 )
2020-08-28 00:32:00 -07:00
Pavel Feldman
15ec87dbcc
feat(testrunner): support --retries, flaky tests ( #3649 )
2020-08-26 16:32:47 -07:00
Pavel Feldman
adc2a44113
infra: simplify test results collection ( #3623 )
2020-08-25 15:46:42 -07:00
Pavel Feldman
06dcf967ba
feat(testrunner): allow external reporters ( #3603 )
2020-08-24 19:16:20 -07:00
Joel Einbinder
012f9425bf
chore(test-runner): move into its own folder and typescript project ( #3548 )
2020-08-20 16:04:27 -07:00
Pavel Feldman
30f4c0c9fe
test runner: remove dependencies on playwright ( #3539 )
2020-08-19 17:47:24 -07:00
Max Schmitt
e679b82339
fix(devops): auto roll tests ( #3536 )
2020-08-19 15:04:52 -07:00
Max Schmitt
8ea280090d
devops: first implementation of browser auto-roll bot ( #3455 )
...
Relates #3258
After a chat with @aslushnikov we add this in two iterations. The first one (this PR) is about scheduled runs for testing the latest tip-of-tree version of the browsers daily and the next PR is about opening an automated PRs once its passing (not sure if its worth to add for failing too) or sending Telegram/Slack notifications.
Current status is that Firefox (around 2 hours) and WebKit (around 3-4 hours) works.
Known issues which I fix before we merge:
- ~~Changes in `test/base.fixture.ts` will get extracted in #3453~~
Feel free to review, current blockers are before we can merge:
- ~~#3453~~
- potential git clone optimisation by aslushnikov
2020-08-17 11:23:46 -07:00
Pavel Feldman
262e886940
test: organize golden files under __snapshots__ folder ( #3494 )
2020-08-16 19:19:52 -07:00
Dmitry Gozman
9b52ca8676
chore: remove unused non-rpc code, test options, infra, bots ( #3444 )
2020-08-13 16:00:23 -07:00
Dmitry Gozman
84ca0120f8
test: upload output from headful bots ( #3439 )
2020-08-13 09:33:43 -07:00
Joel Einbinder
d3677357b8
feat(testrunner): take the first argument as the test root dir ( #3423 )
2020-08-12 20:01:13 -07:00
Yury Semikhatsky
f0fcdc8f51
test(firefox): make headful screencast tests work under xvfb ( #3421 )
2020-08-12 16:07:01 -07:00
Pavel Feldman
a4a07c46c3
test: support --grep, --forbid-only ( #3417 )
2020-08-12 14:57:37 -07:00
Pavel Feldman
962ddc09c4
test: consolidate runner files ( #3415 )
2020-08-12 13:47:44 -07:00
Pavel Feldman
7e07634cc6
test: use mocha in ci/cd ( #3406 )
2020-08-12 11:48:30 -07:00
Dmitry Gozman
8bb6d73b44
feat(rpc): keep non-rpc linux bots for now ( #3381 )
2020-08-10 20:49:53 -07:00
Ross Wollman
cbd33f9601
devops: avoid running publish on external contrib ( #3257 )
...
Everytime I sync my fork to upstream, I get failure notifications:
```
Run failed for master (3edfb2a
2020-07-31 14:09:36 -07:00
Andrey Lushnikov
421f6f48c7
devops: use playwright-github-action@v1 ( #3221 )
...
The playwright-github-action@v1 now points to v1.4.3, so we can
switch to it once again.
2020-07-30 17:47:39 -07:00
Andrey Lushnikov
e7ddf868bf
devops: rename docker image tag for tip-of-tree images ( #3222 )
...
We currently tag tip-of-tree docker images with `dev` tag. It'll
be much nicer to have consistent taggin with our `npm` which tags
with `next` tag.
This patch removes the `dev` tag and starts using the `next` tag instead
for docker images. Since we haven't announced `dev` tag support
anywhere, I think it's fine to remove it rather than have both `next`
and `dev`.
2020-07-30 11:45:54 -07:00
Andrey Lushnikov
77b1c4b883
devops: enable Ubuntu 20.04 tests ( #3178 )
2020-07-29 11:36:38 -07:00
Tierney Cyren
51ce47f30f
docs: use "Node.js" instead of "Node" ( #3176 )
...
* docs: use "Node.js" instead of "Node"
* docs: fix broken anchor
2020-07-27 10:27:41 -07:00
Yury Semikhatsky
79ab07bd0d
devops: install Media Pack on Windows bot ( #3137 )
2020-07-23 18:06:16 -07:00
Dmitry Gozman
d234dac752
chore: support esm imports ( #3125 )
2020-07-23 15:14:36 -07:00
Joel Einbinder
773ee08e9d
chore(test): restore api coverage checks ( #3068 )
...
* chore(test): restore api coverage checks
* try to catch the correct error on the bots
* try to trick github into taking the new code
* uninstall coverage
* dgozman comments
2020-07-22 09:08:10 -07:00
Joel Einbinder
3c151d8f1d
fix(test): don't output babel's debug info on the bots ( #3073 )
2020-07-21 16:23:46 -07:00
Pavel Feldman
b5f9985d3a
devops: make headful a matrix, collect test results ( #3027 )
2020-07-18 10:50:58 -07:00
Andrey Lushnikov
7d2078ef6f
devops: bake browsers into Docker image ( #2990 )
...
This patch bakes browsers into docker image.
Important observations:
- We now re-build docker image everytime we roll browsers.
- Docker image size almost doubles: from `225MB` to `496MB`.
References #2926
2020-07-17 16:51:39 -07:00
Pavel Feldman
9d9801192e
test: wire test commands to jest ( #3014 )
2020-07-17 16:09:27 -07:00
Pavel Feldman
424f11d165
test: convert some tests to the jest+fixtures ( #2983 )
2020-07-16 16:59:45 -07:00
Pavel Feldman
ecc130c644
test: convert evaluation.spec to jest+fixtures ( #2968 )
2020-07-16 11:18:38 -07:00
Pavel Feldman
19cd96c46a
test: add the jest-circus experimental runner ( #2962 )
2020-07-15 16:52:41 -07:00
Andrey Lushnikov
d58a57c4b2
devops: fix docker publishing ( #2939 )
...
- Repository name has to start with `public/` to be exported to dockerhub.
- Remove `DOCKER_USERNAME` to avoid unnecessary masking in our logs.
- Publish dev versions of Docker image only when changes to docker file
happen. (this is why NPM publishing and Docker publishing for dev
releases are now separate).
- Release publishing in two separate jobs to make them independent.
References #2926
2020-07-13 17:15:10 -07:00
Andrey Lushnikov
b7d68d1cdb
devops: automate Docker image publishing ( #2937 )
...
This starts publishing our Docker images using Github Actions:
- on every commit, a new image will be pushed, tagged with a SHA of the
commit, e.g.
`mcr.microsoft.com/playwright:sha-fe997eca88d6de48378b05133dadfe032bd8b0ea`
- on every release, a new image will be pushed, tagged with the release
version, e.g. `mcr.microsoft.com/playwright:v1.2.1`
**Note:** today we don't version our images and instead push them all as
`bionic`. This patch retains the tag - along with `latest`. Both
`bionic` and `latest` tags will point to the latest release.
2020-07-13 16:18:51 -07:00
Dmitry Gozman
2151757621
feat(rpc): run rpc tests in-process and out-of-process ( #2929 )
2020-07-13 15:00:20 -07:00
Dmitry Gozman
6d94c92053
feat(rpc): support no-serialization mode, run hook tests ( #2925 )
...
Added rpc_json_linux bots to excercise serialization - these
do not run hook tests.
2020-07-13 08:31:20 -07:00
Pavel Feldman
982e5e3550
devops: collect artifacts from browser locations ( #2913 )
2020-07-10 16:15:00 -07:00
