Max Schmitt
79559ae213
devops: auto add CQ1 label to browser rolls ( #14228 )
2022-05-17 17:54:33 +03:00
Max Schmitt
721721141f
devops: try to auto run bots on incoming roll ( #14223 )
2022-05-17 17:16:01 +03:00
Dmitry Gozman
c5face5ecc
test: add more chromium-tip-of-tree bots ( #14120 )
2022-05-12 15:44:13 +01:00
Dmitry Gozman
dba503c4b7
test: upload electron win+mac results to dashboard ( #14072 )
2022-05-10 17:24:44 +01:00
Andrey Lushnikov
3efd0e15e5
devops: upload all headed tests to flakiness ( #14056 )
2022-05-10 06:49:28 -07:00
Pavel Feldman
1658172b2c
chore: run headed on all OSs ( #14042 )
2022-05-09 12:55:59 -07:00
Andrey Lushnikov
bc9ef1c76e
devops: follow-up with installation tests on flakienss dashbaord ( #14015 )
...
- upload more installation tests to the dashboard
- use json reporter on CI
2022-05-07 09:17:07 -07:00
Andrey Lushnikov
cde34841a0
devops: upload installation tests to flakienss dashboard ( #14007 )
2022-05-06 19:04:34 -07:00
Pavel Feldman
f4933e6d8b
chore(electron): add Win+Mac bots ( #13943 )
2022-05-04 12:29:22 -07:00
Max Schmitt
315fc3751e
devops: keep one bot for Node.js 12 ( #13923 )
2022-05-04 10:10:42 +01:00
Ross Wollman
c4af7f2fc8
fix: unbreak installation tests, include in primary CI runs ( #13903 )
2022-05-03 12:48:35 -07:00
Andrey Lushnikov
9cc5f3dba1
devops(chromium-tot): fix workflow trigger for tot builds
2022-04-27 15:53:47 -04:00
Ross Wollman
3e84ab4701
test: run installation tests on all major platforms ( #13742 )
2022-04-26 11:09:49 -07:00
Max Schmitt
f7af79137b
devops: unpin NPM on CI and use again version 8 ( #13765 )
2022-04-26 17:52:10 +02:00
Max Schmitt
6c922d2f6c
devops: align Node.js versions on CI and add 16/18 bots ( #13759 )
2022-04-26 16:59:47 +02:00
Max Schmitt
6931f6dbeb
devops: bump Node.js versions on CI by 2 ( #13754 )
2022-04-26 12:20:26 +02:00
Ross Wollman
e69e836c40
chore: port installation tests to @playwright/test ( #13644 )
2022-04-25 09:30:14 -07:00
Andrey Lushnikov
317b649f78
feat: support tip-of-tree chromium channel ( #13701 )
2022-04-22 09:43:57 -07:00
Max Schmitt
ca4cfca8ad
chore: make tests pass on Node.js 17+ ( #13678 )
2022-04-22 13:42:52 +02:00
Andrey Lushnikov
10111790d0
devops: add workflow to trigger chromium tip-of-tree builds ( #13668 )
2022-04-20 22:45:51 -07:00
Andrey Lushnikov
2bf875987b
devops: introduce chromium tip-of-tree build ( #13664 )
2022-04-20 22:38:26 -07:00
Yury Semikhatsky
aee6ba299a
chore: remove GridClient, run only page tests in service mode ( #13566 )
2022-04-14 15:30:04 -07:00
Andrey Lushnikov
0f6638190e
fix: do not require --force flag when installing channel on CI ( #13487 )
2022-04-11 13:42:21 -07:00
Max Schmitt
55560d0c8a
devops: fix roll Chromium workflow ( #13421 )
2022-04-08 18:31:27 +02:00
Max Schmitt
f7119ef597
chore: have a Android GitHub Actions workflow ( #13400 )
2022-04-07 23:44:13 +02:00
Andrey Lushnikov
732afa7cb9
devops: switch chromium to build from chromium-beta branch ( #13302 )
...
This patch:
- switches `//browser_patches/chromium` to checkout and build
chromium-beta branch
- introduces `//browser_patches/chromium/roll_to_current_beta.sh` script
that pulls build configuration for beta from omaha proxy
- switches Github Action to pull daily to the latest beta
Drive-by: fix bug in argument parsing for Chromium building
2022-04-04 14:33:23 -07:00
Andrey Lushnikov
a87794dae6
fix: demand --force to re-install stable browser channels ( #13200 )
...
This patch will check if browser channel is already installed.
If it is, it'll abort installation with the following error:
```
aslushnikov:~/prog/playwright$ npx playwright install msedge
Failed to install browsers
Error:
╔═════════════════════════════════════════════════════════════════╗
║ ATTENTION: "msedge" is already installed on the system! ║
║ ║
║ "msedge" installation is not hermetic; installing newer version ║
║ requires *removal* of a current installation first. ║
║ ║
║ To *uninstall* current version and re-install latest "msedge": ║
║ ║
║ - Close all running instances of "msedge", if any ║
║ - Use "--force" to install browser: ║
║ ║
║ npx playwright install --force msedge ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════╝
```
To re-install browser channel, use `--force`.
Fixes https://github.com/microsoft/playwright/issues/13061
2022-04-01 10:05:53 -07:00
Andrey Lushnikov
a02384d2dd
devops: fix uploading test runner reports on windows ( #13232 )
...
Fixes #12443
2022-03-31 15:56:28 -07:00
Pavel Feldman
bd6e88b8be
test: start adding component tests ( #13159 )
2022-03-29 13:27:37 -07:00
Dmitry Gozman
9420a53939
fix(esm): make sure import from './foo.js' is supported ( #13137 )
...
Drive-by: migrate all @esm tests to esm.spec.ts.
2022-03-28 14:37:46 -07:00
Andrey Lushnikov
174225697a
devops: cancel primary_tests workflow jobs for stale PR commits ( #13018 )
2022-03-23 17:16:32 -07:00
Max Schmitt
94f7c2dcba
devops: audit prod npm dependencies ( #12959 )
2022-03-22 20:46:45 +01:00
Yury Semikhatsky
0e79fd59fd
devops: delete deprecated 10.14 build trigger ( #12825 )
2022-03-16 09:07:27 -07:00
Ross Wollman
b364efca38
chore: update GitHub issue template ( #12752 )
2022-03-14 20:29:09 -07:00
Pavel Feldman
e9fa098bf3
chore: add ct examples ( #12693 )
2022-03-11 15:46:11 -08:00
Max Schmitt
3f468abedd
fix(test-runner): ESM compatibly on Windows ( #12615 )
2022-03-10 19:27:25 +01:00
Dmitry Gozman
a5f2dc0d7e
tests: bring back test runner bots as they were ( #12423 )
2022-02-28 22:19:15 -08:00
Max Schmitt
cb41e668fe
devops: fix test runner flakiness uploads ( #12415 )
2022-03-01 00:37:37 +01:00
Andrey Lushnikov
f47423d315
devops: upload test-runner test results to flakiness dashboard ( #12412 )
...
Fixes #12152
2022-02-28 13:41:30 -08:00
Max Schmitt
c1a1eaec34
docs(trace-viewer): viewing remote traces on trace.playwright.dev ( #12363 )
2022-02-25 19:23:39 +01:00
Max Schmitt
8292fe8940
devops: run test-runner tests on Node 16 ( #12359 )
2022-02-25 19:13:45 +01:00
Max Schmitt
428a014cad
devops: Docker publishing cleanups ( #12341 )
2022-02-24 18:10:34 +01:00
Max Schmitt
0b55950d6a
chore: fix Android tests ( #12325 )
2022-02-24 06:57:32 +01:00
Andrey Lushnikov
2c59985bcd
chore: refactor installation tests ( #12054 )
...
This patch refactors installation tests. With this
refactoring:
- each test is a separate file
- to run a single test, just run the bash file
* tests support optional `--no-build` flag to re-use previously
built packages.
* tests support optional `--debug` flag to see line-by-line test output
* failed tests print a line that can be copied-and-pasted locally
to debug the test
- run all tests with `//installation-tests/run_all_tests.sh`
* test output is hidden for successful runs when run locally and is
shown when test fails
* runs all tests, and reports failed tests in the end
* command output is split into groups when viewed on Github.
2022-02-11 17:06:37 -08:00
Andrey Lushnikov
ab1cc0ed89
chore: remove github PR template ( #12009 )
2022-02-10 12:31:39 -08:00
Andrey Lushnikov
031219a757
chore: work-around npm install on windows ( #11726 )
...
Since yesterday all our windows bots are dying while trying to
install npm@8.
Turns out this is due to recent release of npm@8.4. This patch
moves our CI to use npm@8.3
https://github.com/npm/cli/issues/4341
2022-01-29 07:56:50 -08:00
Pavel Feldman
136fab7041
fix(prepare): don't change package files on prepare ( #11579 )
2022-01-24 11:25:24 -08:00
Andrey Lushnikov
1b0c350d0a
devops: another attempt to fix docker workflow
2022-01-15 05:11:35 +03:00
Andrey Lushnikov
26da1cc2cd
devops: further enhance workflow syntax ( #11416 )
2022-01-14 17:32:40 -08:00
Andrey Lushnikov
6895e61a4f
devops: fix docker publishing for prereleases ( #11400 )
2022-01-14 06:04:40 -08:00
Andrey Lushnikov
62095b000b
devops: split release workflow into many ( #11310 )
...
This way we can restart independent parts of the release independently.
References #11292
2022-01-10 14:05:48 -08:00
Pavel Feldman
a0aeaeb929
test: expose repeatEachIndex ( #11158 )
2022-01-03 17:29:54 -08:00
Andrey Lushnikov
056d310e20
feat(ffmpeg): roll ffmpeg to 1007 ( #11081 )
...
This build:
- Includes a native build for Mac Arm64
- Changes executable name for the linux arm64 build
2021-12-29 20:10:29 -08:00
Andrey Lushnikov
c27a27d561
devops: move docker tests to internal ( #11137 )
...
We'll re-use M1 hardware to run Ubuntu arm64 smoke tests.
2021-12-29 19:14:15 -08:00
Andrey Lushnikov
fdf750522a
devops: attempt to use ubuntu 18.04 for docker tests ( #11093 )
...
Folks on the internet claim 18.04 never runs out of disk space for them
for github actions.
2021-12-23 22:08:44 -08:00
Andrey Lushnikov
db227e1059
devops: attempt to free space before running docker tests ( #11084 )
...
Docker runs fail with "No space left on device" error.
This patch follows advice given here: https://github.com/actions/virtual-environments/issues/2840#issuecomment-790492173
2021-12-22 18:13:07 -08:00
Andrey Lushnikov
bc78faba70
devops: bring back channel installation sanity test inside docker ( #11083 )
...
This was regressed in https://github.com/microsoft/playwright/pull/11079/files
2021-12-22 16:54:41 -08:00
Andrey Lushnikov
a58dda29c7
devops: disable docker tests workflow in forks ( #11082 )
2021-12-22 16:52:56 -08:00
Andrey Lushnikov
5fafd943cb
chore: fix workflow syntax
2021-12-22 17:26:37 -07:00
Andrey Lushnikov
3bce3444e2
devops: fix tests on Ubuntu 20.04 arm64 ( #11080 )
2021-12-22 16:19:47 -08:00
Andrey Lushnikov
a21dcf0184
devops: run tests on Ubuntu 20.04 arm64 ( #11079 )
...
Since our Docker images for Ubuntu 18.04 and Ubuntu 20.04 are almost
identical, we can avoid testing all permutations.
With this patch, we will run our test only under 2 docker
configurations:
- Ubuntu 20.04 arm64 + root user
- Ubuntu 18.04 x86_64 + pwuser
2021-12-22 16:13:32 -08:00
Max Schmitt
c81c927e23
chore: make PR template more accessible ( #10952 )
2021-12-15 11:20:30 -08:00
Pavel Feldman
e55f96d466
test: add component tests for html report ( #10900 )
2021-12-13 18:30:48 -08:00
Max Schmitt
05719dc24d
chore: add Pull Request template ( #10644 )
...
Co-authored-by: Pavel Feldman <pavel.feldman@gmail.com>
2021-12-08 15:41:46 -08:00
Max Schmitt
5ba7903ba0
devops: migrate from master to main branch ( #10303 )
2021-12-07 22:58:33 -08:00
Andrey Lushnikov
388918cf3d
devops: setup Docker Qemu for arm64 docker builds ( #10771 )
...
We might also need to install docker buildx if this is not enough.
References #10351
2021-12-07 16:17:30 -08:00
Andrey Lushnikov
6ea607ce2a
devops: move docker publishing logic to main repo ( #10768 )
...
This patch:
- moves docker publishing to main repo
- extracts all the logic from the GHA YML file to Bash
- starts using the script in both `publish_canary.yml` and
`publish_release.yml`
Fixes #10351
2021-12-07 15:28:47 -08:00
Max Schmitt
070b18e755
devops: fix Docker tests ( #10767 )
2021-12-07 15:23:20 -08:00
Max Schmitt
da13d025dc
chore: fix test-package-installation tests on Node.js 12 ( #10756 )
2021-12-07 10:15:21 -08:00
Max Schmitt
26e0c6122c
test: add test for installing Chrome&MSEdge on Docker ( #10617 )
2021-12-06 15:30:45 -08:00
Pavel Feldman
541248006c
chore: remove create-playwright, it is in monorepo by mistake ( #10654 )
2021-12-01 13:09:35 -08:00
Pavel Feldman
7eb3f76f49
feat(esm): allow running tests in type module projects ( #10503 )
2021-11-24 12:42:48 -08:00
Andrey Lushnikov
32bc83d322
chore: be on the safe side with publishing release candidate ( #10363 )
...
Make sure we never publish any other version that contains `rc`
as part of the version.
References #10334
2021-11-16 15:38:14 -08:00
Andrey Lushnikov
6904d6c7e6
chore: support release candidate publishing ( #10360 )
...
Fixes #10334
2021-11-16 14:28:34 -08:00
Marcus Felling
1794ebb3ba
chore: Slack -> GitHub discussions ( #10139 )
2021-11-11 12:25:24 +01:00
Andrey Lushnikov
7af0dc178b
devops: support beta deployment for Trace viewer ( #10201 )
...
Trace Viewer will have 3 deployments:
- Stable: https://trace.playwright.dev
- Beta (from release branch): https://trace.playwright.dev/beta
- Next (from master branch): https://trace.playwright.dev/next
2021-11-09 17:21:51 -08:00
Andrey Lushnikov
56521e2a49
chore: remove vtest bot ( #10202 )
...
Visual regression tests did not survive a week and got merged back.
Remove the bot since there are no tests to run.
2021-11-09 17:15:16 -08:00
Andrey Lushnikov
12c1716fcc
chore: move to a new docker publishing ( #10169 )
2021-11-09 15:58:18 -08:00
Max Schmitt
3d18b67ce8
devops: follow-up on Trace Viewer deployment ( #10154 )
2021-11-09 00:53:48 +01:00
Max Schmitt
51910b7a01
devops: add Trace Viewer deployment ( #10154 )
2021-11-09 00:27:54 +01:00
Max Schmitt
82ec09fc55
chore: fix create-playwright builds ( #10083 follow-up)
2021-11-08 23:31:41 +01:00
Max Schmitt
4b37990f9c
devops: use NPM 8 ( #10083 )
2021-11-08 23:06:03 +01:00
Andrey Lushnikov
7f1d6e4c16
devops: do not build Chromium with symbols for every commit ( #10103 )
...
Wastes a lot of compute for the thing we barely use.
2021-11-05 17:29:24 -07:00
Max Schmitt
95a5c5cb79
chore(create-playwright): make it Node.js 12 compatible ( #10081 )
2021-11-05 17:30:18 +01:00
Max Schmitt
b177e6450a
devops: make vrt CI pipeline faster ( #10082 )
2021-11-05 12:16:39 +01:00
Max Schmitt
583944f43e
devops: fix client side changes bot after monorepo ( #10025 )
2021-11-03 23:34:57 +01:00
Andrey Lushnikov
1a577ac344
chore: introduce docker integration dogfood ( #9998 )
...
This patch:
- rolls stable-test-runner to Nov 2, 2021 tip-of-tree
- introduces a new npm script, `npm run vtest`, to run Visual Regression
Tests for our HTML reporter
2021-11-03 15:26:18 -07:00
Andrey Lushnikov
1540d19947
devops: fix version for workflow_dispatch package publishing trigger ( #9966 )
2021-11-02 03:42:00 -07:00
Andrey Lushnikov
d91d58cbec
devops: trigger docker publishing as part of NPM publishing ( #9964 )
...
This way we can tag docker image with a matching NPM version.
2021-11-02 03:01:49 -07:00
Andrey Lushnikov
e26a722d23
devops: fix publishing @next versions ( #9963 )
...
This patch:
- removes the "is this upstream check?" when publishing daily version
- fixes the bug when manually triggered builds were pushed under @beta
tag
Drive-by: rename "tip-of-tree" flag to "next" for consistency.
2021-11-02 02:35:03 -07:00
Max Schmitt
96d611ed7d
devops: publish devrelease:npm to beta on release branches ( #9949 )
...
Co-authored-by: Andrey Lushnikov <aslushnikov@gmail.com>
2021-11-01 17:29:56 -07:00
Max Schmitt
a2c414cd88
chore: add Microsoft Edge Stable on Linux ( #9915 )
2021-11-01 22:03:51 +01:00
Andrey Lushnikov
b1e555889f
devops: build canary docker daily
2021-10-27 16:37:46 -07:00
Joel Einbinder
f2888395a6
fix: support even older node 12 ( #9718 )
2021-10-22 15:59:52 -04:00
Max Schmitt
94d1fcf835
chore: move create-playwright build to build.js infra ( #9687 )
...
Co-authored-by: Joel Einbinder <joel.einbinder@gmail.com>
2021-10-22 10:13:05 +02:00
Andrey Lushnikov
1f20b0470c
chore: run docker tests on every commit ( #9632 )
...
Otherwise, we run docker tests very rarely, and their failures don't
show up on the flakiness dashboard.
2021-10-20 11:53:28 +02:00
Andrey Lushnikov
083b54a64e
chore: fix docker tests upload ( #9643 )
2021-10-20 01:52:55 -07:00
Andrey Lushnikov
6264a70f70
chore: do not publish driver on every commit ( #9634 )
...
With this patch:
- one can trigger driver publish manually
- driver will be published once a day for master branch
- driver will be published for every commit of release branch
2021-10-20 01:41:39 -07:00
Max Schmitt
299d3d6074
devops: fix Docker test-result uploads
2021-10-14 13:55:13 +02:00
Max Schmitt
0450b20712
test: fix docker flakiness dashboard uploads
2021-10-11 22:10:17 +02:00
