Commit Graph

327 Commits

Author SHA1 Message Date
Dmitry Gozman
a5f2dc0d7e
tests: bring back test runner bots as they were (#12423) 2022-02-28 22:19:15 -08:00
Max Schmitt
cb41e668fe
devops: fix test runner flakiness uploads (#12415) 2022-03-01 00:37:37 +01:00
Andrey Lushnikov
f47423d315
devops: upload test-runner test results to flakiness dashboard (#12412)
Fixes #12152
2022-02-28 13:41:30 -08:00
Max Schmitt
c1a1eaec34
docs(trace-viewer): viewing remote traces on trace.playwright.dev (#12363) 2022-02-25 19:23:39 +01:00
Max Schmitt
8292fe8940
devops: run test-runner tests on Node 16 (#12359) 2022-02-25 19:13:45 +01:00
Max Schmitt
428a014cad
devops: Docker publishing cleanups (#12341) 2022-02-24 18:10:34 +01:00
Max Schmitt
0b55950d6a
chore: fix Android tests (#12325) 2022-02-24 06:57:32 +01:00
Andrey Lushnikov
2c59985bcd
chore: refactor installation tests (#12054)
This patch refactors installation tests. With this
refactoring:

- each test is a separate file
- to run a single test, just run the bash file
  * tests support optional `--no-build` flag to re-use previously
    built packages.
  * tests support optional `--debug` flag to see line-by-line test output
  * failed tests print a line that can be copied-and-pasted locally
    to debug the test
- run all tests with `//installation-tests/run_all_tests.sh`
  * test output is hidden for successful runs when run locally and is
    shown when test fails
  * runs all tests, and reports failed tests in the end
  * command output is split into groups when viewed on Github.
2022-02-11 17:06:37 -08:00
Andrey Lushnikov
ab1cc0ed89
chore: remove github PR template (#12009) 2022-02-10 12:31:39 -08:00
Andrey Lushnikov
031219a757
chore: work-around npm install on windows (#11726)
Since yesterday all our windows bots are dying while trying to
install npm@8.

Turns out this is due to recent release of npm@8.4. This patch
moves our CI to use npm@8.3

https://github.com/npm/cli/issues/4341
2022-01-29 07:56:50 -08:00
Pavel Feldman
136fab7041
fix(prepare): don't change package files on prepare (#11579) 2022-01-24 11:25:24 -08:00
Andrey Lushnikov
1b0c350d0a devops: another attempt to fix docker workflow 2022-01-15 05:11:35 +03:00
Andrey Lushnikov
26da1cc2cd
devops: further enhance workflow syntax (#11416) 2022-01-14 17:32:40 -08:00
Andrey Lushnikov
6895e61a4f
devops: fix docker publishing for prereleases (#11400) 2022-01-14 06:04:40 -08:00
Andrey Lushnikov
62095b000b
devops: split release workflow into many (#11310)
This way we can restart independent parts of the release independently.

References #11292
2022-01-10 14:05:48 -08:00
Pavel Feldman
a0aeaeb929
test: expose repeatEachIndex (#11158) 2022-01-03 17:29:54 -08:00
Andrey Lushnikov
056d310e20
feat(ffmpeg): roll ffmpeg to 1007 (#11081)
This build:
- Includes a native build for Mac Arm64
- Changes executable name for the linux arm64 build
2021-12-29 20:10:29 -08:00
Andrey Lushnikov
c27a27d561
devops: move docker tests to internal (#11137)
We'll re-use M1 hardware to run Ubuntu arm64 smoke tests.
2021-12-29 19:14:15 -08:00
Andrey Lushnikov
fdf750522a
devops: attempt to use ubuntu 18.04 for docker tests (#11093)
Folks on the internet claim 18.04 never runs out of disk space for them
for github actions.
2021-12-23 22:08:44 -08:00
Andrey Lushnikov
db227e1059
devops: attempt to free space before running docker tests (#11084)
Docker runs fail with "No space left on device" error.
This patch follows advice given here: https://github.com/actions/virtual-environments/issues/2840#issuecomment-790492173
2021-12-22 18:13:07 -08:00
Andrey Lushnikov
bc78faba70
devops: bring back channel installation sanity test inside docker (#11083)
This was regressed in https://github.com/microsoft/playwright/pull/11079/files
2021-12-22 16:54:41 -08:00
Andrey Lushnikov
a58dda29c7
devops: disable docker tests workflow in forks (#11082) 2021-12-22 16:52:56 -08:00
Andrey Lushnikov
5fafd943cb chore: fix workflow syntax 2021-12-22 17:26:37 -07:00
Andrey Lushnikov
3bce3444e2
devops: fix tests on Ubuntu 20.04 arm64 (#11080) 2021-12-22 16:19:47 -08:00
Andrey Lushnikov
a21dcf0184
devops: run tests on Ubuntu 20.04 arm64 (#11079)
Since our Docker images for Ubuntu 18.04 and Ubuntu 20.04 are almost
identical, we can avoid testing all permutations.

With this patch, we will run our test only under 2 docker
configurations:
- Ubuntu 20.04 arm64 + root user
- Ubuntu 18.04 x86_64 + pwuser
2021-12-22 16:13:32 -08:00
Max Schmitt
c81c927e23
chore: make PR template more accessible (#10952) 2021-12-15 11:20:30 -08:00
Pavel Feldman
e55f96d466
test: add component tests for html report (#10900) 2021-12-13 18:30:48 -08:00
Max Schmitt
05719dc24d
chore: add Pull Request template (#10644)
Co-authored-by: Pavel Feldman <pavel.feldman@gmail.com>
2021-12-08 15:41:46 -08:00
Max Schmitt
5ba7903ba0
devops: migrate from master to main branch (#10303) 2021-12-07 22:58:33 -08:00
Andrey Lushnikov
388918cf3d
devops: setup Docker Qemu for arm64 docker builds (#10771)
We might also need to install docker buildx if this is not enough.

References #10351
2021-12-07 16:17:30 -08:00
Andrey Lushnikov
6ea607ce2a
devops: move docker publishing logic to main repo (#10768)
This patch:
- moves docker publishing to main repo
- extracts all the logic from the GHA YML file to Bash
- starts using the script in both `publish_canary.yml` and
  `publish_release.yml`

Fixes #10351
2021-12-07 15:28:47 -08:00
Max Schmitt
070b18e755
devops: fix Docker tests (#10767) 2021-12-07 15:23:20 -08:00
Max Schmitt
da13d025dc
chore: fix test-package-installation tests on Node.js 12 (#10756) 2021-12-07 10:15:21 -08:00
Max Schmitt
26e0c6122c
test: add test for installing Chrome&MSEdge on Docker (#10617) 2021-12-06 15:30:45 -08:00
Pavel Feldman
541248006c
chore: remove create-playwright, it is in monorepo by mistake (#10654) 2021-12-01 13:09:35 -08:00
Pavel Feldman
7eb3f76f49
feat(esm): allow running tests in type module projects (#10503) 2021-11-24 12:42:48 -08:00
Andrey Lushnikov
32bc83d322
chore: be on the safe side with publishing release candidate (#10363)
Make sure we never publish any other version that contains `rc`
as part of the version.

References #10334
2021-11-16 15:38:14 -08:00
Andrey Lushnikov
6904d6c7e6
chore: support release candidate publishing (#10360)
Fixes #10334
2021-11-16 14:28:34 -08:00
Marcus Felling
1794ebb3ba
chore: Slack -> GitHub discussions (#10139) 2021-11-11 12:25:24 +01:00
Andrey Lushnikov
7af0dc178b
devops: support beta deployment for Trace viewer (#10201)
Trace Viewer will have 3 deployments:
- Stable: https://trace.playwright.dev
- Beta (from release branch): https://trace.playwright.dev/beta
- Next (from master branch): https://trace.playwright.dev/next
2021-11-09 17:21:51 -08:00
Andrey Lushnikov
56521e2a49
chore: remove vtest bot (#10202)
Visual regression tests did not survive a week and got merged back.
Remove the bot since there are no tests to run.
2021-11-09 17:15:16 -08:00
Andrey Lushnikov
12c1716fcc
chore: move to a new docker publishing (#10169) 2021-11-09 15:58:18 -08:00
Max Schmitt
3d18b67ce8 devops: follow-up on Trace Viewer deployment (#10154) 2021-11-09 00:53:48 +01:00
Max Schmitt
51910b7a01
devops: add Trace Viewer deployment (#10154) 2021-11-09 00:27:54 +01:00
Max Schmitt
82ec09fc55 chore: fix create-playwright builds (#10083 follow-up) 2021-11-08 23:31:41 +01:00
Max Schmitt
4b37990f9c
devops: use NPM 8 (#10083) 2021-11-08 23:06:03 +01:00
Andrey Lushnikov
7f1d6e4c16
devops: do not build Chromium with symbols for every commit (#10103)
Wastes a lot of compute for the thing we barely use.
2021-11-05 17:29:24 -07:00
Max Schmitt
95a5c5cb79
chore(create-playwright): make it Node.js 12 compatible (#10081) 2021-11-05 17:30:18 +01:00
Max Schmitt
b177e6450a
devops: make vrt CI pipeline faster (#10082) 2021-11-05 12:16:39 +01:00
Max Schmitt
583944f43e
devops: fix client side changes bot after monorepo (#10025) 2021-11-03 23:34:57 +01:00