feat: implement a new image comparison function (#19166)
This patch implements a new image comparison function, codenamed
"ssim-cie94". The goal of the new comparison function is to cancel out
browser non-determenistic rendering.
To use the new comparison function:
```ts
await expect(page).toHaveScreenshot({
comparator: 'ssim-cie94',
});
```
As of Nov 30, 2022, we identified the following sources of
non-determenistic rendering for Chromium:
- Anti-aliasing for certain shapes might be different due to the
way skia rasterizes certain shapes.
- Color blending might be different on `x86` and `aarch64`
architectures.
The new function employs a few heuristics to fight these
differences.
Consider two non-equal image pixels `(r1, g1, b1)` and `(r2, g2, b2)`:
1. If the [CIE94] metric is less then 1.0, then we consider these pixels
**EQUAL**. (The value `1.0` is the [just-noticeable difference] for
[CIE94].). Otherwise, proceed to next step.
1. If all the 8 neighbors of the first pixel match its color, or
if the 8 neighbors of the second pixel match its color, then these
pixels are **DIFFERENT**. (In case of anti-aliasing, some of the
direct neighbors have to be blended up or down.) Otherwise, proceed
to next step.
1. If SSIM in some locality around the different pixels is more than
0.99, then consider this pixels to be **EQUAL**. Otherwise, mark them
as **DIFFERENT**. (Local SSIM for anti-aliased pixels turns out to be
very close to 1.0).
[CIE94]: https://en.wikipedia.org/wiki/Color_difference#CIE94
[just-noticeable difference]:
https://en.wikipedia.org/wiki/Just-noticeable_difference
2022-12-03 02:22:05 +03:00
|
|
|
/**
|
|
|
|
* Copyright (c) Microsoft Corporation.
|
|
|
|
*
|
|
|
|
* Licensed under the Apache License, Version 2.0 (the "License");
|
|
|
|
* you may not use this file except in compliance with the License.
|
|
|
|
* You may obtain a copy of the License at
|
|
|
|
*
|
|
|
|
* http://www.apache.org/licenses/LICENSE-2.0
|
|
|
|
*
|
|
|
|
* Unless required by applicable law or agreed to in writing, software
|
|
|
|
* distributed under the License is distributed on an "AS IS" BASIS,
|
|
|
|
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
|
|
* See the License for the specific language governing permissions and
|
|
|
|
* limitations under the License.
|
|
|
|
*/
|
|
|
|
|
|
|
|
import { PNG } from 'playwright-core/lib/utilsBundle';
|
|
|
|
import { ImageChannel } from 'playwright-core/lib/image_tools/imageChannel';
|
|
|
|
|
|
|
|
// mulberry32
|
|
|
|
export function createRandom(seed) {
|
|
|
|
return function() {
|
|
|
|
let t = seed += 0x6D2B79F5;
|
|
|
|
t = Math.imul(t ^ t >>> 15, t | 1);
|
|
|
|
t ^= t + Math.imul(t ^ t >>> 7, t | 61);
|
|
|
|
return ((t ^ t >>> 14) >>> 0) / 4294967296;
|
|
|
|
};
|
|
|
|
}
|
|
|
|
|
|
|
|
export function randomPNG(width, height, seed) {
|
|
|
|
const random = createRandom(seed);
|
|
|
|
const png = new PNG({ width, height });
|
|
|
|
for (let i = 0; i < height; ++i) {
|
|
|
|
for (let j = 0; j < width; ++j) {
|
|
|
|
for (let k = 0; k < 4; ++k)
|
|
|
|
png.data[(i * width + j) * 4 + k] = (random() * 255) | 0;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
return png;
|
|
|
|
}
|
|
|
|
|
|
|
|
export function assertEqual(value1, value2) {
|
|
|
|
if (Math.abs(value1 - value2) >= 1e-3)
|
|
|
|
throw new Error(`ERROR: ${value1} is not equal to ${value2}`);
|
|
|
|
}
|
|
|
|
|
|
|
|
// NOTE: this is exact formula from SSIM.js and it DOES NOT include alpha.
|
|
|
|
// We use it to better compare with original SSIM implementation.
|
2023-10-17 21:52:41 +03:00
|
|
|
export function grayChannel(image: any) {
|
feat: implement a new image comparison function (#19166)
This patch implements a new image comparison function, codenamed
"ssim-cie94". The goal of the new comparison function is to cancel out
browser non-determenistic rendering.
To use the new comparison function:
```ts
await expect(page).toHaveScreenshot({
comparator: 'ssim-cie94',
});
```
As of Nov 30, 2022, we identified the following sources of
non-determenistic rendering for Chromium:
- Anti-aliasing for certain shapes might be different due to the
way skia rasterizes certain shapes.
- Color blending might be different on `x86` and `aarch64`
architectures.
The new function employs a few heuristics to fight these
differences.
Consider two non-equal image pixels `(r1, g1, b1)` and `(r2, g2, b2)`:
1. If the [CIE94] metric is less then 1.0, then we consider these pixels
**EQUAL**. (The value `1.0` is the [just-noticeable difference] for
[CIE94].). Otherwise, proceed to next step.
1. If all the 8 neighbors of the first pixel match its color, or
if the 8 neighbors of the second pixel match its color, then these
pixels are **DIFFERENT**. (In case of anti-aliasing, some of the
direct neighbors have to be blended up or down.) Otherwise, proceed
to next step.
1. If SSIM in some locality around the different pixels is more than
0.99, then consider this pixels to be **EQUAL**. Otherwise, mark them
as **DIFFERENT**. (Local SSIM for anti-aliased pixels turns out to be
very close to 1.0).
[CIE94]: https://en.wikipedia.org/wiki/Color_difference#CIE94
[just-noticeable difference]:
https://en.wikipedia.org/wiki/Just-noticeable_difference
2022-12-03 02:22:05 +03:00
|
|
|
const width = image.width;
|
|
|
|
const height = image.height;
|
|
|
|
const gray = new Uint8Array(image.width * image.height);
|
|
|
|
for (let y = 0; y < image.height; ++y) {
|
|
|
|
for (let x = 0; x < image.width; ++x) {
|
|
|
|
const index = y * image.width + x;
|
|
|
|
const offset = index * 4;
|
|
|
|
gray[index] = (77 * image.data[offset] + 150 * image.data[offset + 1] + 29 * image.data[offset + 2] + 128) >> 8;
|
|
|
|
}
|
|
|
|
}
|
|
|
|
return new ImageChannel(width, height, gray);
|
|
|
|
}
|