facebookarchive/prepack
1
1
Fork 0
mirror of https://github.com/facebookarchive/prepack.git synced 2024-10-26 15:20:18 +03:00
Code Issues Projects Releases Wiki Activity

Improve Test262 test runner

Browse Source 
Summary:
Two improvements:
1. The CI has 10340 ES6 tests passing so reflect the latest status in test runner.
2. Always show test failure groups summary even in success situation. This allows us to run the test locally and compare failure groups summary to the baseline summary in CI to find out which specific test group is failing. Saving much time in troubleshooting test failure!
Closes https://github.com/facebook/prepack/pull/820

Differential Revision: D5447438

Pulled By: yinghuitan

fbshipit-source-id: 87fa62693cb6e1365978e5cb635e3732fc2ded09
This commit is contained in:
Jeffrey Tan 2017-07-18 15:38:53 -07:00 committed by Facebook Github Bot
parent f85cb45201
commit 39ac78f3c5
1 changed files with 4 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
scripts/test262-runner.js
View File

@ -564,9 +564,11 @@ function handleFinished(args: MasterProgramArgs, groups: GroupsMap, earlierNumSk
if (errmsg) {
console.log(errmsg);
}
} else if (group_es5_failed + group_es6_failed > 0) {
}
if (group_es5_failed + group_es6_failed > 0) {
failed_groups.push(msg);
}
numPassedES5 += group_es5_passed;
numPassedES6 += group_es6_passed;
numFailedES5 += group_es5_failed;
@ -597,7 +599,7 @@ function handleFinished(args: MasterProgramArgs, groups: GroupsMap, earlierNumSk
}
// exit status
if (!args.filterString && (numPassedES5 < 22916 || numPassedES6 < 10336 || numTimeouts > 0)) {
if (!args.filterString && (numPassedES5 < 22916 || numPassedES6 < 10340 || numTimeouts > 0)) {
console.log(chalk.red("Overall failure. Expected more tests to pass!"));
return 1;
} else {