canmove, Confirmed users, Bureaucrats and Sysops emeriti
3,627
edits
TestEngineering/Performance/Talos/Tests: Difference between revisions
Jump to navigation
Jump to search
TestEngineering/Performance/Talos/Tests (view source)
Revision as of 09:59, 20 February 2020
, 20 February 2020→xperf: Add some notes about current xperf issues.
(→motionmark_webgl: Add motionmark_webgl info for test added by bug 1615871) |
(→xperf: Add some notes about current xperf issues.) |
||
| Line 1,281: | Line 1,281: | ||
* Did you change the dimensions of the content area? Even a little? The tsvgx test seems to be sensitive to changes like this. See {{bug|1375479}}, for example. Usually, these sorts of "regressions" aren't real regressions - they just mean that we need to re-baseline our expectations from the test. | * Did you change the dimensions of the content area? Even a little? The tsvgx test seems to be sensitive to changes like this. See {{bug|1375479}}, for example. Usually, these sorts of "regressions" aren't real regressions - they just mean that we need to re-baseline our expectations from the test. | ||
== xperf == | == xperf (tp5n) == | ||
* contact: :aklotz | * contact: :aklotz | ||
* source: [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/xtalos xperf instrumentation] | * source: [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/xtalos xperf instrumentation] | ||
| Line 1,312: | Line 1,312: | ||
The values we collect during stackwalk are: | The values we collect during stackwalk are: | ||
* [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/xperf.config#l11 'FileRead', 'FileWrite', 'FileFlush'] | * [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/xperf.config#l11 'FileRead', 'FileWrite', 'FileFlush'] | ||
Notes: | |||
* Currently some runs may [https://bugzilla.mozilla.org/show_bug.cgi?id=1614805 return all-zeros and skew the results] | |||
* Additionally, these runs don't have dedicated hardware and have a large variability. At least 30 runs are likely to be needed to get stable statistics (xref [https://bugzilla.mozilla.org/show_bug.cgi?id=1616236 bug 1616236]) | |||
= Build metrics = | = Build metrics = | ||