Closed Bug 1596942 Opened 5 years ago Closed 5 years ago

Improve wpt support in 'mach test-info report'

Categories

(Testing :: General, enhancement, P2)

Version 3
enhancement

Tracking

(Not tracked)

RESOLVED WONTFIX

People

(Reporter: gbrown, Assigned: gbrown)

References

(Blocks 1 open bug)

Details

Are disabled wpt tests reported as such?

Reports can be filtered by manifest annotations for manifestparser or reftest manifests, but what about wpt?

How are wpt tests reflected in a manifest report? Are they associated with components correctly? Are they/can they be broken down by directory?

Priority: -- → P2

'mach test-info tests <wpt-test>' works correctly and reports the manifest as _tests/web-platform/meta/MANIFEST.json. ActiveData records are found in an abbreviated directory, like '/webvr/webvr-disabled-by-feature-policy.https.sub.html'.

$ ./mach test-info report testing/web-platform/tests
Finding tests...
Resolver found 36252 tests, 1 manifests
{
"manifests": {},
"summary": {
"components": 63,
"failed tests": 0,
"manifests": 1,
"skipped tests": 0,
"tests": 36252
}
}
...so, no manifest summary for MANIFEST.json (but it would be boring anyway); and no skipped/failed info.

$ ./mach test-info report testing/web-platform/tests/webvr --show-tests
Finding tests...
Resolver found 7 tests, 1 manifests
{
"tests": {
"Core::DOM: WebVR": [
{
"test": "testing/web-platform/tests/webvr/idlharness.https.html"
},
{
"test": "testing/web-platform/tests/webvr/webvr-disabled-by-feature-policy.https.sub.html"
},
{
"test": "testing/web-platform/tests/webvr/webvr-enabled-by-feature-policy-attribute-redirect-on-load.https.sub.html"
},
{
"test": "testing/web-platform/tests/webvr/webvr-enabled-by-feature-policy-attribute.https.sub.html"
},
{
"test": "testing/web-platform/tests/webvr/webvr-enabled-by-feature-policy.https.sub.html"
},
{
"test": "testing/web-platform/tests/webvr/webvr-enabled-on-self-origin-by-feature-policy.https.sub.html"
},
{
"test": "testing/web-platform/tests/webvr/webvr-supported-by-feature-policy.html"
}
]
}
}

I'm reasonably happy with existing support and don't have specific ideas for how to improve this area.

Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.