Closed Bug 360998 Opened 18 years ago Closed 18 years ago

run w3c DOM suites for automated test coverage

Categories

(Core :: DOM: Core & HTML, defect)

defect
Not set
normal

Tracking

()

VERIFIED FIXED
mozilla1.9alpha3

People

(Reporter: sayrer, Assigned: sayrer)

References

Details

Attachments

(2 files, 3 obsolete files)

They store their tests in an XML format, and then transform it. We'll need to adapt their XSLT to produce tests that we can run in mochikit, instead of whatever JS lib they use.
Attached file test-to-mochikit.xslt (obsolete) (deleted) —
quick and dirty version that gets some Level 1 Core stuff working.
Assignee: general → sayrer
Status: NEW → ASSIGNED
Attachment #248628 - Attachment is patch: false
Attached patch new and improved (obsolete) (deleted) — Splinter Review
Attachment #248628 - Attachment is obsolete: true
I'm all for dropping the use of JsUnit in the DOM tests and transforming the raw XML test descriptions into something else, but if you are keeping JsUnit etc what benefit do you get from mochikit?
I need to attach some more files. I deleted half of DOMTestCase.js and wrote some shims that map assertEquals and friends to the MochiKit stuff. This means all the JSUnit-esque assertions go through the MochiKit logger (and thus out to files, stdio, etc).
Attachment #248680 - Attachment is obsolete: true
this patch doesn't include all of the generated test files, but there are enough there to get the idea. The exclusions.js file converts failing tests to todo() calls in the named files. Most of the ones we fail are DTD-related, but there are others.
Attachment #253212 - Attachment is obsolete: true
Attachment #253214 - Flags: review?(jst)
Comment on attachment 253214 [details] [diff] [review] generate MochiKit from W3C dom-level1-core tests Seems like Bob would be a more appropriate reviewer for this. I'll happily sr if there's a need for that here.
Attachment #253214 - Flags: review?(jst) → review?(bclary)
Attached file bz2 of patch (deleted) —
following up comment 3: The patch takes the approach of taking the output of the W3C DOM Test Suite build process, modifying the resulting html files to use a modified version of the DOMTestCase.js with mochikit replacing JsUnit. The result is a static set of pages forked from the W3C DOM Test Suite that contains code that is copyright W3C and licensed under the W3C license. I'm not particularly in love with the W3C DOM Test Suite or JsUnit, but I don't see the major benefit in going down this path. I do have the means to run the output of the W3C DOM Test Suite build process automatically and to either generate the test results as text files or by submitting the individual test results to a web service. As soon as we can get more of the buildbot infrastructure deployed, it will be relatively easy to execute the suite and collect the results. If mochikit is desired, I would think that we could standardize on using it for our new mozilla.org dom tests and leave the W3C DOM Test Suite as is. If we must replace JsUnit, then we should take the approach that the W3C DOM Test Suite build process uses which is taking the raw xml format description of the testcases and transform them into mochikit based tests. This would alleviate any issue of forking or checking in W3C copyrighted materials into CVS. Just my opinion.
Requirements: * no dependencies other than what is already required by our build system * must be runnable by developers with that setup * must report to the console * must run automated I am not going to get involved with JsUnit, so anyone who wants to use that should assign this bug to themselves.
Summary: convert w3c DOM suite to mochikit → run w3c DOM suites for automated test coverage
Assignee: sayrer → general
Status: ASSIGNED → NEW
oops, forgot one requirement: * we don't pass all of the DOM suite, and it's unlikely we ever will, so the harness must have a facility for "todo" or "expected fail".
ignore me, do whatever you want.
Attachment #253214 - Flags: review?(bclary) → review?(rcampbell)
Comment on attachment 253214 [details] [diff] [review] generate MochiKit from W3C dom-level1-core tests let's hook it up and try it.
Attachment #253214 - Flags: review?(rcampbell) → review+
Status: NEW → RESOLVED
Closed: 18 years ago
OS: Mac OS X → All
Hardware: PC → All
Resolution: --- → FIXED
Target Milestone: --- → mozilla1.9alpha3
Depends on: 483992
Assignee: general → sayrer
QA Contact: ian → general
Status: RESOLVED → VERIFIED
Component: DOM → DOM: Core & HTML
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: