Closed Bug 808783 Opened 12 years ago Closed 12 years ago

Get green set of Mn tests running on cedar so we can get them going on m-c

Categories

(Remote Protocol :: Marionette, defect)

Product:
Remote Protocol
Component:
Marionette
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(firefox18 fixed, firefox19 fixed)

Status:
RESOLVED FIXED
Milestone:
mozilla19
Tracking Flags:
Tracking Status
firefox18 --- fixed
firefox19 --- fixed

People

(Reporter: ahal, Assigned: ahal)

References

Details

Attachments

(4 files, 2 obsolete files)

[checked in] Patch 2.0 - Disable tests and update marionette's manifest parser
(deleted), patch
jgriffin
: review+
Details | Diff | Splinter Review
[checked in] Another patch for 808783
(deleted), patch
ahal
: review+
Details | Diff | Splinter Review
[checked in] Nov15 patch for 808783
(deleted), patch
ahal
: review+
Details | Diff | Splinter Review
[checked in] Patch to disable remaining WebTelepony tests
(deleted), patch
ahal
: review+
Details | Diff | Splinter Review
We've had Mn tests running on cedar for quite some time. There are still some random oranges. We should try to get them green, or failing that just get a small subset of them running on m-c https://tbpl.mozilla.org/?tree=Cedar
Attached patch Patch for 808783 (obsolete) (deleted) — — Splinter Review
Disabling three tests that are consistently failing or random orange.
Attachment #678468 - Flags: review?(ahalberstadt)
Comment on attachment 678468 [details] [diff] [review] Patch for 808783 Review of attachment 678468 [details] [diff] [review]: ----------------------------------------------------------------- Thanks! I'll get this landed on cedar.
Attachment #678468 - Flags: review?(ahalberstadt) → review+
Green!
Attached patch Patch 1.0 - Disable failing marionette tests (obsolete) (deleted) — — Splinter Review
Unfortunately I re-trigged and an we had a new failure. This disables it and switches some of the manifests to use the "disabled = <reason>" format.
Attachment #678535 - Flags: review?(rwood)
Attachment #678468 - Attachment is obsolete: true
Comment on attachment 678535 [details] [diff] [review] Patch 1.0 - Disable failing marionette tests Looks good!
Attachment #678535 - Flags: review?(rwood) → review+
This also modifies marionette to honour the built-in 'disabled' attribute as opposed to 'skip'.
Attachment #678782 - Flags: review?(jgriffin)
Attachment #678535 - Attachment is obsolete: true
Comment on attachment 678782 [details] [diff] [review] [checked in] Patch 2.0 - Disable tests and update marionette's manifest parser Review of attachment 678782 [details] [diff] [review]: ----------------------------------------------------------------- Looks good. Do we need to try this on cedar before landing?
Attachment #678782 - Flags: review?(jgriffin) → review+
https://hg.mozilla.org/integration/mozilla-inbound/rev/a22328aa1130
Assignee: nobody → ahalberstadt
Target Milestone: --- → mozilla19
https://hg.mozilla.org/mozilla-central/rev/a22328aa1130
Status: NEW → RESOLVED
Closed: 12 years ago
Resolution: --- → FIXED
Reopening as another random orange is showing up in the telephony tests, causing the emulator to crash. Must disable another telephony test.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Disabling test_incoming_answer_hangup.js as sometimes it also causes the emulator to crash.
Attachment #680642 - Flags: review?(ahalberstadt)
Comment on attachment 680642 [details] [diff] [review] [checked in] Another patch for 808783 Review of attachment 680642 [details] [diff] [review]: ----------------------------------------------------------------- Lgtm
Attachment #680642 - Flags: review?(ahalberstadt) → review+
Whiteboard: [automation-needed-in-aurora]
https://hg.mozilla.org/mozilla-central/rev/3052145ed25c
Status: REOPENED → RESOLVED
Closed: 12 years ago → 12 years ago
Resolution: --- → FIXED
Reopening as test_incoming_reject.js is now randomorange and causing the emulator to crash. Will attach patch to disable that test also.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Attachment #682107 - Flags: review?(ahalberstadt)
Attachment #682107 - Flags: review?(ahalberstadt) → review+
Keywords: checkin-needed
Attachment #678782 - Attachment description: Patch 2.0 - Disable tests and update marionette's manifest parser → [checked in] Patch 2.0 - Disable tests and update marionette's manifest parser
Attachment #680642 - Attachment description: Another patch for 808783 → [checked in] Another patch for 808783
Attachment #682107 - Attachment description: Nov15 patch for 808783 → [checked in] Nov15 patch for 808783
https://hg.mozilla.org/mozilla-central/rev/c794e4ef27fc
Status: REOPENED → RESOLVED
Closed: 12 years ago → 12 years ago
Resolution: --- → FIXED
After disabling test_incoming_reject.js, the very next telephony test in the list caused the emulator to crash. Therefore reopening this issue yet again. This time I will make a patch to disable all remaining WebTelephony tests until the issue (Bug 811167) is resolved.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Attachment #682569 - Flags: review?(ahalberstadt) → review+
Keywords: checkin-needed
Comment on attachment 682569 [details] [diff] [review] [checked in] Patch to disable remaining WebTelepony tests (In reply to Ryan VanderMeulen from comment #25) > https://hg.mozilla.org/integration/mozilla-inbound/rev/212ebdca04a8 https://hg.mozilla.org/releases/mozilla-aurora/rev/df5ab2adf761
Attachment #682569 - Attachment description: Patch to disable remaining WebTelepony tests → [checked in] Patch to disable remaining WebTelepony tests
https://hg.mozilla.org/mozilla-central/rev/212ebdca04a8
Status: REOPENED → RESOLVED
Closed: 12 years ago → 12 years ago
Resolution: --- → FIXED
Product: Testing → Remote Protocol
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: