Closed Bug 1459947 Opened 7 years ago Closed 7 years ago

Various webextension tests are going to permafail when the Gecko version number is bumped to 63 on 2018-06-25

Categories

(WebExtensions :: General, defect)

defect
Not set
major

Tracking

(firefox-esr52 unaffected, firefox-esr60 unaffected, firefox60 unaffected, firefox61 unaffected, firefox62+ verified)

VERIFIED FIXED
mozilla62
Tracking Status
firefox-esr52 --- unaffected
firefox-esr60 --- unaffected
firefox60 --- unaffected
firefox61 --- unaffected
firefox62 + verified

People

(Reporter: aryx, Assigned: rpl)

References

Details

(Keywords: regression)

Version increase simulation: https://treeherder.mozilla.org/#/jobs?repo=try&revision=67f7a605b345437aa7e33d58076cf6b5ac7069ae&filter-resultStatus=testfailed&filter-resultStatus=busted&filter-resultStatus=exception&filter-resultStatus=retry&filter-resultStatus=usercancel&filter-resultStatus=runnable&selectedJob=177472940 toolkit/components/extensions/test/xpcshell/test_ext_background_telemetry.js fails because WEBEXT_BACKGROUND_PAGE_LOAD_MS expires: https://treeherder.mozilla.org/logviewer.html#?job_id=177472919&repo=try toolkit/components/extensions/test/mochitest/test_chrome_ext_contentscript_telemetry.html because of WEBEXT_CONTENT_SCRIPT_INJECTION_MS: https://treeherder.mozilla.org/logviewer.html#?job_id=177473075&repo=try browser/components/extensions/test/browser/test-oop-extensions/browser_ext_browserAction_telemetry.js because of WEBEXT_BROWSERACTION_POPUP_OPEN_MS: https://treeherder.mozilla.org/logviewer.html#?job_id=177472926&repo=try Check the list below from the last expiration bump (60 -> 63)- +++ This bug was initially created as a clone of Bug #1425957 +++ [Tracking Requested - why for this release]: Permafailing tests when the Gecko version number is bumped to 60. Looks like the probes these tests depend on are set to expire when Gecko hits 60: WEBEXT_BACKGROUND_PAGE_LOAD_MS WEBEXT_CONTENT_SCRIPT_INJECTION_MS WEBEXT_EXTENSION_STARTUP_MS WEBEXT_STORAGE_LOCAL_GET_MS WEBEXT_STORAGE_LOCAL_SET_MS Looks like there's some other expiring probes as well, but those are the ones causing test failures anyway. How do you want to proceed, Bob?
Flags: needinfo?(bob.silverberg)
Summary: Various webextension tests are going to permafail when the Gecko version number is bumped to 60 → Various webextension tests are going to permafail when the Gecko version number is bumped to 63
Summary: Various webextension tests are going to permafail when the Gecko version number is bumped to 63 → Various webextension tests are going to permafail when the Gecko version number is bumped to 63 on 2018-06-25
Bob isn't working on webextensions any more, Luca is handling telemetry now. I think this may just need to be dup'ed to bug 1452685.
Flags: needinfo?(bob.silverberg) → needinfo?(lgreco)
(In reply to Andrew Swan [:aswan] from comment #1) > Bob isn't working on webextensions any more, Luca is handling telemetry now. > I think this may just need to be dup'ed to bug 1452685. Yes, all the probes mentioned in comment 0 are the same that bug 1452685's patch is going to re-new.
Assignee: nobody → lgreco
Status: NEW → ASSIGNED
Depends on: 1452685
Flags: needinfo?(lgreco)
This should have been fixed by Bug 1452685, I'm closing it as fixed (but let me know / re-open it if on the next "version increase simulation" this issue is still reproducible).
Status: ASSIGNED → RESOLVED
Closed: 7 years ago
Flags: needinfo?(aryx.bugmail)
Resolution: --- → FIXED
Target Milestone: --- → mozilla62
These failures no longer appear on recent beta simulations.
Status: RESOLVED → VERIFIED
(In reply to Andreea Pavel [:apavel] from comment #4) > These failures no longer appear on recent beta simulations. Has this been verified with a version increase simulation?
Product: Toolkit → WebExtensions
(In reply to Sebastian Hengst [:aryx] (needinfo on intermittent or backout) from comment #6) > (In reply to Andreea Pavel [:apavel] from comment #4) > > These failures no longer appear on recent beta simulations. > Has this been verified with a version increase simulation? No, just by checking the latest 3/4 beta simulations. Can we take a look at it today?
Flags: needinfo?(apavel) → needinfo?(aryx.bugmail)
You need to log in before you can comment on or make changes to this bug.