1514425 - Intermittent dom/payments/test/test_constructor.html | paymentMethods' length should be 1.

Reporter

Description

•

6 years ago

treeherder

Filed by: aciure [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=217135173&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/RKpq-nZzQeqr2jt-h61kcA/runs/0/artifacts/public/logs/live_backing.log

[task 2018-12-15T00:31:22.543Z] 00:31:22     INFO - TEST-PASS | dom/payments/test/test_constructor.html | PaymentRequest should be created 
[task 2018-12-15T00:31:22.544Z] 00:31:22     INFO - Buffered messages finished
[task 2018-12-15T00:31:22.544Z] 00:31:22     INFO - TEST-UNEXPECTED-FAIL | dom/payments/test/test_constructor.html | paymentMethods' length should be 1. 
[task 2018-12-15T00:31:22.545Z] 00:31:22     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:275:7
[task 2018-12-15T00:31:22.545Z] 00:31:22     INFO - testFailHandler@https://example.com/tests/dom/payments/test/test_constructor.html:20:5
[task 2018-12-15T00:31:22.546Z] 00:31:22     INFO - Async*@https://example.com/tests/dom/payments/test/test_constructor.html:17:17
[task 2018-12-15T00:31:22.547Z] 00:31:22     INFO - Not taking screenshot here: see the one that was previously logged
[task 2018-12-15T00:31:22.547Z] 00:31:22     INFO - TEST-UNEXPECTED-FAIL | dom/payments/test/test_constructor.html | methodData.data should not exist. 
[task 2018-12-15T00:31:22.548Z] 00:31:22     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:275:7
[task 2018-12-15T00:31:22.550Z] 00:31:22     INFO - testFailHandler@https://example.com/tests/dom/payments/test/test_constructor.html:20:5
[task 2018-12-15T00:31:22.551Z] 00:31:22     INFO - Async*@https://example.com/tests/dom/payments/test/test_constructor.html:17:17
[task 2018-12-15T00:31:22.552Z] 00:31:22     INFO - TEST-PASS | dom/payments/test/test_constructor.html | PaymentRequest should be created

Comment hidden (Intermittent Failures Robot)

25 failures in 156 pushes (0.16 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-central: 4
* try: 3
* mozilla-inbound: 9
* autoland: 9

Platform breakdown:
* linux32: 1
* linux64: 22
* windows10-64: 1
* windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1514425&startday=2018-12-15&endday=2018-12-15&tree=all

Cosmin Sabou [:CosminS]

Comment 2

•

6 years ago

This started after Bug 1497219 landed here http://tinyurl.com/y9a2jdjp. Eden please take a look over this. Thank you.

Flags: needinfo?(echuang)

Whiteboard: [retriggered]

Comment hidden (Intermittent Failures Robot)

43 failures in 2485 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #36 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* try: 3
* autoland: 12
* mozilla-inbound: 18
* mozilla-central: 10

Platform breakdown:
* windows10-64-qr: 2
* linux64: 33
* linux32: 4
* windows10-64: 3
* macosx64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1514425&startday=2018-12-10&endday=2018-12-16&tree=all

Comment hidden (Intermittent Failures Robot)

48 failures in 476 pushes (0.101 failures/push) were associated with this bug yesterday.

Repository breakdown:
* autoland: 23
* mozilla-central: 7
* mozilla-inbound: 14
* try: 4

Platform breakdown:
* linux64-qr: 3
* osx-10-10: 7
* linux32-nightly: 1
* windows10-64: 3
* linux32: 6
* linux64: 28

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1514425&startday=2018-12-17&endday=2018-12-17&tree=all

Comment hidden (Intermittent Failures Robot)

28 failures in 505 pushes (0.055 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-central: 4
* try: 3
* autoland: 12
* mozilla-inbound: 9

Platform breakdown:
* linux64: 18
* linux32-nightly: 1
* linux32: 6
* osx-10-10: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1514425&startday=2018-12-18&endday=2018-12-18&tree=all

Comment hidden (Intermittent Failures Robot)

38 failures in 479 pushes (0.079 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* try: 6
* mozilla-central: 5
* autoland: 18
* mozilla-inbound: 9

Platform breakdown:
* linux64: 28
* windows10-64: 1
* linux32: 3
* osx-10-10: 4
* macosx64-nightly: 1
* linux64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1514425&startday=2018-12-19&endday=2018-12-19&tree=all

Eliza Balazs [:ebalazs_]

Comment 7

•

6 years ago

Attached patch Skipped test on linux (deleted) — Details — Splinter Review

Created a patch to disable this on linux.

Attachment #9032671 - Flags: review?(jmaher)

Joel Maher ( :jmaher ) (UTC -8)

Updated

•

6 years ago

Attachment #9032671 - Flags: review?(jmaher) → review+

Joel Maher ( :jmaher ) (UTC -8)

Updated

•

6 years ago

Keywords: checkin-needed, leave-open

Whiteboard: [retriggered][stockwell disable-recommended] → [retriggered][stockwell disabled]

Pulsebot

Comment 8

•

6 years ago

Pushed by ebalazs@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/0b4364c5795d
Disable test_constructor.html on linux for frequent failures. r=jmaher

Keywords: checkin-needed

Narcis Beleuzu [:NarcisB]

Comment 9

•

6 years ago

bugherder

https://hg.mozilla.org/mozilla-central/rev/0b4364c5795d

Comment hidden (Intermittent Failures Robot)

16 failures in 441 pushes (0.036 failures/push) were associated with this bug yesterday.

Repository breakdown:
* mozilla-central: 5
* try: 1
* mozilla-inbound: 1
* autoland: 9

Platform breakdown:
* linux64: 7
* windows10-64-qr: 2
* windows10-64: 1
* osx-10-10: 3
* linux64-nightly: 1
* linux32: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1514425&startday=2018-12-20&endday=2018-12-20&tree=all

Comment hidden (Intermittent Failures Robot)

145 failures in 2648 pushes (0.055 failures/push) were associated with this bug in the last 7 days.

This is the #7 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. ** 

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-central: 25
* try: 19
* mozilla-inbound: 34
* autoland: 67

Platform breakdown:
* windows10-64: 8
* windows10-64-qr: 3
* linux64-qr: 4
* linux32: 17
* linux64: 85
* osx-10-10: 21
* linux32-nightly: 2
* linux64-nightly: 2
* macosx64-nightly: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1514425&startday=2018-12-17&endday=2018-12-23&tree=all

Raul Gurzau (:RaulG)

Comment 12

•

6 years ago

There are 31 failures for this nug in the past 7 days. Affected platforms are osx-10-10 and windows10-64

Recent log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=219156354&repo=mozilla-inbound&lineNumber=7937

15:07:40     INFO - TEST-START | dom/payments/test/test_constructor.html
15:07:40     INFO - TEST-INFO | started process screencapture
15:07:40     INFO - TEST-INFO | screencapture: exit 0
15:07:40     INFO - Buffered messages logged at 15:07:40
15:07:40     INFO - TEST-PASS | dom/payments/test/test_constructor.html | PaymentRequest should be created 
15:07:40     INFO - Buffered messages finished
15:07:40     INFO - TEST-UNEXPECTED-FAIL | dom/payments/test/test_constructor.html | paymentMethods' length should be 1. 
15:07:40     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:275:7
15:07:40     INFO - testFailHandler@https://example.com/tests/dom/payments/test/test_constructor.html:20:5
15:07:40     INFO - Async*@https://example.com/tests/dom/payments/test/test_constructor.html:17:17
15:07:40     INFO - Not taking screenshot here: see the one that was previously logged
15:07:40     INFO - TEST-UNEXPECTED-FAIL | dom/payments/test/test_constructor.html | methodData.data should not exist. 
15:07:40     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:275:7
15:07:40     INFO - testFailHandler@https://example.com/tests/dom/payments/test/test_constructor.html:20:5
15:07:40     INFO - Async*@https://example.com/tests/dom/payments/test/test_constructor.html:17:17

Comment hidden (Intermittent Failures Robot)

37 failures in 1008 pushes (0.037 failures/push) were associated with this bug in the last 7 days.

This is the #10 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-inbound: 14
* autoland: 17
* mozilla-central: 5
* try: 1

Platform breakdown:
* osx-10-10: 14
* windows10-64-qr: 2
* windows10-64: 21

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1514425&startday=2018-12-24&endday=2018-12-30&tree=all

Cosmin Sabou [:CosminS]

Comment 14

•

6 years ago

Attached patch Disable on win and osx (deleted) — Details — Splinter Review

Hi! This was skipped on Linux but looking at the failure rate after that I think it needs to be skipped also on win10 and osx and I've made a patch for this. Thanks.

Assignee: nobody → csabou

Attachment #9034614 - Flags: review?(jmaher)

Joel Maher ( :jmaher ) (UTC -8)

Updated

•

6 years ago

Attachment #9034614 - Flags: review?(jmaher) → review+

Joel Maher ( :jmaher ) (UTC -8)

Updated

•

6 years ago

Keywords: checkin-needed

Pulsebot

Comment 15

•

6 years ago

Pushed by csabou@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/a1f680c69689
Disable dom/payments/test/test_constructor.html on win and osx for frequent failures. r=jmaher

Keywords: checkin-needed

Cosmin Sabou [:CosminS]

Updated

•

6 years ago

Assignee: csabou → nobody

Comment hidden (Intermittent Failures Robot)

35 failures in 1668 pushes (0.021 failures/push) were associated with this bug in the last 7 days.

This is the #19 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* try: 9
* mozilla-inbound: 9
* autoland: 10
* mozilla-central: 7

Platform breakdown:
* windows10-64-qr: 2
* osx-10-10: 17
* windows10-64: 13
* windows7-32: 2
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1514425&startday=2018-12-31&endday=2019-01-06&tree=all

Cristian Brindusan [:cbrindusan]

Comment 17

•

6 years ago

bugherder

https://hg.mozilla.org/mozilla-central/rev/a1f680c69689

Comment hidden (Intermittent Failures Robot)

Andreea Pavel [:apavel]

Comment 22

•

6 years ago

There are 26 total failures in the last 7 days on windows7-32-shippable opt and windows7-32 pgo

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=237089085&repo=autoland&lineNumber=5561

05:15:40 INFO - TEST-START | dom/payments/test/test_constructor.html
05:15:40 INFO - TEST-INFO | started process screenshot
05:15:40 INFO - TEST-INFO | screenshot: exit 0
05:15:40 INFO - Buffered messages logged at 05:15:40
05:15:40 INFO - TEST-PASS | dom/payments/test/test_constructor.html | PaymentRequest should be created
05:15:40 INFO - Buffered messages finished
05:15:40 INFO - TEST-UNEXPECTED-FAIL | dom/payments/test/test_constructor.html | paymentMethods' length should be 1.
05:15:40 INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:275:18
05:15:40 INFO - testFailHandler@https://example.com/tests/dom/payments/test/test_constructor.html:20:5
05:15:40 INFO - Async*@https://example.com/tests/dom/payments/test/test_constructor.html:17:31
05:15:40 INFO - Not taking screenshot here: see the one that was previously logged
05:15:40 INFO - TEST-UNEXPECTED-FAIL | dom/payments/test/test_constructor.html | methodData.data should not exist.
05:15:40 INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:275:18
05:15:40 INFO - testFailHandler@https://example.com/tests/dom/payments/test/test_constructor.html:20:5
05:15:40 INFO - Async*@https://example.com/tests/dom/payments/test/test_constructor.html:17:31
05:15:40 INFO - TEST-PASS | dom/payments/test/test_constructor.html | PaymentRequest should be created

Eden are you still working on this?

Flags: needinfo?(echuang)

Andreea Pavel [:apavel]

Updated

•

6 years ago

Flags: needinfo?(echuang)

Whiteboard: [retriggered][stockwell disabled] → [retriggered][stockwell needswork:owner]

Comment hidden (Intermittent Failures Robot)

Razvan Maries

Comment 26

•

6 years ago

There are 27 total failures in the last 7 days on windows7-32-shippable opt and windows7-32 debug and opt.

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=241677318&repo=autoland&lineNumber=5364

08:22:43 INFO - TEST-START | dom/payments/test/test_constructor.html
08:22:43 INFO - TEST-INFO | started process screenshot
08:22:43 INFO - TEST-INFO | screenshot: exit 0
08:22:43 INFO - Buffered messages logged at 08:22:43
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | PaymentRequest should be created
08:22:43 INFO - Buffered messages finished
08:22:43 INFO - TEST-UNEXPECTED-FAIL | dom/payments/test/test_constructor.html | paymentMethods' length should be 1.
08:22:43 INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:275:18
08:22:43 INFO - testFailHandler@https://example.com/tests/dom/payments/test/test_constructor.html:20:5
08:22:43 INFO - Async*@https://example.com/tests/dom/payments/test/test_constructor.html:17:31
08:22:43 INFO - Not taking screenshot here: see the one that was previously logged
08:22:43 INFO - TEST-UNEXPECTED-FAIL | dom/payments/test/test_constructor.html | methodData.data should not exist.
08:22:43 INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:275:18
08:22:43 INFO - testFailHandler@https://example.com/tests/dom/payments/test/test_constructor.html:20:5
08:22:43 INFO - Async*@https://example.com/tests/dom/payments/test/test_constructor.html:17:31
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | PaymentRequest should be created
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | PaymentRequest should be created
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | Expected 'TypeError' with duplicate shippingOption Ids.
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | PaymentRequest with complex parameters should be created
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | PaymentRequest with simplest parameters should be created
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | Expected 'successful', but got 'successful'
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | PaymentRequest should be created
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | request.shippingOption should be null in default, when options.requestShipping is false
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | PaymentRequest should be created
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | request.shippingOption should be null in default, when options.requestShipping is false
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | PaymentRequest should be created
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | request.shippingOption should not be null when both shoppingOtpion.selected and options.requestOptions are true
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | request.shippingOption should be 'option1'
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | PaymentRequest should be created
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | request.shippingOption should not be null when both shoppingOtpion.selected and options.requestOptions are true
08:22:43 INFO - TEST-PASS | dom/payments/test/test_constructor.html | request.shippingOption should be 'option2' which is the last one selected.
08:22:43 INFO - GECKO(4968) | MEMORY STAT | vsize 451MB | vsizeMaxContiguous 1011MB | residentFast 65MB | heapAllocated 7MB
08:22:43 INFO - TEST-OK | dom/payments/test/test_constructor.html | took 110ms

Andrew, could you please assign this to someone?

Flags: needinfo?(echuang)

Razvan Maries

Updated

•

6 years ago

Flags: needinfo?(overholt)

Comment hidden (Intermittent Failures Robot)

Andrew Overholt [:overholt]

Comment 28

•

6 years ago

We're not shipping Web Payments right now so I expect tests to regress. Can we ignore this directory?

Flags: needinfo?(overholt)

Joel Maher ( :jmaher ) (UTC -8)

Comment 29

•

6 years ago

Attached file Bug 1514425 - disable webpayment tests as we do not currently ship this feature. r=overholt (deleted) — Details

disable webpayment tests as we do not currently ship this feature

Comment hidden (Intermittent Failures Robot)

Joel Maher ( :jmaher ) (UTC -8)

Updated

•

5 years ago

Assignee: nobody → jmaher

Joel Maher ( :jmaher ) (UTC -8)

Comment 31

•

5 years ago

Eden, I am waiting for your review to disable these tests, can you take a look at it this week?

Flags: needinfo?(echuang)

Pulsebot

Comment 32

•

5 years ago

Pushed by jmaher@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/e607a590c53c
disable webpayment tests as we do not currently ship this feature. r=marcosc,edenchuang

Arthur Iakab [arthur_iakab]

Comment 33

•

5 years ago

bugherder

https://hg.mozilla.org/mozilla-central/rev/e607a590c53c

Comment hidden (Intermittent Failures Robot)

Eden Chuang[:edenchuang]

Updated

•

5 years ago

Flags: needinfo?(echuang)

Jens Stutte [:jstutte]

Comment 36

•

5 years ago

Can I assume, that the remaining two patches are not needed anymore then? Such that we can close this bug?

Flags: needinfo?(echuang)

Eden Chuang[:edenchuang]

Comment 37

•

5 years ago

The patch only disables the tests, it doesn't mean the bug is fixed.
I'd like to keep the bug open with low priority and set the assignee to nobody.
Keeping the bug open, and we can know the issue when we focus back on Web Payment project.

Assignee: jmaher → nobody

Flags: needinfo?(echuang)

Jens Stutte [:jstutte]

Updated

•

3 years ago

Whiteboard: [retriggered][stockwell unknown] → [retriggered][stockwell disabled]

BMO Automation

Updated

•

2 years ago

Severity: normal → S3

Skipped test on linux 6 years ago Eliza Balazs [:ebalazs_] (deleted), patch	jmaher : review+	Details \| Diff \| Splinter Review
Disable on win and osx 6 years ago Cosmin Sabou [:CosminS] (deleted), patch	jmaher : review+	Details \| Diff \| Splinter Review
Bug 1514425 - disable webpayment tests as we do not currently ship this feature. r=overholt 6 years ago Joel Maher ( :jmaher ) (UTC -8) (deleted), text/x-phabricator-request		Details