This test intermittently fails on master and aurora with: Traceback (most recent call last): File "/var/jenkins/workspace/b2g.hamachi.mozilla-central.ui/.env/local/lib/python2.7/site-packages/marionette_client-0.7.2-py2.7.egg/marionette/marionette_test.py", line 143, in run testMethod() File "/var/jenkins/workspace/b2g.hamachi.mozilla-central.ui/tests/python/gaia-ui-tests/gaiatest/tests/functional/cost_control/test_cost_control_reset_wifi.py", line 52, in test_cost_control_reset_wifi self.wait_for_condition(lambda m: cost_control.wifi_data_usage_figure == u'0.00 B', message='Wifi usage did not reset back to 0.00 B') File "/var/jenkins/workspace/b2g.hamachi.mozilla-central.ui/tests/python/gaia-ui-tests/gaiatest/gaia_test.py", line 1087, in wait_for_condition raise TimeoutException(message) TimeoutException: Wifi usage did not reset back to 0.00 B

As you can see from the screenshot there is an insignificant traffic that is still there. Maybe, this happens because the browser is still opened in the background.

I think that we should also close the Browser before reseting

I started an adhoc job here http://qa-selenium.mv.mozilla.com:8080/view/B2G%20Hamachi/job/b2g.hamachi.mozilla-central.ui.adhoc/115

Comment on attachment 8363579 [details] Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/15597 The adhoc run looks ok :) I also ran the test with your fix and it passed.

Comment on attachment 8363579 [details] Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/15597 r+

Merged: https://github.com/mozilla-b2g/gaia/commit/1985ad0a96f19abc9174a2eed23a8e7808a628a2

Making this v1.3 affected

Comment on attachment 8366018 [details] Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/15733 Updated

I also started an adhoc job here: http://qa-selenium.mv.mozilla.com:8080/view/B2G%20Hamachi/job/b2g.hamachi.mozilla-aurora.ui.adhoc/12

Comment on attachment 8366018 [details] Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/15733 This fix doesn't seems to be a good idea. The adhoc run shows some fails in this test, I also ran it locally and I got fails too.

This is odd. The test from the PR passed 21/21 for me on my Inari with v1.3, but it seems to have a lot of difficulty passing on CI. Are you saying that the fix is good on master as well, but just not on v1.3? Do you have any idea why that is?

I'm going to try to dig into this a bit more to see why: a) it's passing on master and not on v1.3, and b) it's passing on my Inari but not on a Hamachi on CI I'll try testing locally on v1.3 with my Hamachi to see if I can reproduce the failure.

Thanks for looking into this! I can replicate this on v1.3 Hamachi, but I cannot replicate it manually.