Closed Bug 1187614 Opened 9 years ago Closed 9 years ago

retry funsize-balrog-submitter on ssl errors

Categories

(Release Engineering :: General, defect)

defect
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: rail, Assigned: rail)

References

Details

[taskcluster] taskId: umhg8o-rTJi_v8d8RbVv8Q, workerId: i-a22a1860 rail/funsize-balrog-submitter@sha256:7f5df4c0cea63903f4a2ec784e14cb99c2524789cb99f8c29ed422e3e2295d0e exists in the cache. + test https://queue.taskcluster.net/v1/task/84XQILLyQkCihiWbyDtCUg/artifacts/public/env + test http://balrog/api + test nightly + wget -O /home/worker/manifest.json https://queue.taskcluster.net/v1/task/84XQILLyQkCihiWbyDtCUg/artifacts/public/env/manifest.json --2015-07-25 15:41:08-- https://queue.taskcluster.net/v1/task/84XQILLyQkCihiWbyDtCUg/artifacts/public/env/manifest.json Resolving queue.taskcluster.net (queue.taskcluster.net)... 23.21.178.59, 54.221.199.178, 54.235.163.87 Connecting to queue.taskcluster.net (queue.taskcluster.net)|23.21.178.59|:443... connected. HTTP request sent, awaiting response... 303 See Other Location: http://s3-copy-proxy-us-west-1.taskcluster.svc.tutum.io/84XQILLyQkCihiWbyDtCUg/0/public/env/manifest.json [following] --2015-07-25 15:41:10-- http://s3-copy-proxy-us-west-1.taskcluster.svc.tutum.io/84XQILLyQkCihiWbyDtCUg/0/public/env/manifest.json Resolving s3-copy-proxy-us-west-1.taskcluster.svc.tutum.io (s3-copy-proxy-us-west-1.taskcluster.svc.tutum.io)... 52.8.16.71 Connecting to s3-copy-proxy-us-west-1.taskcluster.svc.tutum.io (s3-copy-proxy-us-west-1.taskcluster.svc.tutum.io)|52.8.16.71|:80... connected. HTTP request sent, awaiting response... 302 Found Location: https://s3-us-west-1.amazonaws.com/taskcluster-public-artifacts-us-west-1/84XQILLyQkCihiWbyDtCUg/0/public/env/manifest.json [following] --2015-07-25 15:41:10-- https://s3-us-west-1.amazonaws.com/taskcluster-public-artifacts-us-west-1/84XQILLyQkCihiWbyDtCUg/0/public/env/manifest.json Resolving s3-us-west-1.amazonaws.com (s3-us-west-1.amazonaws.com)... 54.231.235.6 Connecting to s3-us-west-1.amazonaws.com (s3-us-west-1.amazonaws.com)|54.231.235.6|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 1474 (1.4K) [application/json] Saving to: '/home/worker/manifest.json' /home/worker/manife 0%[ ] 0 --.-KB/s /home/worker/manife 100%[=====================>] 1.44K --.-KB/s in 0s 2015-07-25 15:41:10 (61.1 MB/s) - '/home/worker/manifest.json' saved [1474/1474] + cat /home/worker/manifest.json [ { "ACCEPTED_MAR_CHANNEL_IDS": "firefox-mozilla-central", "appName": "Firefox", "branch": "mozilla-central", "detached_signatures": { "gpg": "Firefox-mozilla-central-42.0a1-win32-nn-NO-20150724030210-20150725030209.partial.mar.asc" }, "from_buildid": "20150724030210", "from_hash": "5173111c517f0f0aec5f9d72dd5184bbd7fc403e4a994558dd947bd6b7809235c2c9916c43f9b64376ee6aa6597326e6372bc7b872944c780688e949f69550d2", "from_mar": "http://download.cdn.mozilla.net/pub/mozilla.org/firefox/nightly/2015/07/2015-07-24-03-02-10-mozilla-central-l10n/firefox-42.0a1.nn-NO.win32.complete.mar", "from_size": 51560983, "hash": "359c0a3f77d3114a71bc3ac77cb6dcca3019daf719138a098b00dfa6057924e94ecc9229a0b703e150598e74a5c5a7203686c047e8b9bf7f7fe5e7d6160d469e", "locale": "nn-NO", "mar": "Firefox-mozilla-central-42.0a1-win32-nn-NO-20150724030210-20150725030209.partial.mar", "platform": "win32", "repo": "https://hg.mozilla.org/mozilla-central", "revision": "d3228c82badd", "size": 6320866, "to_buildid": "20150725030209", "to_hash": "337f912ab8db8389ffbc3f3384529bbee3cebbad55df9be207407565cb766b408e6cb6c02418867a085ea0bb9a28f6a7a93cbb5dee12b9e71095a51f1c08e8eb", "to_mar": "http://download.cdn.mozilla.net/pub/mozilla.org/firefox/nightly/2015/07/2015-07-25-03-02-09-mozilla-central-l10n/firefox-42.0a1.nn-NO.win32.complete.mar", "to_size": 51681834, "version": "42.0a1" } ]+ python /home/worker/bin/funsize-balrog-submitter.py --artifacts-url-prefix https://queue.taskcluster.net/v1/task/84XQILLyQkCihiWbyDtCUg/artifacts/public/env --manifest /home/worker/manifest.json -a http://balrog/api --signing-cert /home/worker/keys/nightly.pubkey --verbose --dummy Downloading https://queue.taskcluster.net/v1/task/84XQILLyQkCihiWbyDtCUg/artifacts/public/env/Firefox-mozilla-central-42.0a1-win32-nn-NO-20150724030210-20150725030209.partial.mar to /tmp/tmpMO0x2p... Downloading https://queue.taskcluster.net/v1/task/84XQILLyQkCihiWbyDtCUg/artifacts/public/env/Firefox-mozilla-central-42.0a1-win32-nn-NO-20150724030210-20150725030209.partial.mar to /tmp/tmpMO0x2p Starting new HTTPS connection (1): queue.taskcluster.net "GET /v1/task/84XQILLyQkCihiWbyDtCUg/artifacts/public/env/Firefox-mozilla-central-42.0a1-win32-nn-NO-20150724030210-20150725030209.partial.mar HTTP/1.1" 303 29 Starting new HTTP connection (1): s3-copy-proxy-us-west-1.taskcluster.svc.tutum.io "GET /84XQILLyQkCihiWbyDtCUg/0/public/env/Firefox-mozilla-central-42.0a1-win32-nn-NO-20150724030210-20150725030209.partial.mar HTTP/1.1" 302 217 Starting new HTTPS connection (1): s3-us-west-1.amazonaws.com "GET /taskcluster-public-artifacts-us-west-1/84XQILLyQkCihiWbyDtCUg/0/public/env/Firefox-mozilla-central-42.0a1-win32-nn-NO-20150724030210-20150725030209.partial.mar HTTP/1.1" 200 6320866 Verifying the signature... Checking /tmp/tmpMO0x2p signature index_offset is 6319354 first offset is 392 reading signatures file_size: 6320866 bytes 1 signatures present signature data at 28 to 284 ver 1 signature 256 bytes at 20 1 additional sections present 1 104 bytes: 'firefox-mozilla-central\x0042.0a1\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00' Verification OK (RSA-PKCS1-SHA1) Checking if mozilla-central/20150725030209/Firefox-mozilla-central-42.0a1-win32-nn-NO-20150724030210-20150725030209.partial.mar already exists Uploading to mozilla-central/20150725030209/Firefox-mozilla-central-42.0a1-win32-nn-NO-20150724030210-20150725030209.partial.mar... Downloading http://download.cdn.mozilla.net/pub/mozilla.org/firefox/nightly/2015/07/2015-07-25-03-02-09-mozilla-central-l10n/firefox-42.0a1.nn-NO.win32.complete.mar to /tmp/tmpCzF9pP... Downloading http://download.cdn.mozilla.net/pub/mozilla.org/firefox/nightly/2015/07/2015-07-25-03-02-09-mozilla-central-l10n/firefox-42.0a1.nn-NO.win32.complete.mar to /tmp/tmpCzF9pP Starting new HTTP connection (1): download.cdn.mozilla.net "GET /pub/mozilla.org/firefox/nightly/2015/07/2015-07-25-03-02-09-mozilla-central-l10n/firefox-42.0a1.nn-NO.win32.complete.mar HTTP/1.1" 200 51681834 Verifying the signature... Checking /tmp/tmpCzF9pP signature index_offset is 51679854 first offset is 392 reading signatures file_size: 51681834 bytes 1 signatures present signature data at 28 to 284 ver 1 signature 256 bytes at 20 1 additional sections present 1 104 bytes: 'firefox-mozilla-central\x0042.0a1\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00' Verification OK (RSA-PKCS1-SHA1) Checking if mozilla-central/20150725030209/firefox-42.0a1.nn-NO.win32.complete.mar already exists Traceback (most recent call last): File "/home/worker/bin/funsize-balrog-submitter.py", line 175, in <module> main() File "/home/worker/bin/funsize-balrog-submitter.py", line 143, in main complete_mar_url, complete_mar_dest, args.signing_cert) File "/home/worker/bin/funsize-balrog-submitter.py", line 75, in verify_copy_to_s3 if get_hash(key.get_contents_as_string()) == \ File "/usr/lib/python2.7/dist-packages/boto/s3/key.py", line 1780, in get_contents_as_string response_headers=response_headers) File "/usr/lib/python2.7/dist-packages/boto/s3/key.py", line 1648, in get_contents_to_file response_headers=response_headers) File "/usr/lib/python2.7/dist-packages/boto/s3/key.py", line 1480, in get_file query_args=None) File "/usr/lib/python2.7/dist-packages/boto/s3/key.py", line 1533, in _get_file_internal for bytes in self: File "/usr/lib/python2.7/dist-packages/boto/s3/key.py", line 386, in next data = self.resp.read(self.BufferSize) File "/usr/lib/python2.7/dist-packages/boto/connection.py", line 413, in read return http_client.HTTPResponse.read(self, amt) File "/usr/lib/python2.7/httplib.py", line 611, in read s = self.fp.read(amt) File "/usr/lib/python2.7/socket.py", line 384, in read data = self._sock.recv(left) File "/usr/lib/python2.7/ssl.py", line 734, in recv return self.read(buflen) File "/usr/lib/python2.7/ssl.py", line 621, in read v = self._sslobj.read(len or 1024) ssl.SSLError: ('The read operation timed out',) [taskcluster] Unsuccessful task run with exit code: 1 completed in 1206.95 seconds
download() is @retriable() now.
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → FIXED
Assignee: nobody → rail
Component: General Automation → General
You need to log in before you can comment on or make changes to this bug.