Closed Bug 1213308 Opened 9 years ago Closed 9 years ago

Automatic backfilling to handle KeyError issue

Categories

(Testing :: General, defect)

defect
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: armenzg, Assigned: armenzg)

References

(Blocks 1 open bug)

Details

I saw this on the logs. I think this started happening after my push to Heroku (I don't see it before 5 minutes ago) Oct 09 07:51:02 pulse-actions app/worker1.1: KeyError: 'status' Oct 09 07:52:02 pulse-actions app/worker1.1: KeyError: 'status' Oct 09 07:53:01 pulse-actions app/worker1.1: KeyError: 'status' Oct 09 07:54:02 pulse-actions app/worker1.1: KeyError: 'status' Oct 09 07:55:02 pulse-actions app/worker1.1: KeyError: 'status' Oct 09 07:51:07 pulse-actions heroku/worker1.1: source=worker1.1 dyno=heroku.37276462.4a7d73eb-8206-4a42-b3be-3edd31751569 sample#load_avg_1m=0.00 Oct 09 07:51:12 pulse-actions app/worker1.1: INFO: 'Ubuntu VM 12.04 mozilla-inbound pgo test mochitest-2' with status 0. Nothing to be done. Oct 09 07:51:27 pulse-actions heroku/worker1.1: source=worker1.1 dyno=heroku.37276462.4a7d73eb-8206-4a42-b3be-3edd31751569 sample#load_avg_1m=0.00 Oct 09 07:51:27 pulse-actions heroku/worker1.1: source=worker1.1 dyno=heroku.37276462.4a7d73eb-8206-4a42-b3be-3edd31751569 sample#memory_total=17.96MB sample#memory_rss=16.00MB sample#memory_cache=1.96MB sample#memory_swap=0.00MB sample#memory_pgpgin=10808pages sample#memory_pgpgout=6210pages Oct 09 07:51:28 pulse-actions app/worker1.1: INFO: 'b2g_emulator_vm mozilla-inbound opt test reftest-13' with status 0. Nothing to be done. Oct 09 07:51:46 pulse-actions heroku/worker1.1: source=worker1.1 dyno=heroku.37276462.4a7d73eb-8206-4a42-b3be-3edd31751569 sample#load_avg_1m=0.00 Oct 09 07:51:46 pulse-actions heroku/worker1.1: source=worker1.1 dyno=heroku.37276462.4a7d73eb-8206-4a42-b3be-3edd31751569 sample#memory_total=17.96MB sample#memory_rss=16.00MB sample#memory_cache=1.96MB sample#memory_swap=0.00MB sample#memory_pgpgin=10808pages sample#memory_pgpgout=6210pages Oct 09 07:51:56 pulse-actions app/worker1.1: INFO: 'Windows 8 64-bit mozilla-inbound debug test reftest' with status 0. Nothing to be done. Oct 09 07:52:02 pulse-actions app/worker1.1: INFO: 'Android armv7 API 9 mozilla-inbound opt test mochitest-2' with status 0. Nothing to be done. Oct 09 07:52:02 pulse-actions app/worker1.1: Traceback (most recent call last): Oct 09 07:52:02 pulse-actions app/worker1.1: File "pulse_actions/worker.py", line 69, in run_pulse Oct 09 07:52:02 pulse-actions app/worker1.1: pulse.listen() Oct 09 07:52:02 pulse-actions app/worker1.1: File "/app/.heroku/python/lib/python2.7/site-packages/mozillapulse/consumers.py", line 151, in listen Oct 09 07:52:02 pulse-actions app/worker1.1: self._drain_events_loop() Oct 09 07:52:02 pulse-actions app/worker1.1: File "/app/.heroku/python/lib/python2.7/site-packages/mozillapulse/consumers.py", line 198, in _drain_events_loop Oct 09 07:52:02 pulse-actions app/worker1.1: self.connection.drain_events(timeout=self.timeout) Oct 09 07:52:02 pulse-actions app/worker1.1: File "/app/.heroku/python/lib/python2.7/site-packages/kombu/connection.py", line 275, in drain_events Oct 09 07:52:02 pulse-actions app/worker1.1: return self.transport.drain_events(self.connection, **kwargs) Oct 09 07:52:02 pulse-actions app/worker1.1: File "/app/.heroku/python/lib/python2.7/site-packages/kombu/transport/pyamqp.py", line 95, in drain_events Oct 09 07:52:02 pulse-actions app/worker1.1: return connection.drain_events(**kwargs) Oct 09 07:52:02 pulse-actions app/worker1.1: File "/app/.heroku/python/lib/python2.7/site-packages/amqp/connection.py", line 325, in drain_events Oct 09 07:52:02 pulse-actions app/worker1.1: return amqp_method(channel, args, content) Oct 09 07:52:02 pulse-actions app/worker1.1: File "/app/.heroku/python/lib/python2.7/site-packages/amqp/channel.py", line 1908, in _basic_deliver Oct 09 07:52:02 pulse-actions app/worker1.1: fun(msg) Oct 09 07:52:02 pulse-actions app/worker1.1: File "/app/.heroku/python/lib/python2.7/site-packages/kombu/messaging.py", line 596, in _receive_callback Oct 09 07:52:02 pulse-actions app/worker1.1: return on_m(message) if on_m else self.receive(decoded, message) Oct 09 07:52:02 pulse-actions app/worker1.1: File "/app/.heroku/python/lib/python2.7/site-packages/kombu/messaging.py", line 563, in receive Oct 09 07:52:02 pulse-actions app/worker1.1: [callback(body, message) for callback in callbacks] Oct 09 07:52:02 pulse-actions app/worker1.1: File "pulse_actions/worker.py", line 60, in handler_with_dry_run Oct 09 07:52:02 pulse-actions app/worker1.1: return event_handler(data, message, dry_run) Oct 09 07:52:02 pulse-actions app/worker1.1: File "/app/pulse_actions/handlers/backfilling.py", line 39, in on_event Oct 09 07:52:02 pulse-actions app/worker1.1: status = payload["status"] Oct 09 07:52:02 pulse-actions app/worker1.1: KeyError: 'status'
This was a regression introduce with Mozilla Pulse 1.2.1 [1] A new release has been produced. [1] https://hg.mozilla.org/automation/mozillapulse/rev/cafbb0f97f10
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.