Didn't come back from a PDU reboot.

Didn't get fixed after recovery. Callek, what's the next step here?

This tegra appears to be online but isn't connected to a master. Callek?

Bah, mistaken setup of foopy27.... [cltbld@foopy27 builds]$ tail tegra-253/twistd*.log -f 2012-09-01 01:59:03-0700 [Uninitialized] Connection to buildbot-master19.build.mozilla.org:9160 failed: Connectio n Refused [cltbld@foopy27 builds]$ grep "passwd = 'pass'" tegra-*/buildbot.tac tegra-248/buildbot.tac:passwd = 'pass' tegra-249/buildbot.tac:passwd = 'pass' tegra-250/buildbot.tac:passwd = 'pass' tegra-251/buildbot.tac:passwd = 'pass' tegra-252/buildbot.tac:passwd = 'pass' tegra-253/buildbot.tac:passwd = 'pass' tegra-254/buildbot.tac:passwd = 'pass' tegra-255/buildbot.tac:passwd = 'pass' tegra-256/buildbot.tac:passwd = 'pass' tegra-257/buildbot.tac:passwd = 'pass' tegra-258/buildbot.tac:passwd = 'pass' tegra-259/buildbot.tac:passwd = 'pass' tegra-260/buildbot.tac:passwd = 'pass' Fixing, and restarting all these tegras.

Looking good now....

Perma-retrying; disabled. python /builds/sut_tools/installApp.py 10.26.85.201 build/fennec-33.0a1.en-US.android-arm.apk org.mozilla.fennec in dir /builds/tegra-253/test/. (timeout 1200 secs) watching logfiles {} argv: ['python', '/builds/sut_tools/installApp.py', '10.26.85.201', u'build/fennec-33.0a1.en-US.android-arm.apk', 'org.mozilla.fennec'] environment: HOME=/home/cltbld LOGNAME=cltbld OLDPWD=/home/cltbld PATH=/usr/local/bin:/usr/local/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/tegra-253/test PYTHONPATH=/builds/sut_tools SHELL=/bin/sh SHLVL=4 SUT_IP=10.26.85.201 SUT_NAME=tegra-253 USER=cltbld _=/tools/buildbot/bin/python2.7 using PTY: False 06/13/2014 00:25:51: INFO: copying build/fennec/application.ini to build/talos/remoteapp.ini 06/13/2014 00:25:51: DEBUG: calling [cp build/fennec/application.ini build/talos/remoteapp.ini] 06/13/2014 00:25:51: DEBUG: cp: cannot create regular file `build/talos/remoteapp.ini': No such file or directory 06/13/2014 00:25:51: INFO: connecting to: 10.26.85.201 reconnecting socket 06/13/2014 00:25:51: INFO: devroot /mnt/sdcard/tests 06/13/2014 00:25:51: INFO: 10.26.84.3, 50253 06/13/2014 00:25:51: INFO: Current device time is 2014/06/13 00:25:50 06/13/2014 00:25:51: INFO: Setting device time to 2014/06/13 00:25:51 06/13/2014 00:25:51: INFO: Current device time is 2014/06/13 00:25:51 results: {'process': [['10007', '1208', 'com.android.inputmethod.latin'], ['1001', '1217', 'com.android.phone'], ['1000', '1020', 'system'], ['10029', '1326', 'com.android.deskclock'], ['10031', '1503', 'com.mozilla.SUTAgentAndroid'], ['10018', '1228', 'com.android.launcher'], ['10017', '1335', 'com.android.bluetooth'], ['10013', '1435', 'com.cooliris.media'], ['10009', '1410', 'com.android.quicksearchbox'], ['1000', '1234', 'com.android.settings'], ['10002', '1424', 'com.android.music'], ['10004', '1354', 'android.process.media'], ['10032', '1401', 'com.mozilla.watcher'], ['10006', '1382', 'com.android.mms'], ['10010', '1367', 'com.android.providers.calendar'], ['10014', '1343', 'com.android.email'], ['10015', '1262', 'android.process.acore']]} results: {'memory': ['PA:837120000, FREE: 765194240']} results: {'uptime': ['0 days 0 hours 59 minutes 8 seconds 549 ms']} results: {'screen': ['X:1024 Y:768']} 06/13/2014 00:25:51: INFO: Installing /mnt/sdcard/tests/fennec-33.0a1.en-US.android-arm.apk in push file with: build/fennec-33.0a1.en-US.android-arm.apk, and: /mnt/sdcard/tests/fennec-33.0a1.en-US.android-arm.apk sending: push /mnt/sdcard/tests/fennec-33.0a1.en-US.android-arm.apk push returned: 65addc1da12b3996567fbbfaf557c886 Push File Validated! 06/13/2014 00:26:11: INFO: /builds/tegra-253/test/../error.flg Remote Device Error: updateApp() call failed - exiting program finished with exit code 1 elapsedTime=50.108618

replaced SD card, flashed and reimaged tegra. vle@vle-10516 ~ $ telnet tegra-253.tegra.releng.scl3.mozilla.com 20701 Trying 10.26.85.201... Connected to tegra-253.tegra.releng.scl3.mozilla.com. Escape character is '^]'. $>^] telnet> q