For use as input to slavealloc scripts in braindump/it-related

SQL to update graph servers

For use as input to braindump/it-related/rename_host_bugs

SQL to update slavealloc database

bugs renamed (none needed)

Databases updated: $ mysql --defaults-file=graph-stage.ini -e "source train_1_graphs.sql" Enter password: $ mysql --defaults-file=graph-prod.ini -e "source train_1_graphs.sql" Enter password: 0 [hwine@cruncher it-related] $ mysql --defaults-file=slavealloc.ini -e "source train_1_slavealloc.sql " Enter password: 0 [hwine@cruncher it-related]

No functional change sort of devices.json file $ hg inc comparing with https://hg.mozilla.org/build/tools searching for changes no changes found 1 [Hal@Hals-MacBook-Air mobile] $ mv -i devices.json devices.json.old 0 [Hal@Hals-MacBook-Air mobile] $ ~1/sort-devices <devices.json.old >devices.json 0 [Hal@Hals-MacBook-Air mobile] $ wc devices.json* 5727 10365 166876 devices.json 5727 10365 166876 devices.json.old 11454 20730 333752 total 0 Using the following script: #!/usr/bin/env python ''' Take a devices.json file as input, sort & output. ''' import argparse import copy import json import logging import sys logger = logging.getLogger(__name__) def main(): parser = argparse.ArgumentParser(description=__doc__) parser.add_argument('--devices', '-d', dest='device_file', default=None, help='json file (defaults to stdin)') args = parser.parse_args() # sanity checks if args.device_file is None: fp = sys.stdin else: fp = open(args.device_file, 'r') devices = json.load(fp) new_devices = copy.deepcopy(devices) # set separators to ensure no trailing newline json.dump(new_devices, sys.stdout, sort_keys=True, indent=4, separators=(',', ': ')) print # add newline to last line if __name__ == "__main__": logging.basicConfig(level=logging.INFO, format='%(asctime)s %(message)s') sys.exit(main())

Actual data center updates. Created using http://hg.mozilla.org/build/braindump/rev/2b604d928d33 via: $ mv -i devices.json devices.json.old overwrite devices.json.old? (y/n [n]) y 0 [Hal@Hals-MacBook-Air mobile] $ ~1/move-devices < devices.json.old ~/wip/train_1/scl1\ master\ panda\ move\ list\ -\ p*csv >devices.json 0 [Hal@Hals-MacBook-Air mobile] $ wc devices.json* 5727 10365 166876 devices.json 5727 10365 166876 devices.json.old 11454 20730 333752 total 0 [Hal@Hals-MacBook-Air mobile] $ grep -c scl1 devices.json* devices.json:527 devices.json.old:788 0 [Hal@Hals-MacBook-Air mobile] $ grep -c scl3 devices.json* devices.json:617 devices.json.old:356 0 [Hal@Hals-MacBook-Air mobile] So, 261 changes made, but 262 panda boards in spreadsheets. Some digging determined that panda-250 is not in the devices.json file.

Comment on attachment 8449535 [details] [diff] [review] train_1.patch Review of attachment 8449535 [details] [diff] [review]: ----------------------------------------------------------------- skimmed stamp+

Comment on attachment 8449468 [details] [diff] [review] sorted.patch https://hg.mozilla.org/build/tools/rev/67cfbf835683

Comment on attachment 8449535 [details] [diff] [review] train_1.patch https://hg.mozilla.org/build/tools/rev/96161ebf8568

No changes to buildbot-configs needed as no panda board names change (only fqdn): 0 [Hal@Hals-MacBook-Air buildbot-configs] $ ack panda- mozilla-tests/mobile_config.py 1674:# M4,M5,M6,M7,J1,J2,J3 only for panda-android mozilla-tests/production_config.py 53: SLAVES['panda_android']['panda-%04i' % i] = { mozilla-tests/staging_config.py 16: STAGING_SLAVES['panda_android']['panda-%04i' % i] = { 0 [Hal@Hals-MacBook-Air buildbot-configs]

created device directories: for f in $(grep ^foop train_1_short.txt | cut -d, -f1) ; do ./manage_foopies.py -f ../mobile/devices.json -H $f create_device_dirs done update to latest tools: for f in $(cat ~/foopies.txt) ; do ./manage_foopies.py -f ../mobile/devices.json -H $f update done verify all on latest tools: for f in $(cat ~/foopies.txt) ; do ./manage_foopies.py -f ../mobile/devices.json -H $f show_revision done foopy39 5e3c477a2afc foopy40 5e3c477a2afc foopy41 5e3c477a2afc foopy42 5e3c477a2afc foopy43 5e3c477a2afc foopy44 5e3c477a2afc foopy45 5e3c477a2afc foopy46 5e3c477a2afc foopy47 5e3c477a2afc foopy48 5e3c477a2afc foopy49 5e3c477a2afc foopy50 5e3c477a2afc foopy51 5e3c477a2afc foopy52 5e3c477a2afc foopy60 5e3c477a2afc foopy61 5e3c477a2afc foopy62 5e3c477a2afc foopy63 5e3c477a2afc foopy64 5e3c477a2afc foopy65 5e3c477a2afc foopy66 5e3c477a2afc

train 1 units have been re-enabled.