Filed by: apavel [at] mozilla.com https://treeherder.mozilla.org/logviewer.html#?job_id=183173774&repo=try https://queue.taskcluster.net/v1/task/Rtz34vdyQmmeeN9FC4zOBw/runs/0/artifacts/public/logs/live_backing.log When merging central to beta: [task 2018-06-14T12:14:00.245Z] 12:14:00 INFO - /builds/worker/workspace/build/src/sccache2/sccache /builds/worker/workspace/build/src/gcc/bin/gcc -std=gnu99 -o zutil.o -c -I/builds/worker/workspace/build/src/obj-firefox/dist/system_wrappers -include /builds/worker/workspace/build/src/config/gcc_hidden.h -DNDEBUG=1 -DTRIMMED=1 -I/builds/worker/workspace/build/src/modules/zlib/src -I/builds/worker/workspace/build/src/obj-firefox/modules/zlib/src -I/builds/worker/workspace/build/src/obj-firefox/dist/include -I/builds/worker/workspace/build/src/obj-firefox/dist/include/nspr -I/builds/worker/workspace/build/src/obj-firefox/dist/include/nss -fPIC -include /builds/worker/workspace/build/src/obj-firefox/mozilla-config.h -DMOZILLA_CLIENT -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -Wall -Wempty-body -Wignored-qualifiers -Wpointer-arith -Wsign-compare -Wtype-limits -Wunreachable-code -Wduplicated-cond -Wno-error=maybe-uninitialized -Wno-error=deprecated-declarations -Wno-error=array-bounds -Wno-error=free-nonheap-object -Wformat -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -fno-strict-aliasing -ffunction-sections -fdata-sections -fno-math-errno -pthread -pipe -g -freorder-blocks -O2 -fomit-frame-pointer -Werror -MD -MP -MF .deps/zutil.o.pp /builds/worker/workspace/build/src/modules/zlib/src/zutil.c [task 2018-06-14T12:14:00.245Z] 12:14:00 INFO - make[4]: Leaving directory '/builds/worker/workspace/build/src/obj-firefox/modules/zlib/src' [task 2018-06-14T12:14:00.246Z] 12:14:00 INFO - make[4]: Entering directory '/builds/worker/workspace/build/src/obj-firefox/modules/fdlibm/src' [task 2018-06-14T12:14:00.246Z] 12:14:00 INFO - /builds/worker/workspace/build/src/sccache2/sccache /builds/worker/workspace/build/src/gcc/bin/g++ -o e_log2.o -c -I/builds/worker/workspace/build/src/obj-firefox/dist/stl_wrappers -I/builds/worker/workspace/build/src/obj-firefox/dist/system_wrappers -include /builds/worker/workspace/build/src/config/gcc_hidden.h -DNDEBUG=1 -DTRIMMED=1 -DMOZ_HAS_MOZGLUE -I/builds/worker/workspace/build/src/modules/fdlibm/src -I/builds/worker/workspace/build/src/obj-firefox/modules/fdlibm/src -I/builds/worker/workspace/build/src/obj-firefox/dist/include -I/builds/worker/workspace/build/src/obj-firefox/dist/include/nspr -I/builds/worker/workspace/build/src/obj-firefox/dist/include/nss -fPIC -DMOZILLA_CLIENT -include /builds/worker/workspace/build/src/obj-firefox/mozilla-config.h -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -Wall -Wempty-body -Wignored-qualifiers -Woverloaded-virtual -Wpointer-arith -Wsign-compare -Wtype-limits -Wunreachable-code -Wwrite-strings -Wno-invalid-offsetof -Wduplicated-cond -Wno-error=maybe-uninitialized -Wno-error=deprecated-declarations -Wno-error=array-bounds -Wno-error=free-nonheap-object -Wformat -D_GLIBCXX_USE_CXX11_ABI=0 -fno-sized-deallocation -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -fno-exceptions -fno-strict-aliasing -fno-rtti -ffunction-sections -fdata-sections -fno-exceptions -fno-math-errno -pthread -pipe -g -freorder-blocks -O2 -fomit-frame-pointer -Werror -Wno-parentheses -Wno-sign-compare -MD -MP -MF .deps/e_log2.o.pp /builds/worker/workspace/build/src/modules/fdlibm/src/e_log2.cpp [task 2018-06-14T12:14:00.247Z] 12:14:00 INFO - make[4]: Leaving directory '/builds/worker/workspace/build/src/obj-firefox/modules/fdlibm/src' [task 2018-06-14T12:14:00.247Z] 12:14:00 INFO - make[4]: Entering directory '/builds/worker/workspace/build/src/obj-firefox/modules/fdlibm/src' [task 2018-06-14T12:14:00.247Z] 12:14:00 INFO - make[4]: Leaving directory '/builds/worker/workspace/build/src/obj-firefox/modules/fdlibm/src' [task 2018-06-14T12:14:00.247Z] 12:14:00 INFO - make[4]: Entering directory '/builds/worker/workspace/build/src/obj-firefox/config/external/icu/common' [task 2018-06-14T12:14:00.248Z] 12:14:00 INFO - /builds/worker/workspace/build/src/sccache2/sccache /builds/worker/workspace/build/src/gcc/bin/g++ -o chariter.o -c -I/builds/worker/workspace/build/src/obj-firefox/dist/system_wrappers -include /builds/worker/workspace/build/src/config/gcc_hidden.h -DNDEBUG=1 -DTRIMMED=1 -DU_COMMON_IMPLEMENTATION -DUCONFIG_NO_TRANSLITERATION -DUCONFIG_NO_REGULAR_EXPRESSIONS -DUCONFIG_NO_LEGACY_CONVERSION -DU_USING_ICU_NAMESPACE=0 -DU_NO_DEFAULT_INCLUDE_UTF_HEADERS=1 -DU_CHARSET_IS_UTF8 -DU_HAVE_NL_LANGINFO_CODESET=0 -I/builds/worker/workspace/build/src/config/external/icu/common -I/builds/worker/workspace/build/src/obj-firefox/config/external/icu/common -I/builds/worker/workspace/build/src/intl/icu/source/i18n -I/builds/worker/workspace/build/src/obj-firefox/dist/include -I/builds/worker/workspace/build/src/obj-firefox/dist/include/nspr -I/builds/worker/workspace/build/src/obj-firefox/dist/include/nss -fPIC -DMOZILLA_CLIENT -include /builds/worker/workspace/build/src/obj-firefox/mozilla-config.h -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -Wall -Wempty-body -Wignored-qualifiers -Woverloaded-virtual -Wpointer-arith -Wsign-compare -Wtype-limits -Wunreachable-code -Wwrite-strings -Wno-invalid-offsetof -Wduplicated-cond -Wno-error=maybe-uninitialized -Wno-error=deprecated-declarations -Wno-error=array-bounds -Wno-error=free-nonheap-object -Wformat -D_GLIBCXX_USE_CXX11_ABI=0 -fno-sized-deallocation -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -fno-exceptions -fno-strict-aliasing -fno-rtti -ffunction-sections -fdata-sections -fno-exceptions -fno-math-errno -pthread -pipe -g -freorder-blocks -O2 -fomit-frame-pointer -Wno-deprecated-declarations -Wno-type-limits -Wno-unused-but-set-variable -Wno-unused-function -Wno-sign-compare -Wno-maybe-uninitialized -frtti -MD -MP -MF .deps/chariter.o.pp /builds/worker/workspace/build/src/intl/icu/source/common/chariter.cpp [task 2018-06-14T12:14:00.248Z] 12:14:00 INFO - make[4]: Leaving directory '/builds/worker/workspace/build/src/obj-firefox/config/external/icu/common' [task 2018-06-14T12:14:00.248Z] 12:14:00 INFO - make[4]: Entering directory '/builds/worker/workspace/build/src/obj-firefox/mfbt' [task 2018-06-14T12:14:00.248Z] 12:14:00 INFO - /builds/worker/workspace/build/src/sccache2/sccache /builds/worker/workspace/build/src/gcc/bin/g++ -o Unified_cpp_mfbt1.o -c -I/builds/worker/workspace/build/src/obj-firefox/dist/system_wrappers -include /builds/worker/workspace/build/src/config/gcc_hidden.h -DNDEBUG=1 -DTRIMMED=1 -DIMPL_MFBT -DLZ4LIB_VISIBILITY= -I/builds/worker/workspace/build/src/mfbt -I/builds/worker/workspace/build/src/obj-firefox/mfbt -I/builds/worker/workspace/build/src/mfbt/double-conversion -I/builds/worker/workspace/build/src/obj-firefox/dist/include -I/builds/worker/workspace/build/src/obj-firefox/dist/include/nspr -I/builds/worker/workspace/build/src/obj-firefox/dist/include/nss -fPIC -DMOZILLA_CLIENT -include /builds/worker/workspace/build/src/obj-firefox/mozilla-config.h -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -Wall -Wempty-body -Wignored-qualifiers -Woverloaded-virtual -Wpointer-arith -Wsign-compare -Wtype-limits -Wunreachable-code -Wwrite-strings -Wno-invalid-offsetof -Wduplicated-cond -Wno-error=maybe-uninitialized -Wno-error=deprecated-declarations -Wno-error=array-bounds -Wno-error=free-nonheap-object -Wformat -D_GLIBCXX_USE_CXX11_ABI=0 -fno-sized-deallocation -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -fno-exceptions -fno-strict-aliasing -fno-rtti -ffunction-sections -fdata-sections -fno-exceptions -fno-math-errno -pthread -pipe -g -freorder-blocks -O2 -fomit-frame-pointer -Werror -MD -MP -MF .deps/Unified_cpp_mfbt1.o.pp /builds/worker/workspace/build/src/obj-firefox/mfbt/Unified_cpp_mfbt1.cpp [task 2018-06-14T12:14:00.249Z] 12:14:00 INFO - make[4]: Leaving directory '/builds/worker/workspace/build/src/obj-firefox/mfbt' [task 2018-06-14T12:14:00.249Z] 12:14:00 INFO - make[4]: Entering directory '/builds/worker/workspace/build/src/obj-firefox/config/external/icu/i18n' [taskcluster:error] Task timeout after 72000 seconds. Force killing container. [task 2018-06-14T12:14:00.249Z] 12:14:00 INFO - make[4]: Leaving directory '/builds/worker/workspace/build/src/obj-firefox/config/external/icu/i18n' [task 2018-06-14T12:14:00.249Z] 12:14:00 INFO - make[4]: Entering directory '/builds/worker/workspace/build/src/obj-firefox/modules/fdlibm/src' [task 2018-06-14T12:14:00.249Z] 12:14:00 INFO - make[4]: Leaving directory '/builds/worker/workspace/build/src/obj-firefox/modules/fdlibm/src' [task 2018-06-14T12:14:00.249Z] 12:14:00 INFO - make[4]: Entering directory '/builds/worker/workspace/build/src/obj-firefox/config/external/ffi' [task 2018-06-14T12:14:00.249Z] 12:14:00 INFO - /builds/worker/workspace/build/src/sccache2/sccache /builds/worker/workspace/build/src/gcc/bin/gcc -std=gnu99 -o closures.o -c -DNDEBUG=1 -DTRIMMED=1 -DX86_64 -DTARGET=X86_64 -DFFI_NO_RAW_API -DHAVE_AS_STRING_PSEUDO_OP -DHAVE_AS_X86_64_UNWIND_SECTION_TYPE -DHAVE_AS_ASCII_PSEUDO_OP -DHAVE_HIDDEN_VISIBILITY_ATTRIBUTE -DHAVE_AS_X86_PCREL '-DEH_FRAME_FLAGS="a"' -DMOZ_HAS_MOZGLUE -I/builds/worker/workspace/build/src/config/external/ffi -I/builds/worker/workspace/build/src/obj-firefox/config/external/ffi -I/builds/worker/workspace/build/src/obj-firefox/js/src/ctypes/libffi -I/builds/worker/workspace/build/src/obj-firefox/js/src/ctypes/libffi/include -I/builds/worker/workspace/build/src/js/src/ctypes/libffi/include -I/builds/worker/workspace/build/src/js/src/ctypes/libffi/src/x86 -I/builds/worker/workspace/build/src/obj-firefox/dist/include -I/builds/worker/workspace/build/src/obj-firefox/dist/include/nspr -I/builds/worker/workspace/build/src/obj-firefox/dist/include/nss -fPIC -include /builds/worker/workspace/build/src/obj-firefox/mozilla-config.h -DMOZILLA_CLIENT -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -Wall -Wempty-body -Wignored-qualifiers -Wpointer-arith -Wsign-compare -Wtype-limits -Wunreachable-code -Wduplicated-cond -Wno-error=maybe-uninitialized -Wno-error=deprecated-declarations -Wno-error=array-bounds -Wno-error=free-nonheap-object -Wformat -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -fno-strict-aliasing -ffunction-sections -fdata-sections -fno-math-errno -pthread -pipe -g -freorder-blocks -O2 -fomit-frame-pointer -MD -MP -MF .deps/closures.o.pp /builds/worker/workspace/build/src/js/src/ctypes/libffi/src/closures.c [task 2018-06-14T12:14:00.249Z] 12:14:00 INFO - /builds/worker/workspace/build/src/js/src/ctypes/libffi/src/closures.c: In function 'dlmmap_locked': [task 2018-06-14T12:14:00.249Z] 12:14:00 INFO - /builds/worker/workspace/build/src/js/src/ctypes/libffi/src/closures.c:460:7: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] [task 2018-06-14T12:14:00.250Z] 12:14:00 INFO - ftruncate (execfd, offset); [task 2018-06-14T12:14:00.250Z] 12:14:00 INFO - ^~~~~~~~~~~~~~~~~~~~~~~~~~ [task 2018-06-14T12:14:00.250Z] 12:14:00 INFO - /builds/worker/workspace/build/src/js/src/ctypes/libffi/src/closures.c:472:7: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] [task 2018-06-14T12:14:00.250Z] 12:14:00 INFO - ftruncate (execfd, offset); [task 2018-06-14T12:14:00.250Z] 12:14:00 INFO - ^~~~~~~~~~~~~~~~~~~~~~~~~~ [task 2018-06-14T12:14:00.250Z] 12:14:00 INFO - make[4]: Leaving directory '/builds/worker/workspace/build/src/obj-firefox/config/external/ffi' [task 2018-06-14T12:14:00.250Z] 12:14:00 INFO - make[4]: Entering directory '/builds/worker/workspace/build/src/obj-firefox/config/external/icu/i18n' [task 2018-06-14T12:14:00.250Z] 12:14:00 INFO - make[4]: Leaving directory '/builds/worker/workspace/build/src/obj-firefox/config/external/icu/i18n' [task 2018-06-14T12:14:00.250Z] 12:14:00 INFO - make[4]: Entering directory '/builds/worker/workspace/build/src/obj-firefox/config/external/icu/common' [task 2018-06-14T12:14:00.250Z] 12:14:00 INFO - /builds/worker/workspace/build/src/sccache2/sccache /builds/worker/workspace/build/src/gcc/bin/g++ -o caniter.o -c -I/builds/worker/workspace/build/src/obj-firefox/dist/system_wrappers -include /builds/worker/workspace/build/src/config/gcc_hidden.h -DNDEBUG=1 -DTRIMMED=1 -DU_COMMON_IMPLEMENTATION -DUCONFIG_NO_TRANSLITERATION -DUCONFIG_NO_REGULAR_EXPRESSIONS -DUCONFIG_NO_LEGACY_CONVERSION -DU_USING_ICU_NAMESPACE=0 -DU_NO_DEFAULT_INCLUDE_UTF_HEADERS=1 -DU_CHARSET_IS_UTF8 -DU_HAVE_NL_LANGINFO_CODESET=0 -I/builds/worker/workspace/build/src/config/external/icu/common -I/builds/worker/workspace/build/src/obj-firefox/config/external/icu/common -I/builds/worker/workspace/build/src/intl/icu/source/i18n -I/builds/worker/workspace/build/src/obj-firefox/dist/include -I/builds/worker/workspace/build/src/obj-firefox/dist/include/nspr -I/builds/worker/workspace/build/src/obj-firefox/dist/include/nss -fPIC -DMOZILLA_CLIENT -include /builds/worker/workspace/build/src/obj-firefox/mozilla-config.h -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -Wall -Wempty-body -Wignored-qualifiers -Woverloaded-virtual -Wpointer-arith -Wsign-compare -Wtype-limits -Wunreachable-code -Wwrite-strings -Wno-invalid-offsetof -Wduplicated-cond -Wno-error=maybe-uninitialized -Wno-error=deprecated-declarations -Wno-error=array-bounds -Wno-error=free-nonheap-object -Wformat -D_GLIBCXX_USE_CXX11_ABI=0 -fno-sized-deallocation -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -fno-exceptions -fno-strict-aliasing -fno-rtti -ffunction-sections -fdata-sections -fno-exceptions -fno-math-errno -pthread -pipe -g -freorder-blocks -O2 -fomit-frame-pointer -Wno-deprecated-declarations -Wno-type-limits -Wno-unused-but-set-variable -Wno-unused-function -Wno-sign-compare -Wno-maybe-uninitialized -frtti -MD -MP -MF .deps/caniter.o.pp /builds/worker/workspace/build/src/intl/icu/source/common/caniter.cpp [task 2018-06-14T12:14:00.250Z] 12:14:00 INFO - make[4]: Leaving directory '/builds/worker/workspace/build/src/obj-firefox/config/external/icu/common' [task 2018-06-14T12:14:00.250Z] 12:14:00 INFO - make[4]: Entering directory '/builds/worker/workspace/build/src/obj-firefox/config/external/icu/i18n' [task 2018-06-14T12:14:00.250Z] 12:14:00 INFO - make[4]: Leaving directory '/builds/worker/workspace/build/src/obj-firefox/config/external/icu/i18n'

There's nothing actionable in the log. We could have someone take a look at papertrail logs for the worker to see if there's anything interesting in the kernel logs. We saw useful info there in bug 1453155, where we're hitting a kernel oops. It's entirely possible that there's some low-level failure that doesn't get handled properly and causes a hang and thus a timeout. (In reply to OrangeFactor Robot from comment #1) > 1 failures in 408 pushes (0.002 failures/push) were associated with this bug > in the last 7 days. ...given the extremely low frequency of occurrence here, it's not really worth someone's time to investigate. If this starts showing up more than once we should look into it. One thing we discussed in our team meeting today is that the "10 hours" max task runtime that has been copied all over our task definitions is unreasonably high and probably dates to Windows PGO builds in buildbot.