Closed Bug 522662 Opened 15 years ago Closed 12 years ago

Random "out of memory" failure on the talos tp4 tests by "__FAILbrowser frozen__FAIL"

Categories

(Core :: General, defect)

Product:
Core
Component:
General
Type:
defect
Priority:
Not set
Severity:
critical

Tracking

()

Status:
RESOLVED WORKSFORME

People

(Reporter: masayuki, Unassigned)

References

Details

(Keywords: hang, intermittent-failure, memory-footprint)

Whiteboard: [orange]
Blocks: 438871
WINNT 6.0 mozilla-central talos tp4 [testfailed] Started 12:33, finished 13:03
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1259872413.1259874177.11430.gz&fulltext=1

Last page ran:
NOISE: Cycle 7: loaded http://localhost/page_load_test/tp4/www.shopping.com/www.shopping.com/index.html (next: http://localhost/page_load_test/tp4/www.tu.tv/www.tu.tv/index.html)
Summary: Random failure the tp tests by "__FAILbrowser frozen__FAIL" → Random failure the tp4 tests by "__FAILbrowser frozen__FAIL"
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1260541633.1260543466.9726.gz
WINNT 6.0 mozilla-central talos tp4 on 2009/12/11 06:27:13  

Last output:
NOISE: Cycle 9: loaded http://localhost/page_load_test/tp4/www.nytimes.com/www.nytimes.com/index.html (next: http://localhost/page_load_test/tp4/www.wretch.cc/www.wretch.cc/index.html)
NOISE: 
NOISE: __FAILbrowser frozen__FAIL

We should definitely note which pages are freezing; it could be a small subset (in which case we should split this bug) or it could be random.

Either way, we may need more diagnostics on the talos run.
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1264120199.1264121379.7540.gz
WINNT 6.0 mozilla-central talos tp4 on 2010/01/21 16:29:59
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1264704438.1264706140.4789.gz
WINNT 6.0 mozilla-central talos tp4 on 2010/01/28 10:47:18
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1264867843.1264869927.31286.gz
Summary: Random failure the tp4 tests by "__FAILbrowser frozen__FAIL" → Random failure on the talos tp4 tests by "__FAILbrowser frozen__FAIL"
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265700545.1265702087.15316.gz
WINNT 6.0 mozilla-central talos tp4 on 2010/02/08 23:29:05  
s: talos-rev2-vista08
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265769534.1265770863.13053.gz
WINNT 6.0 mozilla-central talos tp4 on 2010/02/09 18:38:54  
s: talos-rev2-vista08
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265935898.1265937065.8696.gz
WINNT 6.0 mozilla-central talos tp4 on 2010/02/11 16:51:38  
s: talos-rev2-vista02
Rev3 WINNT 6.1 mozilla-central talos tp4  [testfailed] Started 22:48, finished 23:11
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1268020118.1268021447.18130.gz
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1268603873.1268606576.24840.gz
Rev3 WINNT 6.1 mozilla-central talos tp4 on 2010/03/14 14:57:53
s: talos-r3-w7-020
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1268855275.1268856886.12530.gz
Rev3 WINNT 6.1 mozilla-central talos tp4 on 2010/03/17 12:47:55
I caught this with a stack at: <http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1290793025.1290795099.29138.gz>

NOISE: __FAILbrowser frozen__FAIL
NOISE: Found crashdump: /tmp/tmpJUfLgs/profile/minidumps/25edc319-1a21-e445-2228407c-58959d50.dmp
Operating system: Linux
                  0.0.0 Linux 2.6.31.5-127.fc12.i686.PAE #1 SMP Sat Nov 7 21:25:57 EST 2009 i686
CPU: x86
     GenuineIntel family 6 model 23 stepping 10
     2 CPUs

Crash reason:  SIGABRT
Crash address: 0x7ec

Thread 0 (crashed)
 0  linux-gate.so + 0x424
    eip = 0x00370424   esp = 0xbfb15df0   ebp = 0xbfb15e38   ebx = 0xb760e508
    esi = 0x00000000   edi = 0x0000058b   eax = 0xfffffffc   ecx = 0x00000080
    edx = 0x0000058b   efl = 0x00200282
    Found by: given as instruction pointer in context
 1  libnspr4.so!PR_Wait [ptsynch.c:0d7dd95a1d9a : 614 + 0x11]
    eip = 0x00785087   esp = 0xbfb15e40   ebp = 0xbfb15e58
    Found by: previous frame's frame pointer
 2  libxul.so!nsEventQueue::GetEvent [nsAutoLock.h : 346 + 0x9]
    eip = 0x019c4728   esp = 0xbfb15e60   ebp = 0x00000001   ebx = 0x021267d0
    esi = 0xb7615430   edi = 0xb7676af8
    Found by: call frame info
 3  libxul.so!nsThread::ProcessNextEvent [nsThread.h:0d7dd95a1d9a : 114 + 0x11]
    eip = 0x019c581b   esp = 0xbfb15e90   ebp = 0xb5e6e3a0   ebx = 0x021267d0
    esi = 0xb7676ac0   edi = 0x0181997c
    Found by: call frame info
 4  libxul.so!NS_ProcessNextEvent_P [nsThreadUtils.cpp : 250 + 0xf]
    eip = 0x0198e76d   esp = 0xbfb15ee0   ebp = 0xb5e6e3a0   ebx = 0x021267d0
    esi = 0x8007000e   edi = 0xb760fd70
    Found by: call frame info
 5  libxul.so!nsThread::Shutdown [nsThread.cpp:0d7dd95a1d9a : 492 + 0xc]
    eip = 0x019c5cb0   esp = 0xbfb15f10   ebp = 0xb5e6e3a0   ebx = 0x021267d0
    esi = 0x8007000e   edi = 0xb760fd70
    Found by: call frame info
 6  libxul.so!nsSocketTransportService::Shutdown [nsSocketTransportService2.cpp:0d7dd95a1d9a : 465 + 0x7]
    eip = 0x00eeb262   esp = 0xbfb15f60   ebp = 0x01e20bcb   ebx = 0x021267d0
    esi = 0xbfb15f74   edi = 0xb5e32000
    Found by: call frame info
 7  libxul.so!nsIOService::SetOffline [nsIOService.cpp:0d7dd95a1d9a : 729 + 0x8]
    eip = 0x00ed6fd8   esp = 0xbfb15f90   ebp = 0x01e20bcb   ebx = 0x021267d0
    esi = 0x01e20da8   edi = 0xb761f300
    Found by: call frame info
 8  libxul.so!nsIOService::Observe [nsIOService.cpp:0d7dd95a1d9a : 920 + 0x9]
    eip = 0x00ed6d51   esp = 0xbfb16000   ebp = 0x01e1e0d4   ebx = 0x021267d0
    esi = 0x01e1e0d4   edi = 0xb761f300
    Found by: call frame info
 9  libxul.so!nsObserverList::NotifyObservers [nsObserverList.cpp:0d7dd95a1d9a : 130 + 0xb]
    eip = 0x0199ed5b   esp = 0xbfb16080   ebp = 0x01e1e0d4   ebx = 0x021267d0
    esi = 0x00000003   edi = 0x01e1e3b8
    Found by: call frame info
10  libxul.so!nsObserverService::NotifyObservers [nsObserverService.cpp:0d7dd95a1d9a : 182 + 0xb]
    eip = 0x0199f039   esp = 0xbfb160b0   ebp = 0x01e1e3b8   ebx = 0x021267d0
    esi = 0xb5e2667c   edi = 0x01e1e0d4
    Found by: call frame info
11  libxul.so!nsXREDirProvider::DoShutdown [nsXREDirProvider.cpp:0d7dd95a1d9a : 798 + 0x17]
    eip = 0x00eb5276   esp = 0xbfb160e0   ebp = 0xb0f07060   ebx = 0x021267d0
    esi = 0x01e1e3b8   edi = 0xbfb163d0
    Found by: call frame info
12  libxul.so!ScopedXPCOMStartup::~ScopedXPCOMStartup [nsAppRunner.cpp : 1113 + 0xd]
    eip = 0x00eafa78   esp = 0xbfb16120   ebp = 0xb0f07060   ebx = 0x021267d0
    esi = 0xbfb16618   edi = 0x01887262
    Found by: call frame info
13  libxul.so!XRE_main [nsAppRunner.cpp : 3721 + 0xf]
    eip = 0x00eb2973   esp = 0xbfb16150   ebp = 0xb0f07060   ebx = 0x021267d0
    esi = 0x00000000   edi = 0x01887262
    Found by: call frame info
14  firefox-bin!main [nsBrowserApp.cpp:0d7dd95a1d9a : 158 + 0xe]
    eip = 0x08049554   esp = 0xbfb16660   ebp = 0xbfb16774   ebx = 0x08054858
    esi = 0xbfb16774   edi = 0x00000000
    Found by: call frame info
15  libc-2.11.so + 0x16bb5
    eip = 0x007adbb6   esp = 0xbfb166d0   ebp = 0xbfb16748   ebx = 0x00907ff4
    esi = 0x00000000   edi = 0x00000000
    Found by: call frame info
16  firefox-bin + 0x1390
    eip = 0x08049391   esp = 0xbfb16750   ebp = 0x00000000
    Found by: previous frame's frame pointer
17  firefox-bin!Output [nsBrowserApp.cpp:0d7dd95a1d9a : 77 + 0x4]
    eip = 0x0804946f   esp = 0xbfb16754   ebp = 0x00000000
    Found by: stack scanning
18  0xa
    eip = 0x0000000b   esp = 0xbfb16774   ebp = 0x00000000   ebx = 0x00ae58e0
    Found by: call frame info

This could be solved by my patch in bug 614286...
Depends on: 614286
It would be interesting to see if this would happen after bug 614286 has landed...
(In reply to comment #43)
> It would be interesting to see if this would happen after bug 614286 has
> landed...

Well, it did happen on the very landing of that bug!  :-)

http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1291218632.1291220696.17728.gz
No longer depends on: 614286
Keywords: footprint
Summary: Random failure on the talos tp4 tests by "__FAILbrowser frozen__FAIL" → Random "out of memory" failure on the talos tp4 tests by "__FAILbrowser frozen__FAIL"
philor says this is one of this bug:

http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1295041652.1295044346.9269.gz
Rev3 WINNT 6.1 mozilla-central talos tp4
Mass marking whiteboard:[orange] bugs WFM (to clean up TBPL bug suggestions) that:
* Haven't changed in > 6months
* Whose whiteboard contains none of the strings: {disabled,marked,random,fuzzy,todo,fails,failing,annotated,leave open,time-bomb}
* Passed a (quick) manual inspection of bug summary/whiteboard to ensure they weren't a false positive.

I've also gone through and searched for cases where the whiteboard wasn't labelled correctly after test disabling, by using attachment description & basic comment searches. However if the test for which this bug was about has in fact been disabled/annotated/..., please accept my apologies & reopen/mark the whiteboard appropriately so this doesn't get re-closed in the future (and please ping me via IRC or email so I can try to tweak the saved searches to avoid more edge cases).

Sorry for the spam! Filter on: #FFA500
Status: NEW → RESOLVED
Closed: 12 years ago
Resolution: --- → WORKSFORME
Whiteboard: [orange]
You need to log in before you can comment on or make changes to this bug.