John Daggett (:jtd) Reporter
	Description • 14 years ago

Yesterday I submitted tryserver rev f14dda107573.  Builds ran on OSX, Windows and mobile platforms.  But for Linux only build and leaktest builds ran, no reftest builds ran.  Same thing happened last Friday with rev 72fc60bc9304, no reftest builds ran on Linux.

Don't know whether this is a problem with a crowded queue (i.e. jobs getting dropped because of too much contention) or a bug in the queue handling code for Linux tryserver machines.

	Nick Thomas [:nthomas] (UTC+12)
	Comment 1 • 14 years ago

It's true there is a backlog, some 13 jobs for linux opt reftest at the moment, but there's been more than 30 pushes since f14dda107573. So yours should have been processed by now. That buildbot master is complete buried right now so it's hard to get more info.

	Nick Thomas [:nthomas] (UTC+12)
	Comment 2 • 14 years ago

The sendchange from the linux opt build went over to test-master01 without error at Mon Jul 19 02:16:43 2010 PDT, taking 28 seconds.

	Nick Thomas [:nthomas] (UTC+12)
	Comment 3 • 14 years ago

Your build ran almost immediately, result:
reftest: 4477/6/249

The log is at
 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTry/1279531030.1279531689.2961.gz

If it's not showing on TBPL then that's someone elses problem. Beware bug 544373 when not in PDT/PST.

	John Daggett (:jtd) Reporter
	Comment 4 • 14 years ago

Argh, so the jobs run but there's no mail notification (as with other builds)?

	Nick Thomas [:nthomas] (UTC+12)
	Comment 5 • 14 years ago

Armen, this is a regression from moving the tests to the mini farm.

	Armen [:armenzg]
	Comment 6 • 14 years ago

The summary is incorrect since the reftests are actually running:
http://test-master02.build.mozilla.org:8012/builders/Rev3%20Fedora%2012%20tryserver%20opt%20test%20reftest
and I also see it on TBPL.

I am adding lsblakk since she might know why you are not getting emails.

Are you not getting emails for the Linux reftests or for more suites than that?

For reference:
http://hg.mozilla.org/try/pushloghtml?changeset=f14dda107573

	John Daggett (:jtd) Reporter
	Comment 7 • 14 years ago

I only see four results for Linux builds, no other test results show up via email:

Linux tryserver build
Linux tryserver leak test build
Linux x86-64 tryserver build
Linux x86-64 tryserver leak test build

But if I pull tinderbox log I can dig through and find the reftest logs which is what I've been doing today.

	Armen [:armenzg]
	Comment 8 • 14 years ago

Now that I know that it is not a fallout of running jobs on the minis I am putting it back into the pool since I can't get to it right now.

	bhearsum@mozilla.com (:bhearsum)
	Comment 9 • 14 years ago

(In reply to comment #8)
> Now that I know that it is not a fallout of running jobs on the minis I am
> putting it back into the pool since I can't get to it right now.

The summary was incorrect until this morning -- this bug is actually about not having mailed results for unit tests which run on a test master AFAICT. On a build master we get a mail notifier for try builds:
http://hg.mozilla.org/build/buildbotcustom/file/tip/misc.py#l439

We don't have one for the test masters. Getting one going there would resolve this bug.

	Lukas Blakk [:lsblakk] use ?needinfo
	Comment 10 • 14 years ago

I will be on vacation for a week (July 24 -31) but this will be in my work queue when I get back.

	Lukas Blakk [:lsblakk] use ?needinfo
	Comment 11 • 14 years ago

putting it back in the triage queue since this is more urgent than i can do

	Nick Thomas [:nthomas] (UTC+12)
	Comment 12 • 14 years ago

Sorry, I thought I'd changed the summary at comment #5.

	bhearsum@mozilla.com (:bhearsum)
	Comment 16 • 14 years ago

Comment on attachment 460584 [details] [diff] [review]
Add MailNotifier for test masters, and fix talos message code

generateTalos* confuses and scares me. However, this patch seems fine

	bhearsum@mozilla.com (:bhearsum)
	Comment 17 • 14 years ago

Comment on attachment 460583 [details] [diff] [review]
Add configs for mail notifier in test masters

Hooray!

	Chris AtLee [:catlee] Assignee
	Comment 18 • 14 years ago

Comment on attachment 460584 [details] [diff] [review]
Add MailNotifier for test masters, and fix talos message code

changeset:   847:918b2105ea71

	Chris AtLee [:catlee] Assignee
	Comment 19 • 14 years ago

Comment on attachment 460583 [details] [diff] [review]
Add configs for mail notifier in test masters

changeset:   2757:8bfe83cdad60

and

changeset:   2761:5d0cdeed3335