Closed
Bug 405007
Opened 17 years ago
Closed 13 years ago
Create unittest buildbots for Calendar
Categories
(Calendar :: Build Config, defect)
Calendar
Build Config
Tracking
(Not tracked)
RESOLVED
FIXED
1.1
People
(Reporter: mschroeder, Assigned: standard8)
References
Details
(Whiteboard: [not needed beta][no l10n impact])
Attachments
(3 files, 1 obsolete file)
(deleted),
patch
|
dbo
:
review+
|
Details | Diff | Splinter Review |
(deleted),
patch
|
mschroeder
:
review+
|
Details | Diff | Splinter Review |
(deleted),
patch
|
Fallen
:
review+
|
Details | Diff | Splinter Review |
We don't use the Trunk tinderboxen for production at the moment, and the Mozilla1.8 tinderboxen can't run unit tests automatically. So we decided to enable automated unit testing on the Trunk tinderboxen in the QA chat. What has to be done: * Change Makefiles on Trunk * Change config of Trunk tinderboxen
Reporter | ||
Comment 1•17 years ago
|
||
We have to change the Makefile in the test directory on Trunk to run XPCShell unit tests with "make check" from the OBJDIR.
Attachment #291122 -
Flags: review?(ctalbert)
Reporter | ||
Comment 2•17 years ago
|
||
Comment on attachment 291122 [details] [diff] [review] [checked in] Patch for Makefile v1 (TRUNK ONLY) Shifting to Daniel for a quick review. I tested this patch thoroughly.
Attachment #291122 -
Flags: review?(ctalbert) → review?(daniel.boelzle)
Comment 3•17 years ago
|
||
Comment on attachment 291122 [details] [diff] [review] [checked in] Patch for Makefile v1 (TRUNK ONLY) r=dbo, try it out > # Note: Invoke any additional (non-xpcshell) test programs here. > check:: >- $(RUN_TEST_PROGRAM) $(DIST)/bin/test_all.sh $(DIST)/bin/$(MODULE) Why have you left the check target in?
Attachment #291122 -
Flags: review?(daniel.boelzle) → review+
Comment 4•17 years ago
|
||
(In reply to comment #3) > > # Note: Invoke any additional (non-xpcshell) test programs here. > > check:: > >- $(RUN_TEST_PROGRAM) $(DIST)/bin/test_all.sh $(DIST)/bin/$(MODULE) > Why have you left the check target in? I personally like it, because of the comment. We might want to add some extra tests here (I have a few ideas for that, wanting some way to measure performance)
Reporter | ||
Comment 5•17 years ago
|
||
Comment on attachment 291122 [details] [diff] [review] [checked in] Patch for Makefile v1 (TRUNK ONLY) Checked in on HEAD.
Attachment #291122 -
Attachment description: Patch for Makefile v1 (TRUNK ONLY) → [checked in] Patch for Makefile v1 (TRUNK ONLY)
Updated•16 years ago
|
Updated•16 years ago
|
Flags: tb-integration?
Assignee | ||
Comment 6•16 years ago
|
||
I don't see how this affects TB-integration. This is essentially a Sunbird bug. What you really want to get working/passing for Lightning integration is any tests which are run in calendar/ when you do "make check". I think this bug covers more than that.
Comment 7•16 years ago
|
||
(In reply to comment #6) As far as I know Thunderbird now requires unittests. If Lightning gets integrated the same rules should be applied to the calendar code. If this isn't required than this bug is probably not blocking the integration.
Reporter | ||
Updated•16 years ago
|
Depends on: 458190
Summary: Enable unit tests on Trunk tinderboxen → Create unittest buildbots for Calendar
Comment 8•16 years ago
|
||
I don't think we'd block based on this bug.
Flags: tb-integration? → tb-integration-
Reporter | ||
Updated•15 years ago
|
Assignee: mschroeder → nobody
Status: ASSIGNED → NEW
Updated•15 years ago
|
Flags: blocking-calendar1.0+
Whiteboard: [not needed beta][no l10n impact]
Comment 9•14 years ago
|
||
As a first step, we should make sure that unit tests work. This patch allows running make xpcshell-tests when building Lightning with Thunderbird and also fixes our unit tests. I have a strange error on one test that seems to be fixed by adding a dump() statement. This is probably some sort of timing issue, but I haven't found out why.
Comment 10•14 years ago
|
||
comm/mozilla-central now requires the use of xpcshell.ini, see bug 658666. This patch takes care and uses buildlist.py to include the lightning tests in the app xpcshell.ini. Not sure if the latter fully needed, but I had the feeling it is. A slightly modified version could be checked in on comm-miramar.
Attachment #524642 -
Attachment is obsolete: true
Attachment #534892 -
Flags: review?(mschroeder)
Attachment #524642 -
Flags: review?(mschroeder)
Reporter | ||
Comment 11•13 years ago
|
||
Comment on attachment 534892 [details] [diff] [review] [backed out] Make unit tests work with comm-central This seems to work fine after adding the two additional test files (test_webcal.js and test_bug668222.js). r=mschroeder
Attachment #534892 -
Flags: review?(mschroeder) → review+
Comment 12•13 years ago
|
||
Comment on attachment 534892 [details] [diff] [review] [backed out] Make unit tests work with comm-central changeset: 8242:ec28666abc48 user: Philipp Kewisch <mozilla@kewis.ch> date: Fri Aug 05 21:00:48 2011 +0200 summary: Bug 405007 - Create unittest buildbots for Calendar. r=mschroeder Keeping open for buildbot work.
Attachment #534892 -
Attachment description: Make unit tests work with comm-central → [checked in] Make unit tests work with comm-central
![]() |
||
Comment 14•13 years ago
|
||
Fallen FYI: Building SeaMonkey trunk with ac_add_options --enable-calendar fails since /suite/test/xpcshell.ini is missing the folllowing line: [include:calendar/test/unit/xpcshell.ini]
Comment 15•13 years ago
|
||
Someone, please back this out (r=bustage) per me. (In reply to Philipp Kewisch [:Fallen] from comment #13) > Undid accidental mail changes in comm-central changeset 8951a95a0755 This was caused due to buildlist.py pointing at the SRCDIR and modifying the thunderbird xpcshell.ini when it shouldn't, keeping this in will cause someone else to checkin that change by accident, I guarantee it. (In reply to Philip Chee from comment #14) > Fallen FYI: > > Building SeaMonkey trunk with > ac_add_options --enable-calendar > fails since > /suite/test/xpcshell.ini is missing the folllowing line: > [include:calendar/test/unit/xpcshell.ini] This is sadly also a reason I want you to backout, please do $(MOZ_BUILD_APP) if you need to reference a file in mail/ (that is also in suite/) otherwise TEST on MOZ_BUILD_APP here. Thanks
Comment 16•13 years ago
|
||
Backed out, sorry for the hassle. changeset: 8250:8e61adaa68ab tag: tip user: Philipp Kewisch <mozilla@kewis.ch> date: Sat Aug 06 19:27:00 2011 +0200 summary: Backout bug 405007 - Create unittest buildbots for Calendar r=bustage (In reply to Justin Wood (:Callek) from comment #15) > Someone, please back this out (r=bustage) per me. > > (In reply to Philipp Kewisch [:Fallen] from comment #13) > > Undid accidental mail changes in comm-central changeset 8951a95a0755 > > This was caused due to buildlist.py pointing at the SRCDIR and modifying the > thunderbird xpcshell.ini when it shouldn't, keeping this in will cause > someone else to checkin that change by accident, I guarantee it. Seems this was changed in the meanwhile, but iirc then mail was doing something similar to copy over the mozilla/testing xpcshell.ini. I may be mistaking though. > > (In reply to Philip Chee from comment #14) > > Fallen FYI: > > > > Building SeaMonkey trunk with > > ac_add_options --enable-calendar > > fails since > > /suite/test/xpcshell.ini is missing the folllowing line: > > [include:calendar/test/unit/xpcshell.ini] > > This is sadly also a reason I want you to backout, please do > $(MOZ_BUILD_APP) if you need to reference a file in mail/ (that is also in > suite/) otherwise TEST on MOZ_BUILD_APP here. Ok, will do so in the next iteration.
Reporter | ||
Updated•13 years ago
|
Attachment #534892 -
Attachment description: [checked in] Make unit tests work with comm-central → [backed out] Make unit tests work with comm-central
Assignee | ||
Comment 18•13 years ago
|
||
This is a slightly different approach. As discovered in bug 659898 we need to add our own stuff to mozinfo.js which may be a bit more complicated, but doable, just not got time. The basic idea here is to skip the calendar tests if we're running TB's or SM's full suite of tests. That's because we haven't got anything into mozinfo.js to say if calendar/lightning is built yet or not. However, by doing this, we've got an entry in the relevant xpcshell.ini which keeps the build system happy. Although we're skipping the tests in the main suite, we can still run them with: make -C objdir/calendar/test xpcshell-tests which means that a) the tests can actually be run, b) we can hack buildbot to make them run, c) they become useful. We can then do a follow-up later to make a switch so that the tests will be run if Lightning is being built. I've tested both configurations and the build system doesn't complain, and the tests run fine.
Attachment #552359 -
Flags: review?(philipp)
Assignee | ||
Comment 19•13 years ago
|
||
Oh note that test_webcal.js fails for me on my Mac, which is why I disabled it (we can deal in a follow-up if you wnat).
Comment 21•13 years ago
|
||
Comment on attachment 552359 [details] [diff] [review] [checked in] Alternate temporary get tests runnable Looks fine, sorry for the delay. r=philipp
Attachment #552359 -
Flags: review?(philipp) → review+
Assignee | ||
Comment 22•13 years ago
|
||
Comment on attachment 552359 [details] [diff] [review] [checked in] Alternate temporary get tests runnable Checked in: http://hg.mozilla.org/comm-central/rev/5826442dafae with a follow-up that completely disables test_webcal.js due to an error, which bug 680201 will fix: http://hg.mozilla.org/comm-central/rev/1f48f873106e
Attachment #552359 -
Attachment description: Alternate temporary get tests runnable → [checked in] Alternate temporary get tests runnable
Assignee | ||
Comment 23•13 years ago
|
||
I've now enabled building of tests for all the Lightning comm-central builders: http://hg.mozilla.org/build/buildbot-configs/rev/2909046e0a50 http://hg.mozilla.org/build/buildbot-configs/rev/de8369b8cd85 I've also done a local addition to buildbot's master.cfg just after the upload step: # XXX Hack to allow calendar to run xpcshell-tests if mozilla_branch == "mozilla-central": mozilla2_dep_factory.addStep(unittest_steps.MozillaCheck, test_name="xpcshell-tests", warnOnWarnings=True, workdir="build/%s/calendar/test" % pf['platform_objdir'], timeout=5*60, # 5 minutes. ) This allows the Lightning builders to just run the Lightning xpcshell-tests. This is in a non-packaged form, so will extend the time of the build by a small amount. This is the easiest way to get them running without adding too much hardware time and needing more hardware. So far only the Linux 64 bit builder has been running. I've only just enabled the others, but I'm confident that they should run correctly. Philipp: if you want to run these on aurora, that is easy to do as well.
Assignee: philipp → mbanner
Assignee | ||
Comment 24•13 years ago
|
||
The Mac tests completely failed, I'm not sure why, but it may be something to do with the universal build. I've disabled them until I get chance to look in more detail.
Assignee | ||
Comment 25•13 years ago
|
||
Windows and Linux stuck and are running nicely green. I'll try and take a look at Mac next week.
Comment 26•13 years ago
|
||
Mark, I'd appreciate if we could transplant these changes to both aurora and beta, that would have calendar in sync across all trees. The additional fix from bug 680742 should also be transplanted. Any objections?
Updated•13 years ago
|
Target Milestone: --- → Trunk
Assignee | ||
Comment 27•13 years ago
|
||
(In reply to Philipp Kewisch [:Fallen] from comment #26) > Mark, I'd appreciate if we could transplant these changes to both aurora and > beta, that would have calendar in sync across all trees. The additional fix > from bug 680742 should also be transplanted. Any objections? No objections, I can transplant them if you want. Once these are on aurora, I'll also enable xpcshell-tests there.
Comment 28•13 years ago
|
||
As long as it doesn't cause the same regression as on the win32 nightly comm-central builder (Bug 682540) ...
Comment 29•13 years ago
|
||
(In reply to Mark Banner (:standard8) from comment #27) > (In reply to Philipp Kewisch [:Fallen] from comment #26) > > Mark, I'd appreciate if we could transplant these changes to both aurora and > > beta, that would have calendar in sync across all trees. The additional fix > > from bug 680742 should also be transplanted. Any objections? > > No objections, I can transplant them if you want. Once these are on aurora, > I'll also enable xpcshell-tests there. Go ahead, and please clobber afterwards. That seemed to fix the win32 builder.
Assignee | ||
Comment 30•13 years ago
|
||
Checked into aurora and beta: http://hg.mozilla.org/releases/comm-aurora/rev/092d1cb3a091 http://hg.mozilla.org/releases/comm-aurora/rev/dda730b7af4a http://hg.mozilla.org/releases/comm-beta/rev/de55382cc023 http://hg.mozilla.org/releases/comm-beta/rev/7e9fc8c8b8f1
Assignee | ||
Comment 31•13 years ago
|
||
I've now added enable-tests to just the linux & mac builds on aurora: http://hg.mozilla.org/build/buildbot-configs/rev/d83f4e213cd6 and I've altered buildbot so that unit test should get run on linux 32 & 64 bit builds on aurora as well as on central. Builders are currently busy, so it may be a while before we can tell.
Assignee | ||
Comment 32•13 years ago
|
||
Linux (32 & 64 bit) unit tests are now running fine on comm-aurora.
Assignee | ||
Comment 33•13 years ago
|
||
Now we've got the Windows builder green on trunk, I've turned on enable-tests for comm-aurora and comm-beta for it: http://hg.mozilla.org/build/buildbot-configs/rev/d76ae177e5b9 If this runs fine over the next day, then I'll enable running the tests.
Assignee | ||
Comment 34•13 years ago
|
||
I've locally modified buildbot master to allow tests to additionally run on Windows comm-aurora and on Windows and Linux comm-beta.
Assignee | ||
Comment 35•13 years ago
|
||
(In reply to Mark Banner (:standard8) from comment #34) > I've locally modified buildbot master to allow tests to additionally run on > Windows comm-aurora and on Windows and Linux comm-beta. Linux comm-beta ran fine. Now just waiting for Windows to run on aurora and beta.
Assignee | ||
Comment 37•13 years ago
|
||
Windows tests ran fine. So Linux & Windows tests are on all branches: http://hg.mozilla.org/build/buildbot-configs/rev/585f8dcb13c5 Mac is to be handled by bug 689126.
Status: ASSIGNED → RESOLVED
Closed: 13 years ago
Resolution: --- → FIXED
You need to log in
before you can comment on or make changes to this bug.
Description
•