Aki Sasaki (not active) Reporter
	Description • 15 years ago

For blassey.  stuart says before winmo fennec b1 would be good.

	Nick Thomas [:nthomas] (UTC+12)
	Comment 1 • 15 years ago

Would be worth checking if bug 504437 also applies to WinMo, suspect it will given the same Visual Studio version. I used the LiveHTTPHeaders extension to capture that URL.

	Aki Sasaki (not active) Reporter
	Comment 2 • 15 years ago

/me reads up on https://wiki.mozilla.org/UpdateGeneration

	Aki Sasaki (not active) Reporter
	Comment 3 • 15 years ago

Question: this is only for nightly builds, not a release channel, correct?

Looks like I'll be spending the bulk of this week on fennec l10n for b4.

	Brad Lassey [:blassey] (use needinfo?)
	Comment 4 • 15 years ago

why is bug 511967 blocking this?

	Aki Sasaki (not active) Reporter
	Comment 5 • 15 years ago

We're doing so many updates now (with l10n nightlies) that en-US updates were showing up after noon PST.  We need to move the update work onto the build slaves where there's a lot more parallel processing power.

	Brad Lassey [:blassey] (use needinfo?)
	Comment 6 • 15 years ago

that's not a bad thing, but that still doesn't block doing winmo updates

	Aki Sasaki (not active) Reporter
	Comment 7 • 15 years ago

Ok, I can remove it.  Aiui, doing this before bug 511967 means we'll have to do this twice; afterwards, once.

	Chris Cooper [:coop] (he/him)
	Comment 8 • 15 years ago

(In reply to comment #6)
> that's not a bad thing, but that still doesn't block doing winmo updates

Sure, it's not strictly blocking, but unless I hear that this is a short-term necessity, I'm going to follow the path where I do this work once (bug 511967) instead of twice.

	Aki Sasaki (not active) Reporter
	Comment 9 • 15 years ago

Constantly getting pinged about this, as we have ~1500 winmo users (aiui) who aren't testing the latest builds due to this bug.

Not sure when I'll have time for this so I'm throwing back in the pool and hoping someone's interested.  Coop says this should proceed before he's done with updates-on-slaves.

	Chris Cooper [:coop] (he/him)
	Comment 10 • 15 years ago

(In reply to comment #9)
> Constantly getting pinged about this, as we have ~1500 winmo users (aiui) who
> aren't testing the latest builds due to this bug.
> 
> Not sure when I'll have time for this so I'm throwing back in the pool and
> hoping someone's interested.  Coop says this should proceed before he's done
> with updates-on-slaves.

Talked with blassey at the all-hands about this, and yes, we're all agreed this should go ahead. We've decided not to block on the updates-on-slaves work (bug 511967) bug we are blocked on getting complete mars generated for winmo (bug 534025). Not sure who should pick up that bug/work. blassey?

	Doug Turner (:dougt)
	Comment 11 • 15 years ago

how is bug 511967 blocking this bug?

	Aki Sasaki (not active) Reporter
	Comment 12 • 15 years ago

Wasn't that removed back in comment 7 ?

	Doug Turner (:dougt)
	Comment 13 • 15 years ago

never mind, misread comment 10.  Sounds like nothing is blocking moving forward on this.  ETA?

	Chris Cooper [:coop] (he/him)
	Comment 14 • 15 years ago

I'll be picking this up tomorrow. Armen might grab it instead, but he's pretty busy with WinCE stuff right now.

	Chris Cooper [:coop] (he/him)
	Comment 15 • 15 years ago

blassey: one thing I'll need to proceed is the OS/ABI identifier string for a WinMo build as generated by the updater.

I don't know how easy this is to do on a WinMo device. On other platforms, it's a matter of editing the firefox.js prefs file and adding a preference for "app.update.log=true", starting the build from a console, and then watching the console output as you click the "Check for Updates..." menu option.

e.g. when I do that on my Mac, I see this in the output:

*** AUS:SVC Checker:getUpdateURL - update URL: https://aus2.mozilla.org/update/3/Firefox/3.6b4/20091124201530/Darwin_Universal-gcc3/en-US/beta/Darwin%2010.2.0/default/default/update.xml?force=1

We're looking for the WinMo-equivalent of "Darwin_Universal-gcc3" in the above output, although posting the entire output wouldn't hurt either.

	Doug Turner (:dougt)
	Comment 16 • 15 years ago

coop, is this the same as the TARGET_XPCOM_ABI that is defined by configure?

	Chris Cooper [:coop] (he/him)
	Comment 17 • 15 years ago

(In reply to comment #16)
> coop, is this the same as the TARGET_XPCOM_ABI that is defined by configure?

Partly. Here's where the string gets put together:

http://mxr.mozilla.org/mozilla-central/source/toolkit/mozapps/update/src/nsUpdateService.js.in#1932

Casual inspection of the WinMo nightly logs indicates to me that the final string will be WINCE_arm-msvc, which is the same as for WinCE. This shouldn't bite us as long as the product name remains Fennecat least that's what I take away from bug 515748.

	Doug Turner (:dougt)
	Comment 18 • 15 years ago

WINCE_arm-msvc sounds right.  But, I brad did change the target to:

--target=arm-wince-winmo

When is your nightly from?

	Chris Cooper [:coop] (he/him)
	Comment 19 • 15 years ago

(In reply to comment #18)
> When is your nightly from?

1.9.2 nightly from last night:

http://tinderbox.mozilla.org/showlog.cgi?log=Mobile/1261040888.1261044880.14088.gz&fulltext=1

	Doug Turner (:dougt)
	Comment 20 • 15 years ago

yeah, that nightly is not correct.  blassey did post (maybe even filed a bug?) about switching the --target and the nightly box doesn't have that change.


can we make that change?  The mozconfig should have this:

ac_add_options --target=arm-wince

be

ac_add_options --target=arm-wince-winmo

	Nick Thomas [:nthomas] (UTC+12)
	Comment 21 • 15 years ago

bug 515748 only landed on mozilla-central so far, so the target change would break the build on m-1.9.2.

	Chris Cooper [:coop] (he/him)
	Comment 22 • 15 years ago

(In reply to comment #21)
> bug 515748 only landed on mozilla-central so far, so the target change would
> break the build on m-1.9.2.

Do we want to re-open bug 515748 until we get the requested 1.9.2 approval for https://bugzilla.mozilla.org/attachment.cgi?id=416128&action=edit ?

	Brad Lassey [:blassey] (use needinfo?)
	Comment 23 • 15 years ago

generally bugs are closed when they're fixed on trunk.

	Chris Cooper [:coop] (he/him)
	Comment 24 • 15 years ago

I've got a build step generating a mar for WinMo trunk in staging now. Next chunk of work is generating a complete snippet and then getting mars and snippets uploaded to the correct places.

	Chris Cooper [:coop] (he/him)
	Comment 25 • 15 years ago

I have WinMo nightlies generating/uploading a mar and uploading a snippet in staging now. I'll post some patches for Aki to review shortly.

I'm currently investigating what AUS and patcher changes will be required to make this work.

	Chris Cooper [:coop] (he/him)
	Comment 26 • 15 years ago

This is running on staging-nightly-updates right now and successfully generate

I added some extra output behind the $verbose flag as well.

	Chris Cooper [:coop] (he/him)
	Comment 27 • 15 years ago

This is my stab at updating the AUS config to accept Fennec as an updatable product. 

morgamic: please let me know if there's more work to do here.

	Chris Cooper [:coop] (he/him)
	Comment 28 • 15 years ago

There's a tiny bit of cleanup in MobileBuildFactory also.

config patch is coming next.

	Chris Cooper [:coop] (he/him)
	Comment 29 • 15 years ago

I made one change here that's a little more intrusive, and that's setting 'stage_base_path' as '/home/ftp/pub/mobile' for all the mobile builds. These were all inheriting from the main config before, so all our mobile builds were going into /pub/firefox. 

I *think* we want our mobile builds going directly into /pub/mobile/, but I haven't heard anything official either way.

	Aki Sasaki (not active) Reporter
	Comment 30 • 15 years ago

Comment on attachment 419472 [details] [diff] [review]
Generate complete mar and snippet for WinMo (buildbotcustom)

Nit: I think catlee wants lists to have [spaces, in, between]. I don't mind either way though.

r=me; thanks for doing this.

	Aki Sasaki (not active) Reporter
	Comment 31 • 15 years ago

Comment on attachment 419474 [details] [diff] [review]
Generate complete mar and snippet for WinMo (buildbot-configs)

Did you intend to point to mobile/nightly instead of firefox/nightly?

Currently mobile/nightly is a softlink to ../../firefox/nightly/latest-mobile-trunk, which is a constant source of confusion.  However, unless we fix everything, we'll either a) end up with two nightly locations (if we remove the softlink first) or b) end up with firefox/nightly/latest-mobile-trunk/latest-mobile-*-l10n/ which will be worse.

So I'd recommend holding off on that and futuring the mobile upload fix. However, if you want to tackle that as part of this, then we need to warn everyone, then change all the firefox/nightly and firefox/tinderbox-builds references to mobile/* and remove the mobile/nightly softlink.

	Michael Morgan [:morgamic]
	Comment 32 • 15 years ago

Comment on attachment 419468 [details] [diff] [review]
Add Fennec to the list of products in AUS

Missing a comma.  Otherwise, looks good.  Will have to make sure the multi-locale thing maps to a real filepath.  Other than that things should work fine.

	Aki Sasaki (not active) Reporter
	Comment 33 • 15 years ago

Comment on attachment 419474 [details] [diff] [review]
Generate complete mar and snippet for WinMo (buildbot-configs)

Hm, on second viewing looks like you've already updated firefox->mobile (minus removing the softlink) -- did it work?

Another nit -- the staging nightly times. Not sure if this is important though.

	Reed Loden [:reed]
	Comment 34 • 15 years ago

Is there a bug on adding the required app.update.* prefs to mobile.js for this to actually work?

	Reed Loden [:reed]
	Comment 35 • 15 years ago

(In reply to comment #34)
> Is there a bug on adding the required app.update.* prefs to mobile.js for this
> to actually work?

I looked, didn't find anything, so I filed bug 537181.

	Chris Cooper [:coop] (he/him)
	Comment 36 • 15 years ago

(In reply to comment #32)
> (From update of attachment 419468 [details] [diff] [review])
> Missing a comma.  Otherwise, looks good.  Will have to make sure the
> multi-locale thing maps to a real filepath.  Other than that things should work
> fine.

Hrmmm, thinking a little more about this, we'll want to have both mozilla-central- and 1.9.2-based versions of Fennec in AUS (I've been using m-c for testing, but 1.9.2 is the current release version). Unfortunately, Fennec makes no version distinction between m-c and 1.9.2 at present, i.e. builds from both branches have the same version. 

I filed bug 537314 on this.

	Chris Cooper [:coop] (he/him)
	Comment 37 • 15 years ago

(In reply to comment #33)
> (From update of attachment 419474 [details] [diff] [review])
> Hm, on second viewing looks like you've already updated firefox->mobile (minus
> removing the softlink) -- did it work?

It worked fine in staging, but I wasn't really paying attention to anything aside from WinMo. 

If it's easier to just go with firefox/* instead of mobile/*, I can do that. I'm not looking to change the world here (necessarily). Is there a bug filed for that change (firefox/->mobile/ upload dest) already?
 
> Another nit -- the staging nightly times. Not sure if this is important though.

Yeah, I'll put that back.

	Aki Sasaki (not active) Reporter
	Comment 38 • 15 years ago

Comment on attachment 419474 [details] [diff] [review]
Generate complete mar and snippet for WinMo (buildbot-configs)

r+ with the staging nightly schedule nit.

We need to coordinate since there's a little bit that needs to happen on stage.m.o before this, but I should have that ready soon.

	Chris Cooper [:coop] (he/him)
	Comment 39 • 15 years ago

There are a bunch of things that need resolution before this can push forward:

* what is the product called on WinMo? I see that bug 537396 is now fixed, but does that also apply to WinMo? Do we still want to setup AUS to handle a separate Fennec product if we're simply going to rename it to Firefox? Maybe we do for development work, but let's explicitly make that call.

* add the required prefs to allow for app updating: bug 537181

* determine how to differentiate between WinCE (tegra) and WinMo devices that are requesting updates. If tegra==Firefox and WinMo==Fennec then we dodge around this, but AFAICT both devices will request updates as WINCE_arm-msvc otherwise. I don't think this was addressed by bug 515748 because the updater relies on what the underlying OS reports. Maybe we patch the updater?

* use different version numbers for Fennec built against different branches: bug 537314

	Nick Thomas [:nthomas] (UTC+12)
	Comment 40 • 15 years ago

Comment on attachment 419466 [details] [diff] [review]
Allow patch-packager to process updates for mobile builds

Sorry for the delay, I lost track of this request. r+ and for bonus points you could s/emptry/empty/.

	Brad Lassey [:blassey] (use needinfo?)
	Comment 41 • 15 years ago

what's left for this?

	Chris Cooper [:coop] (he/him)
	Comment 42 • 15 years ago

(In reply to comment #41)
> what's left for this?

The short list is in comment 39. AFAICT those are all product considerations rather than RelEng issues. 

* The AUS changes are trivial but it requires a decision on the product side.

* Without the required prefs, we can't update WinMo builds anyway -> bug 537181

* Differentiating between WinCE and WinMo so we don't offer updates to the wrong platform. Maybe we get a better picture of this once the update prefs are in place and we can see the request they are making, but it should be possible to piece together what that request would be now.

* Differentiate between version numbers so we don't update to the wrong branch. I don't know how Fennec versioning works right now. If building off trunk were to be renamed as 2.0pre (similar to what we do for Firefox) and 1.9.2 stays as 1.0, that would work, provided the versioning isn't done solely in the mobile code (unless we get a separate repo for mobile-1.9.2, of course).

	Brad Lassey [:blassey] (use needinfo?)
	Comment 43 • 15 years ago

(In reply to comment #42)
> (In reply to comment #41)
> > what's left for this?
> 
> The short list is in comment 39. AFAICT those are all product considerations
> rather than RelEng issues. 
>(In reply to comment #39)
>> There are a bunch of things that need resolution before this can push forward:
>> 
>> * what is the product called on WinMo? I see that bug 537396 is now fixed, but
>> does that also apply to WinMo? Do we still want to setup AUS to handle a
>> separate Fennec product if we're simply going to rename it to Firefox? Maybe we
>> do for development work, but let's explicitly make that call.
Fennec is the project code name, much like Namoroka. Nightlies and alphas will be called Fennec. Betas and final will be Firefox
>> 
>> * add the required prefs to allow for app updating: bug 537181
patch submitted, requested gavin's review
>> 
>> * determine how to differentiate between WinCE (tegra) and WinMo devices that
>> are requesting updates. If tegra==Firefox and WinMo==Fennec then we dodge
>> around this, but AFAICT both devices will request updates as WINCE_arm-msvc
>> otherwise. I don't think this was addressed by bug 515748 because the updater
>> relies on what the underlying OS reports. Maybe we patch the updater?
Is the problem the update url? If that's the case we can differentiate there. Also, if that's the case, we'd have the same problem with the block list.
>> 
>> * use different version numbers for Fennec built against different branches:
>> bug 537314
discussion happening in that bug.

	Chris Cooper [:coop] (he/him)
	Comment 44 • 15 years ago

This work is currently scheduled for March to coincide with other RelEng work on WinMo scaling. As such, it will also benefit from the work in bug 511967.

We may have the opportunity to pick this up again sooner, depending on the completion of other goals.

	Chris Cooper [:coop] (he/him)
	Comment 45 • 15 years ago

Comment on attachment 419472 [details] [diff] [review]
Generate complete mar and snippet for WinMo (buildbotcustom)

http://hg.mozilla.org/build/buildbotcustom/rev/6bf6a7214cea

	Chris Cooper [:coop] (he/him)
	Comment 46 • 15 years ago

Comment on attachment 419474 [details] [diff] [review]
Generate complete mar and snippet for WinMo (buildbot-configs)

http://hg.mozilla.org/build/buildbot-configs/rev/bd800f5bdecc

	Chris Cooper [:coop] (he/him)
	Comment 47 • 15 years ago

Comment on attachment 419466 [details] [diff] [review]
Allow patch-packager to process updates for mobile builds

Checking in patch-packager-production.cfg;
/mofo/release/patcher/patch-packager-production.cfg,v  <--  patch-packager-production.cfg
new revision: 1.6; previous revision: 1.5
done
Checking in patch-packager-staging.cfg;
/mofo/release/patcher/patch-packager-staging.cfg,v  <--  patch-packager-staging.cfg
new revision: 1.5; previous revision: 1.4
done
Checking in patch-packager.pl;
/mofo/release/patcher/patch-packager.pl,v  <--  patch-packager.pl
new revision: 1.32; previous revision: 1.31
done

	Chris Cooper [:coop] (he/him)
	Comment 48 • 15 years ago

(In reply to comment #38)
> We need to coordinate since there's a little bit that needs to happen on
> stage.m.o before this, but I should have that ready soon.

Patches are landed and running in staging. 

I'll roll up a config patch for production but as Aki says, we'll want to fix up the symlinks on stage.m.o before making the dir change for firefox/ -> mobile/ there.

	Brad Lassey [:blassey] (use needinfo?)
	Comment 49 • 15 years ago

I don't think bug 537314 blocks this since the update url has both the fennec version and the gre milestone in it.

	John O'Duinn [:joduinn] (please use "needinfo?" flag)
	Comment 50 • 15 years ago

Added dep.bug as we cant keep piling even more onto the single machine (prometheus-vm) generating all updates.

	Brad Lassey [:blassey] (use needinfo?)
	Comment 51 • 15 years ago

as discussed earlier, that seems like a nice thing to have but in no way does it block this getting done.

	John O'Duinn [:joduinn] (please use "needinfo?" flag)
	Comment 52 • 15 years ago

(In reply to comment #50)
> Added dep.bug as we cant keep piling even more onto the single machine
> (prometheus-vm) generating all updates.

(In reply to comment #51)
> as discussed earlier, that seems like a nice thing to have but in no way does
> it block this getting done.

Valid point - strictly speaking, we could load WinMO updates onto the same machine, generated last after all the usual updates for 1.9.0, m-c, and the recently added updates for 1.9.1, 1.9.2, across all locales. The WinMO updates would be available late in the day, but so long as we stay under 24hours to generate all the updates, then we're always done before the next nightly updates start.

However, we're focusing on bug#527314 first, because generating updates on pool-o-slaves:
- is a pre req for updates on project branches (including Lorentz)
- is needed before we could support another release branch like 3.7
- eliminates single point of failure.

This is being actively worked on; sorry for not linking the dep bugs earlier so you could see that.

	Chris Cooper [:coop] (he/him)
	Comment 53 • 15 years ago

Mass move of bugs from Release Engineering:Future -> Release Engineering. See
http://coop.deadsquid.com/2010/02/kiss-the-future-goodbye/ for more details.

	Chris Cooper [:coop] (he/him)
	Comment 54 • 15 years ago

Two things are still blocking this:
* updating AUS to use the new GUID or PLATFORM_MILESTONE URL format (bug 540007). The ball is in morgamic's court on this AFAIK.
* getting the changes for bug 535369 landed on m-c, which will unblock bug 511967. I've been stuck waiting for the tree to re-open like everyone else here.

	Chris Cooper [:coop] (he/him)
	Comment 55 • 15 years ago

This has already been working in staging for a while.

	Armen [:armenzg]
	Comment 56 • 15 years ago

Comment on attachment 427445 [details] [diff] [review]
Turn on complete mar creation for WinMo on 1.9.2 in production

Stamped!

	Chris Cooper [:coop] (he/him)
	Comment 57 • 15 years ago

Comment on attachment 427445 [details] [diff] [review]
Turn on complete mar creation for WinMo on 1.9.2 in production

http://hg.mozilla.org/build/buildbot-configs/rev/53ca588e1294

	Chris Cooper [:coop] (he/him)
	Comment 58 • 15 years ago

pm02 has been reconfig-ed. Should have complete MARs for 1.9.2 tomorrow.

	Nick Thomas [:nthomas] (UTC+12)
	Comment 59 • 15 years ago

Got asked about this today, some comments
* we're not getting any complete mars for 1.9.2 or m-c WinMo nightlies at the moment, comment #58 implies we should be
* need to publish snippets to .../build/0/{a23983c0-fd0e-11dc-95ff-0800200c9a66} instead of 0/Fennec
* in attachment 419466 [details] [diff] [review] need to s/Fennec/{a23983c0-fd0e-11dc-95ff-0800200c9a66}/, generating a partial works ok with this
* to get builds seeing updates with something like attachment 419468 [details] [diff] [review], this WFM in config-dist.php in the productBranchVersion array
    '{a23983c0-fd0e-11dc-95ff-0800200c9a66}'      =>  array(
        '*_1.9.2*' => 'mozilla-1.9.2',
        '*_1.9.3*' => 'mozilla-central'
    ),

	Nick Thomas [:nthomas] (UTC+12)
	Comment 60 • 15 years ago

(In reply to comment #59)
> Got asked about this today, some comments
> * we're not getting any complete mars for 1.9.2 or m-c WinMo nightlies at the
> moment, comment #58 implies we should be

This is because attachment 419474 [details] [diff] [review] is only for staging

	Chris Cooper [:coop] (he/him)
	Comment 61 • 15 years ago

We're using %VERSION%-%GRE_VERSION% to identify Fennec now, as decided in bug 546695.

	Chris Cooper [:coop] (he/him)
	Comment 62 • 15 years ago

Switch to using appropriate Fennec version to generate partial patches, as decided in bug 546695.

	Aki Sasaki (not active) Reporter
	Comment 64 • 15 years ago

Comment on attachment 432652 [details] [diff] [review]
Use the new identifier when uploading snippets for WinMo

Looks like just updates for 1.9.2?  WFM.

	Chris Cooper [:coop] (he/him)
	Comment 65 • 15 years ago

We weren't setting the snippet var in production, which is why we haven't been generating complete mars.

(In reply to comment #64)
> (From update of attachment 432652 [details] [diff] [review])
> Looks like just updates for 1.9.2?  WFM.

Yeah, one branch at a time, especially until we're doing updates on slaves.

	Chris Cooper [:coop] (he/him)
	Comment 66 • 15 years ago

Comment on attachment 432634 [details] [diff] [review]
Allow patch-packager to process updates for mobile builds, v2

Checking in patch-packager.pl;
/mofo/release/patcher/patch-packager.pl,v  <--  patch-packager.pl
new revision: 1.33; previous revision: 1.32
done

	Chris Cooper [:coop] (he/him)
	Comment 67 • 15 years ago

Comment on attachment 432652 [details] [diff] [review]
Use the new identifier when uploading snippets for WinMo

http://hg.mozilla.org/build/buildbot-configs/rev/2633409cf8ae

	Chris Cooper [:coop] (he/him)
	Comment 68 • 15 years ago

Comment on attachment 432662 [details] [diff] [review]
Set necessary vars in production winmo factory

http://hg.mozilla.org/build/buildbot-configs/rev/2633409cf8ae

	Michael Morgan [:morgamic]
	Comment 69 • 15 years ago

Comment on attachment 432606 [details] [diff] [review]
Add Fennec to the list of products in AUS, v2

This should work.  Looks good to me.

	Chris Cooper [:coop] (he/him)
	Comment 70 • 15 years ago

Comment on attachment 432606 [details] [diff] [review]
Add Fennec to the list of products in AUS, v2

Checking in xml/inc/config-dist.php;
/cvsroot/mozilla/webtools/aus/xml/inc/config-dist.php,v  <--  config-dist.php
new revision: 1.67; previous revision: 1.66
done

morgamic: what's the procedure to get this AUS change into production now that it's landed?

	Nick Thomas [:nthomas] (UTC+12)
	Comment 71 • 15 years ago

Mike's not CC'd here so I'll answer that instead. There's some tagging to do and then file a bug against IT. I can take care of that with attachment 425743 [details] [diff] [review] and push them both live at the same time.

	Nick Thomas [:nthomas] (UTC+12)
	Comment 72 • 15 years ago

Tagging done at bug 542142 comment #17. Bug 553421 to get the change here deployed.

	Chris Cooper [:coop] (he/him)
	Comment 73 • 15 years ago

Into stasis it goes.