Closed Bug 1478995 Opened 6 years ago Closed 6 years ago

get NodeJS 8.11.3 built and used as a toolchain in continuous integration

Categories

(Firefox Build System :: Toolchains, enhancement, P1)

enhancement

Tracking

(firefox63 fixed)

RESOLVED FIXED
mozilla63
Iteration:
63.3 - Aug 6
Tracking Status
firefox63 --- fixed

People

(Reporter: dmosedale, Assigned: dmosedale)

References

(Blocks 2 open bugs)

Details

Attachments

(4 files, 2 obsolete files)

This is the first piece of getting NodeJS into the tree.  Landing it will pave the way for the next chunks of allowing uses of node from moz.build to be debugged in-tree, which will in turn make things easier on the devtools team to get their debugger patches (bug 1461714) in shape for landing.

Landing this should have no effect on the day-to-day workflow of developers.
Assignee: nobody → dmose
Severity: normal → enhancement
Priority: -- → P1
Comment on attachment 8995520 [details]
Bug 1478995 - Add node toolchain repack tasks for linux, windows, and mac,

https://reviewboard.mozilla.org/r/259922/#review267394

This is reasonable given existing tools. But I have patches in bugs 1467359 and 1479533 that will enable the script to be replaced by pure YAML. Depending on when this lands, those may have landed. But we can always nuke the script as a follow-up.
Attachment #8995520 - Flags: review?(gps) → review+
Comment on attachment 8995521 [details]
Bug 1478995 - Add node toolchains to each automated build,

https://reviewboard.mozilla.org/r/259924/#review267398

This all seems pretty reasonable.

::: taskcluster/ci/build/android.yml:49
(Diff revision 1)
>          - android-sdk-linux
>          - linux64-clang
>          - linux64-rust-android
>          - linux64-rust-size
>          - linux64-sccache
> +        - linux64-node

I have a preference for the list being alphebetized. But unless there is a lint enforcing it (there isn't), I'm not inclined for make you change this if you don't want to.
Attachment #8995521 - Flags: review?(gps) → review+
Comment on attachment 8995522 [details]
Bug 1478995 - Add node toolchain path to automation mozconfigs,

https://reviewboard.mozilla.org/r/259926/#review267400

::: browser/config/mozconfigs/linux32/l10n-mozconfig:4
(Diff revision 1)
>  ac_add_options --with-l10n-base=../../l10n
>  ac_add_options --enable-update-channel=${MOZ_UPDATE_CHANNEL}
>  ac_add_options --with-branding=browser/branding/nightly
> +ac_add_options --disable-nodejs

I wish we had a configure flag that indicated "this is an l10n build" because then we could imply --disable-nodejs. But we don't. So this workaround seems reasonable.
Attachment #8995522 - Flags: review?(gps) → review+
Comment on attachment 8995521 [details]
Bug 1478995 - Add node toolchains to each automated build,

https://reviewboard.mozilla.org/r/259924/#review267398

> I have a preference for the list being alphebetized. But unless there is a lint enforcing it (there isn't), I'm not inclined for make you change this if you don't want to.

This is a bunch of hand editing that feels like it could be error prone.  Given the length of time this has already taken, I'd rather just land it as- is.  

As far as getting a linter to do the right thing here, perhaps weighing in with this use case at https://github.com/adrienverge/yamllint/issues/123 would help move the ball forward.
Attachment #8995523 - Attachment is obsolete: true
Pushed by dmosedale@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/8ced503eeb55
Add node toolchain repack tasks for linux, windows, and mac, r=gps
https://hg.mozilla.org/integration/autoland/rev/98578393d635
Add node toolchains to each automated build, r=gps
https://hg.mozilla.org/integration/autoland/rev/51795a3214ea
Add node toolchain path to automation mozconfigs, r=gps
Pushed by mozilla@jorgk.com:
https://hg.mozilla.org/comm-central/rev/43bfa39c5e32
Port bug 1478995 - added linux64-node and win64-node to toolchains. rs=bustage-fix
Pushed by mozilla@hocat.ca:
https://hg.mozilla.org/mozilla-central/rev/3cb90f16402b
Add node toolchain to osx-nightly and win64-asan-reporter builds; r=me a=tomprince
Pushed by mozilla@jorgk.com:
https://hg.mozilla.org/comm-central/rev/97c0d4f68e62
Port more of bug 1478995: add linux64-node/win64-node to macosx.yml, linux.yml and windows.yml. rs=bustage-fix
Depends on: 1480392
Add node as dependency to nightly TB builds
Comment on attachment 8997179 [details]
More bug 1478995: add linux/win64-node to nightly configs. rs=bustage-fix

Tom Prince [:tomprince] (limited availability Jul 16-29) has approved the revision.

https://phabricator.services.mozilla.com/D2684
Attachment #8997179 - Flags: review+
Pushed by mozilla@jorgk.com:
https://hg.mozilla.org/comm-central/rev/d8ce3008ef77
Port even more of bug 1478995: add linux64-node/win64-node to nightly configs. r=tomprince DONTBUILD
Comment on attachment 8995521 [details]
Bug 1478995 - Add node toolchains to each automated build,

https://reviewboard.mozilla.org/r/259924/#review268162

::: taskcluster/ci/toolchain/macosx.yml:37
(Diff revision 2)
>          toolchain-artifact: public/build/clang.tar.xz
>      toolchains:
>          - linux64-cctools-port
>          - linux64-clang-6
>          - linux64-gcc-4.9
> +        - linux64-node

huh? building macosx toolchains doesn't require node.
Pushed by ncsoregi@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/228be4ef7ed1
Fix gradle-dependencies bustage for nodejs not found. CLOSED TREE
Pushed by btara@mozilla.com:
https://hg.mozilla.org/mozilla-central/rev/3c1c7f965f0f
Fix gradle-dependencies bustage for nodejs not found. CLOSED TREE
Comment on attachment 8997179 [details]
More bug 1478995: add linux/win64-node to nightly configs. rs=bustage-fix

Tom Prince [:tomprince] has been removed from the revision.
Attachment #8997179 - Flags: review+
Attachment #8997179 - Attachment is obsolete: true
Comment on attachment 9003176 [details]
Bug 1478995: Disable nodejs is source tasks.

Mihai Tabara [:mtabara]⌚️GMT has approved the revision.
Attachment #9003176 - Flags: review+
Attachment #9003176 - Attachment description: Bug 1478995: Add node to source task. → Bug 1478995: Disable nodejs is source tasks.
Pushed by mozilla@hocat.ca:
https://hg.mozilla.org/integration/mozilla-inbound/rev/6ad53d2f8d32
Disable nodejs in source tasks; r=Callek
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: