Closed Bug 1499147 Opened 6 years ago Closed 5 years ago

Produce distributed sccache toolchain archives in automation

Categories

(Firefox Build System :: General, enhancement, P2)

enhancement

Tracking

(firefox69 fixed)

RESOLVED FIXED
mozilla69
Tracking Status
firefox69 --- fixed

People

(Reporter: nalexander, Assigned: chmanchester)

References

(Blocks 1 open bug)

Details

(Keywords: in-triage)

Attachments

(1 file)

Right now, Mozilla developers building on macOS that want to take advantage of icecream for distributed builds download environment archives from jya's Github repository at https://github.com/jyavenard/mozilla-icecream. We produce nice clang toolchains in automation; can we produce the icecream environment archives in automation as well?
jya: is there anything special about running the icecream environment creation? Does it require macOS, or can it be done from Linux (since we're cross compiling the underlying toolchain there anyway).
Flags: needinfo?(jyavenard)
I want these to be produced in automation as part of Bug 1499145.
Blocks: 1499145
ted: if I understand the upcoming distributed sccache work, macOS (and Windows) users will need to fetch some Linux64 environment archives that are conceptually similar to the icecream environment archives. Can you confirm? These tasks would be very similar to what we'd want for that, correct?
Flags: needinfo?(ted)
I have never attempted to generate the toolchain archive outside the target platform. It may be possible cross-platform so long that you have a binary-O aware tool.
Flags: needinfo?(jyavenard)
Keywords: in-triage
(In reply to Nick Alexander :nalexander [he/him] from comment #3) > ted: if I understand the upcoming distributed sccache work, macOS (and > Windows) users will need to fetch some Linux64 environment archives that are > conceptually similar to the icecream environment archives. Can you confirm? > These tasks would be very similar to what we'd want for that, correct? You're correct. sccache-dist is using the same `icecc-create-env` script for packaging C++ compilers. For cross-compilation the configuration is slightly different, in that sccache has a config file option to tell it what Linux toolchain to use when remoting compilation. I haven't actually looked into the format of the toolchain archives, but I suspect we could just make our clang toolchain jobs upload a separate artifact that's packaged properly for this use case. Once we get people using sccache-dist we'd ideally have this all plumbed into `mach bootstrap` or something.
Flags: needinfo?(ted)

Per conversation with :kmoir, I'm going through untriaged bugs in her components and marking the ones which look to be enhancements/tasks with the enhancement severity to get them out of the triage queue.

If this incorrect, please remove the tag.

Severity: normal → enhancement
Priority: -- → P2
Summary: Produce icecream toolchain archives in automation → Produce distributed sccache toolchain archives in automation
Assignee: nobody → cmanchester
Pushed by cmanchester@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/d28b10b98942 Produce archives of toolchains suitable for use with sccache-dist in automation. r=nalexander
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla69
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: