Most of the time using zst gives far better decompression performance than xz, at the cost of slightly worse compression performance.

For toolchains that are used in CI, we should prefer zst.

Depends on D74925

Depends on D74926

Depends on D74927

Depends on D74928

Depends on D74929

Just to check: MozillaBuild's version of tar can handle zstd when we download a clang in boostrap?

(In reply to :dmajor from comment #7)

Just to check: MozillaBuild's version of tar can handle zstd when we download a clang in boostrap?

Probably not, but I'm planning on adjusting bootstrap to handle them using the python-zstandard module.

(In reply to Chris AtLee [:catlee] from comment #8)

(In reply to :dmajor from comment #7)

Just to check: MozillaBuild's version of tar can handle zstd when we download a clang in boostrap?

Probably not, but I'm planning on adjusting bootstrap to handle them using the python-zstandard module.

Seems like we'd need to be set as a blocking bug of this.

(In reply to :dmajor from comment #9)

(In reply to Chris AtLee [:catlee] from comment #8)

(In reply to :dmajor from comment #7)

Just to check: MozillaBuild's version of tar can handle zstd when we download a clang in boostrap?

Probably not, but I'm planning on adjusting bootstrap to handle them using the python-zstandard module.

Seems like we'd need to be set as a blocking bug of this.

I'll attach a patch to this series

FWIW, MozillaBuild doesn't include zstd, nor does its version of tar support --zstd.

If we want bootstrapping to support this, we will need to ensure that the python-zstandard module is available, or maybe we can shell out to zstd if it exists. We don't have any prior art for ensuring a python package is available from bootstrap, so I'm not sure what the best way forward here is.

Maybe the path of least resistance is to leave win64-clang-cl unchanged. Since many Windows build flavors are cross-compiled now, it's really the Linux toolchains that are the most important piece of this.

Depends on D74931

This is a simple command line utility for doing zstd compression/decompression
of stdin to stdout. It depends on python's zstandard module being available.

Depends on D74928

https://hg.mozilla.org/mozilla-central/rev/4aae9dc67310
https://hg.mozilla.org/mozilla-central/rev/aab5979b57e2
https://hg.mozilla.org/mozilla-central/rev/245952ad63ad
https://hg.mozilla.org/mozilla-central/rev/193de423be34
https://hg.mozilla.org/mozilla-central/rev/fecf02b98dd7
https://hg.mozilla.org/mozilla-central/rev/e81e04151467
https://hg.mozilla.org/mozilla-central/rev/923ff4b6bda7
https://hg.mozilla.org/mozilla-central/rev/fcd7cb8b4cdf

https://hg.mozilla.org/mozilla-central/rev/63b7f29fb954