Closed Bug 1580502 Opened 5 years ago Closed 5 years ago

Install zstandard-0.11.1 on linux and OSX

Categories

(Infrastructure & Operations :: RelOps: Posix OS, enhancement)

enhancement
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: fubar, Assigned: aerickson)

References

Details

Attachments

(2 files)

Should be installed for both py27 and py3 on all POSIX OSes.

Attached file GitHub Pull Request - macos cli (deleted) —
Assignee: nobody → dhouse
Attached file GitHub Pull Request - macos python2/3 (deleted) —

macos mojave has zstandard 1.3.8 (and matching python-zstandard 0.11.1 for python2 and 3) (PR's merged)

Blocks: 1576244
Type: defect → enhancement
Assignee: dhouse → aerickson

Hi :aerickson, this problem is becoming more frequent now. Would it be possible to get a fix for this soon? Here are the failures we are having: https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&tier=1%2C2%2C3&searchStr=btime&revision=a465ca5c85f272e8db9088cad2d9217adabcb6e3

It also affects tests on the integration and try branches as well.

Blocks: 1587576
Flags: needinfo?(aerickson)

:sparky, yes, I'm busy with the TCW migration (Bug 1592377) this week, but should be able to get a fix landed next week.

:glandium, why are we producing zstandard artifacts when the libraries aren't on all systems yet?

Flags: needinfo?(aerickson) → needinfo?(mh+mozilla)

Great, thanks! We're going to make a patch to fix a majority of those failures here: https://bugzilla.mozilla.org/show_bug.cgi?id=1594210

(In reply to Andrew Erickson [:aerickson] from comment #5)

:sparky, yes, I'm busy with the TCW migration (Bug 1592377) this week, but should be able to get a fix landed next week.

:glandium, why are we producing zstandard artifacts when the libraries aren't on all systems yet?

bug 1587576 did that. It didn't need to (well, it did because of the add-prefix, but it didn't need to do that).

Flags: needinfo?(mh+mozilla)

Sorry about that. :glandium, I'm curious to know what would be the other method to accomplish the chromedriver stuff? The only ones we managed to find were using a fetch task (like for chromium) and using this add-prefix option.

Flags: needinfo?(mh+mozilla)

Why do you need add-prefix?

Flags: needinfo?(mh+mozilla)

:glandium, we needed to use that because the files extracted from the chromedriver archives all have the same name, so we couldn't tell which binary goes with which chrome version.

Are you using more than one chromedriver fetch task as a dependency?

Yes because the machines we run on don't update chrome all at the same time causing many intermittent failures when we don't have the multiple dependencies.

Are you testing all versions of chrome at once? Why not one at a time?

We technically test one version at a time, but that version is the latest chrome release available so the version changes over time. It automatically updates to the latest version, but we have issues where the machines don't perform the update at the same time leaving us with multiple versions during these "transition periods".

I really don't understand what you're doing and how. This is also highly offtopic in this bug. Can you detail this in bug 1587576?

PR to add zstandard pips to python 2 and 3 on linux: https://github.com/mozilla-releng/build-puppet/pull/627

Depends on: 1595912

PR for linux zstandard has been landed.

Hosts will install the packages on their next restart.

Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED

It's working for us now, thanks :aerickson! :)

You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: