Closed Bug 1043258 Opened 10 years ago Closed 6 years ago

Tests in automation should fail if symbols_path (and any others) are not set correctly

Categories

(Testing :: General, defect)

defect
Not set
normal

Tracking

(Not tracked)

RESOLVED INCOMPLETE

People

(Reporter: emorley, Unassigned)

References

(Blocks 1 open bug)

Details

More than once we've broken symbolification without knowing it (eg bug 1042842).

We should fail test jobs orange in automation if symbols_path or the breakpad binary paths (or anything else appropriate) are not set.
It's a little tricky to do this because we don't have a concept of "running in automation" vs. "running on a developer's machine". If we can figure out a way to determine that then it wouldn't be hard to have a sanity-check for the necessary options.
We could ensure MOZ_AUTOMATION is defined on the test machines (if not already), like we do for the build machines:
http://mxr.mozilla.org/build-central/search?string=MOZ_AUTOMATION&case=on&find=&findi=&filter=^[^\0]*%24&hitlimit=&tree=build-central
Depends on: 1048446
Mass-closing old bugs I filed that have not had recent activity/no longer affect me.
Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.