Closed
Bug 1412014
Opened 7 years ago
Closed 7 years ago
release-notifications: Stop sending email when a release task completed
Categories
(Release Engineering :: Release Automation: Other, enhancement)
Release Engineering
Release Automation: Other
Tracking
(Not tracked)
RESOLVED
WONTFIX
People
(Reporter: jlorenzo, Assigned: jlorenzo)
References
Details
(Whiteboard: [releaseduty])
Attachments
(1 file)
In bug 1388680, we decided to kill IRC notifications sent by release-notifications (aka pulse-notify).
A few days ago, :sfraser, :bhearsum, :catlee and I thought this would a good idea not send email about succeeded tasks anymore. The main rationale is: These emails create noise and provide low value. On the other hand, links to failed tasks are actionable. If needed, it's easy to find what completed upstream task made one task fail, thanks to the task inspector.
I personally have a filter that marks completed tasks as read. After a year, I realize I've never needed a look into any completed task -- from my Inbox. However, deleting ~12 months of notifications (170.000+ threads) turned out to be painful on Gmail.
How do the other releaseduty people feel about it? Does anybody have a use case to share?
Flags: needinfo?(rgarbas)
Flags: needinfo?(rail)
Flags: needinfo?(nthomas)
Flags: needinfo?(mtabara)
Flags: needinfo?(kmoir)
Flags: needinfo?(jlund)
Flags: needinfo?(aki)
Comment 5•7 years ago
|
||
Less email is good. I think it might be good to know if things are hung, but if we're not finding that via email, then it's just noise.
Flags: needinfo?(aki)
Comment 6•7 years ago
|
||
I have a similar filter setup as you Johan, but don't look at success emails. The only use case for them I can think of is our switch to the newer scheduler API, when the task group explorer didn't handle old task group IDs any more. We have http://mozilla-release-logs.s3-website-us-east-1.amazonaws.com/ to work around that, so no objections from me for disabling success emails.
If we do this, I predict we will also want to suppress emails when a graph is cancelled.
Flags: needinfo?(nthomas)
Comment 8•7 years ago
|
||
+1 for the change. Would it make sense to wait until we have everything in-tree? and then creating a patch for this?
Flags: needinfo?(rgarbas)
Comment 9•7 years ago
|
||
Found in triaging bug 1374497 which is related. Might be worth discussing this as well in order to reduce even more our inbox churn. tl;dr: "when canceling graphs we end up with 1000+ "Exception" emails in our inboxes. Might be worth tweaking logic for non-expired and non-canceled scenarios only".
Updated•7 years ago
|
Whiteboard: [releaseduty]
Assignee | ||
Comment 10•7 years ago
|
||
It can make sense to wait until relpro is in tree. The patch in releasetasks is pretty straightforward, though. If it doesn't interfere with the tc-migration, feel free to pick it.
Attachment #8924925 -
Flags: review?(rail)
Assignee | ||
Updated•7 years ago
|
Assignee: nobody → jlorenzo
Comment 11•7 years ago
|
||
Comment on attachment 8924925 [details]
releasetasks PR
... with a nit
Attachment #8924925 -
Flags: review?(rail) → review+
Assignee | ||
Comment 12•7 years ago
|
||
Landed on master https://github.com/mozilla-releng/releasetasks/commit/de376c25f9538b7628fdc267a807747076b513b0
This will get live at next deployment.
Comment 13•7 years ago
|
||
We didn't anticipate that we'd lose logs as part of this, eg http://mozilla-release-logs.s3-website-us-east-1.amazonaws.com/mozilla-beta/firefox-58.0b5/build1/. That's a serious regression for future archaeology. Is there some way we can block emails but not logs ?
Assignee | ||
Comment 14•7 years ago
|
||
Great catch, Nick! Sorry for the lack of logs. I reverted attachment 8924925 [details] in https://github.com/mozilla-releng/releasetasks/commit/570c30e25c114b9465074aedf32d63620ad3dbd1. I deployed that commit on both bm83 and bm85.
We may be able to deploy the missing logs by fetching them from TC and uploading them manually. Nick, would you know how to get a set of creds that has write access to mozilla-release-logs.s3-website-us-east-1.amazonaws.com?
Apart from that, there's very likely a way to stop email notifications from pulse-notify. I'll look into it more closely.
Flags: needinfo?(nthomas)
Comment 15•7 years ago
|
||
I ended up changing my mind on this in bug 1425571 when implementing notifications for task failures/exceptions via taskcluster-notify. No messages for successful completion there, and we'll use task artifacts for logs as they have sufficient longevity for practical purposes. If you have cycles to reland for 58 and 52ESR then go ahead. Apologies for the churn.
Flags: needinfo?(nthomas)
Assignee | ||
Comment 16•7 years ago
|
||
I think we can leave it as is on 58 and 52esr. release-notifications will be retired after we kill esr52. Closing bug as WONTFIX.
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → WONTFIX
You need to log in
before you can comment on or make changes to this bug.
Description
•