Closed Bug 1412014 Opened 7 years ago Closed 7 years ago

release-notifications: Stop sending email when a release task completed

Categories

(Release Engineering :: Release Automation: Other, enhancement)

enhancement
Not set
normal

Tracking

(Not tracked)

RESOLVED WONTFIX

People

(Reporter: jlorenzo, Assigned: jlorenzo)

References

Details

(Whiteboard: [releaseduty])

Attachments

(1 file)

In bug 1388680, we decided to kill IRC notifications sent by release-notifications (aka pulse-notify). A few days ago, :sfraser, :bhearsum, :catlee and I thought this would a good idea not send email about succeeded tasks anymore. The main rationale is: These emails create noise and provide low value. On the other hand, links to failed tasks are actionable. If needed, it's easy to find what completed upstream task made one task fail, thanks to the task inspector. I personally have a filter that marks completed tasks as read. After a year, I realize I've never needed a look into any completed task -- from my Inbox. However, deleting ~12 months of notifications (170.000+ threads) turned out to be painful on Gmail. How do the other releaseduty people feel about it? Does anybody have a use case to share?
Flags: needinfo?(rgarbas)
Flags: needinfo?(rail)
Flags: needinfo?(nthomas)
Flags: needinfo?(mtabara)
Flags: needinfo?(kmoir)
Flags: needinfo?(jlund)
Flags: needinfo?(aki)
+1 to less email
Flags: needinfo?(kmoir)
(noise--)++ :)
Flags: needinfo?(rail)
+1
Flags: needinfo?(mtabara)
Less email is good. I think it might be good to know if things are hung, but if we're not finding that via email, then it's just noise.
Flags: needinfo?(aki)
I have a similar filter setup as you Johan, but don't look at success emails. The only use case for them I can think of is our switch to the newer scheduler API, when the task group explorer didn't handle old task group IDs any more. We have http://mozilla-release-logs.s3-website-us-east-1.amazonaws.com/ to work around that, so no objections from me for disabling success emails. If we do this, I predict we will also want to suppress emails when a graph is cancelled.
Flags: needinfo?(nthomas)
+1 :)
Flags: needinfo?(jlund)
+1 for the change. Would it make sense to wait until we have everything in-tree? and then creating a patch for this?
Flags: needinfo?(rgarbas)
Found in triaging bug 1374497 which is related. Might be worth discussing this as well in order to reduce even more our inbox churn. tl;dr: "when canceling graphs we end up with 1000+ "Exception" emails in our inboxes. Might be worth tweaking logic for non-expired and non-canceled scenarios only".
Whiteboard: [releaseduty]
Attached file releasetasks PR (deleted) —
It can make sense to wait until relpro is in tree. The patch in releasetasks is pretty straightforward, though. If it doesn't interfere with the tc-migration, feel free to pick it.
Attachment #8924925 - Flags: review?(rail)
Assignee: nobody → jlorenzo
Comment on attachment 8924925 [details] releasetasks PR ... with a nit
Attachment #8924925 - Flags: review?(rail) → review+
We didn't anticipate that we'd lose logs as part of this, eg http://mozilla-release-logs.s3-website-us-east-1.amazonaws.com/mozilla-beta/firefox-58.0b5/build1/. That's a serious regression for future archaeology. Is there some way we can block emails but not logs ?
Great catch, Nick! Sorry for the lack of logs. I reverted attachment 8924925 [details] in https://github.com/mozilla-releng/releasetasks/commit/570c30e25c114b9465074aedf32d63620ad3dbd1. I deployed that commit on both bm83 and bm85. We may be able to deploy the missing logs by fetching them from TC and uploading them manually. Nick, would you know how to get a set of creds that has write access to mozilla-release-logs.s3-website-us-east-1.amazonaws.com? Apart from that, there's very likely a way to stop email notifications from pulse-notify. I'll look into it more closely.
Flags: needinfo?(nthomas)
I ended up changing my mind on this in bug 1425571 when implementing notifications for task failures/exceptions via taskcluster-notify. No messages for successful completion there, and we'll use task artifacts for logs as they have sufficient longevity for practical purposes. If you have cycles to reland for 58 and 52ESR then go ahead. Apologies for the churn.
Flags: needinfo?(nthomas)
I think we can leave it as is on 58 and 52esr. release-notifications will be retired after we kill esr52. Closing bug as WONTFIX.
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: