We need to have some kind of monitoring for AWS. In PHX we use Nagios, AWS has a "CloudWatch" service available that does a lot of the basic resource monitoring but doesn't support arbitrary custom plugins like Nagios does AFAICT. I'm not sure this matters for Socorro (we have a lot of custom Nagios plugins but we should review to see which have actually turned out to be useful)

A third-party service might be the easiest thing here - something like Librato[0] for example. Either that or we also get into the Nagios game. :/ [0] https://www.librato.com/