GitHub January 28th Incident Report seti: notably missing from the "lessons learned" section: not having all your servers in one datacenter on the same power feed; not having all your servers be of 1 make and model susceptible to the same firmware bug. |