Rendering has returned to normal. Will continue to monitor.
Posted Jul 24, 2015 - 11:03 PDT
Monitoring
Roll out of the fix to production has been completed. Currently monitoring 50x error rates. Will provide further updates at or before 16:00 UTC.
Posted Jul 24, 2015 - 10:18 PDT
Update
Build of the fix is finished. Beginning production roll out now. Will update at or before 17:20 UTC with a status update.
Posted Jul 24, 2015 - 10:08 PDT
Update
Created a fix for the elevated 50x error rates and verified that it works in a staging environment. Expected production deployment at 17:05 UTC. More updates at that time or shortly thereafter.
Posted Jul 24, 2015 - 09:57 PDT
Identified
We have identified the root cause of the elevated 50x error rates and are assembling a fix. We'll provide further updates at or before 17:00 UTC.
Posted Jul 24, 2015 - 09:37 PDT
Investigating
We are investigating elevated 500 and 404 rates on our end. We will update by 17:00 UTC with more details.