Opened on Wednesday 6th May 2020, last updated
Resolved — At approximately 15:00 UTC, some services which funnel Internet traffic into Radio.co experienced an outage following some performance issues affecting their availability earlier in the day. Radio.co's core infrastructure is designed to automatically scale up to meet demand, however, the scaling did not work as expected in this scenario, unfortunately resulting in a failure as the network failed to meet demand. This caused approximately 30 minutes of access issues to the Radio.co platform, which may have also resulted in station broadcasts going off air. Our devops team were alerted to the incident immediately and had the issue resolved within 30 minutes of the first error report. We have also identified the original defect with the scaling of these services and implemented a solution to prevent further issues occurring. We have set up additional monitoring to pre-emptively diagnose a scenario like this to allow us to respond before an incident affecting clients occurs.