All Systems Operational
Uptime over the past 90 days. View historical uptime.
API Operational
90 days ago
99.98 % uptime
Today
Gateway Operational
90 days ago
99.98 % uptime
Today
CloudFlare ? Operational
Media Proxy ? Operational
90 days ago
100.0 % uptime
Today
Voice Operational
EU West Operational
EU Central Operational
Singapore Operational
Sydney Operational
US Central Operational
US East Operational
US South Operational
US West Operational
Brazil Operational
Hong Kong Operational
Russia Operational
Japan Operational
South Africa Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
had a major outage
had a partial outage

No incidents or maintenance related to this downtime.

System Metrics Month Week Day
API Response Time
Fetching
Past Incidents
Jul 19, 2019

No incidents reported today.

Jul 18, 2019

No incidents reported.

Jul 17, 2019

No incidents reported.

Jul 16, 2019

No incidents reported.

Jul 15, 2019

No incidents reported.

Jul 14, 2019

No incidents reported.

Jul 13, 2019

No incidents reported.

Jul 12, 2019

No incidents reported.

Jul 11, 2019
Issues sending messages
Resolved - We have recovered operation of our Cassandra clusters and are seeing standard API latencies.
Jul 11, 17:15 PDT
Monitoring - We identified a pattern of access causing some underlying strain on one of our Cassandra clusters, leading to bad latencies for message sending/retrieval. We've addressed this one instance and are now working to understand what happened to the circuit breakers that are supposed to (and have historically) caught & prevented this kind of degradation.

At the moment, though, things look like they're recovered and should be fine. We are continuing to monitor as we work through understanding the root cause.
Jul 11, 14:22 PDT
Investigating - We are aware of an issue sending messages. The team is online and investigating.
Jul 11, 13:55 PDT
Jul 10, 2019
Intermittent message send failure and trouble connecting
Resolved - Things look calm, all alarms have resolved on our end. We are going to close this out and continue our march towards Python 3 tomorrow... thanks for your patience, and our apologies for the interruptions!
Jul 10, 22:19 PDT
Monitoring - We've deployed fixes to the relevant systems and are monitoring. At this point, we believe everything is resolved and will not recur.
Jul 10, 22:03 PDT
Update - We have rolled back a problematic change to our workers (machines that run periodic/on-demand tasks) that were getting duplicated and causing stress to our underlying databases. We are still working through some downstream problems this has caused in our search system.
Jul 10, 21:46 PDT
Identified - We are having some intermittent issues with sending messages and logging in. We know what the cause is and we're working to remediate the issue now.
Jul 10, 21:27 PDT
Jul 9, 2019

No incidents reported.

Jul 8, 2019

No incidents reported.

Jul 7, 2019

No incidents reported.

Jul 6, 2019

No incidents reported.

Jul 5, 2019

No incidents reported.

← Incident History Powered by Statuspage