Wednesday July 15, 2020

Incident

Trouble with Slack calls

Issue summary:
On July 15, 2020 from 4:55 a.m. PDT to 6:41 a.m. PDT, some customers experienced difficulties starting calls in Slack. We determined this issue was caused by a higher than expected load on a part of our caching infrastructure following the unarchiving of a channel with a very high number of members. This had an unforeseen side effect of failed queries on a database involved in starting calls.

The increased load returned to a manageable level without intervention, but we are actively investigating prevention and remediation steps in this area to avoid similar issues from happening in the future.

4:37 PM PST

We've resolved the connection issue that customers were experiencing earlier with Slack calls. Thank you for your patience while we sorted out this issue.

10:19 AM PST

Slack calls remain stable and we continue to look into the cause of the disruption earlier today.

6:25 AM PST

Our engineers are patching things up and Slack calls should be connecting stably at the moment. We're still investigating what caused the original problem.

5:56 AM PST

We're receiving reports of Slack calls failing for some people. Our team is on the case. Apologies for the disruption.

5:25 AM PST

Services affected

Huddles

Status

Incident