Wednesday June 27, 2018

Outage

Connectivity issues affecting all workspaces

Now that we've conducted our postmortem and root cause analysis, we know the event summarized below started at 6:17 a.m. PDT (7/11/18).

4:48 PM PDT・See in your timezone

Thank you for your patience. Everything is back up and running and we wanted to give you a summary of what happened.

On June 27th (yesterday) between 6:33 a.m. and 9:49 a.m. PDT Slack experienced an outage where people could not connect to their workspaces. The network problems were caused by a bug included in an offline batch process of data, which resulted in unexpected network spikes and led all of our customers to become disconnected and unable to reconnect.

Once we identified the problem, we restricted new connections and provisioned extra capacity. At 9:24 a.m. PST, production was healthy enough to remove restrictions and by 9:44 a.m. PST, all customers had reconnected to Slack once again.

Our reliability as a service is core to our commitment to our customers, and we are deeply sorry for the disruption. Thank you again for your patience.

3:27 PM PDT・See in your timezone

We're happy to report that workspaces should be able to connect again, as we've isolated the problem. Some folks may need to refresh (Ctrl + R or Cmd + R). If you're still experiencing issues, please drop us a line at feedback@slack.com.

9:49 AM PDT・See in your timezone

Our efforts to isolate the problem and resume connections are ongoing. Your patience through this is greatly appreciated.

9:33 AM PDT・See in your timezone

We're getting closer to a solution, but we aren't out of the woods yet.

9:03 AM PDT・See in your timezone

We really appreciate you sticking with us. We know this is a big disruption to your day, and we've got all eyes on this issue to get us back up to normal.

8:33 AM PDT・See in your timezone

We have no new information to share just yet, but we're continuing our efforts. Your patience is truly appreciated.

8:03 AM PDT・See in your timezone

We are continuing to work on fixing the connection problems that have been impacting folks. We hope to have the issue fully resolved as soon as possible.

7:33 AM PDT・See in your timezone

Our team is still looking into the cause of the connectivity issues, and we'll continue to update you on our progress.

7:03 AM PDT・See in your timezone

We've received word that all workspaces are having troubles connecting to Slack. We're currently investigating the issue, and will have updates shortly.

6:33 AM PDT・See in your timezone

Services affected

Apps/Integrations/APIs

Link Previews

Workspace/Org Administration

Posts/Files

Notifications

Login/SSO

Calls

Connections

Search

Messaging

Status

Resolved

Incident

Folks in Europe may be having trouble connecting to Slack

It looks like our connectivity troubles are over. Please reload with Ctrl/Cmd+R to reconnect to your Slack workspace if you don't automatically reconnect.

2:35 AM PDT・See in your timezone

People in Europe are reporting that they can't connect to Slack. We're working to resolve this situation as quickly as possible.

2:25 AM PDT・See in your timezone

Status

Resolved