Tuesday July 28, 2020

Incident

Degraded service affecting multiple features

Issue Summary:

On July 28, 2020 from 1:30 a.m. PDT to 4:19 a.m. PDT, some users may have experienced issues with various features of our product, such as calls, invoice downloads, email ingestion and slash commands.

An upstream service provider reported latency issues with DNS resolution. Upon further investigation, we found that this resulted in an observed failure rate on our infrastructure of less than 1%. The customer impact was minimal with subsequent retries being successful.

We apologize for the disruption and for inappropriately notifying our customers. We are taking a closer look at ways to ensure our incident classifications and communication processes improve moving forward.

1:50 PM PST

We’ve resolved the issue with with slash commands, email ingestion, calls failure, invoice downloads and Slack is back to full functionality. We’re sorry for the disruption this has caused.

4:50 AM PST

We’re still investigating issues with with slash commands, email ingestion, calls failure, invoice downloads. No additional information to share just yet, but we’ll keep you posted as soon we have an update.

3:39 AM PST

Some people may be experiencing issues with slash commands, downloading of invoices, calls and email ingestion. We’re investigating and will have more information to share in 30 minutes.

3:10 AM PST

Services affected

Messaging

Files

Huddles

Apps/Integrations/APIs

Status

Incident