Friday July 24, 2020

Incident

We're looking into an issue with certain API calls

Issue summary:
From July 23, 2020 at 9:00 p.m. PDT to August 1, 2020 at 5:17 p.m. PDT, customers may have experienced lags or failures when using various API endpoints.

We began investigating this issue on July 29, and traced these issues to a recent change made to our caching infrastructure, intended to increase the capacity of this infrastructure. A unforeseen side effect caused a small percentage of API requests to take longer to process and ultimately time out. We reverted this change on August 1, and the issue was resolved for all affected customers.

3:49 PM PST

We have deployed fixes for the API issues some customers were seeing and we are confident that the issue is resolved. Please let us know if you're still experiencing trouble.

4:15 PM PST

We're currently aware of some intermittent latency and timeouts with image attachments, certain API methods (including users.setPhoto, chat.postMessage and chat.update, views.*), and apps which use these features. We are currently investigating and will update when we believe these issues have been resolved. Sorry for the inconvenience.

10:45 AM PST

Services affected

Apps/Integrations/APIs

Status

Incident