Tuesday April 19, 2022

Issue summary:
From April 19, 2022 at 4:38 PM PDT to April 20, 2022 at 12:36 PM PDT, our SCIM endpoint began deactivating some users.

This was the result of a code change in a recent patch to fix a bug affecting the way SCIM handled user profile updates.

We reverted this code change to prevent new deactivations. We then restored affected user accounts, group memberships, and integrations to their prior states.

Note: Since initially posting, we've edited the times included in this summary to accurately reflect the duration of the issue.

Note: We discovered a small percentage of users who were still deactivated until April 21, 2022 at 10:40 PM PDT, and we have restored their accounts.

4:48 PM PST

The SCIM issue has been resolved and all affected users have been reactivated. We apologize for the disruption to your day.

12:59 PM PST

We are continuing to monitor the situation and verify that all affected users are reactivated. We're working on restoring group membership and impacted integrations. We'll be back once we have another update to share.

9:48 AM PST

The team is still ensuring that all affected users are reactivated. While we are continuing to work on restoring group membership and impacted integrations, we appreciate your patience.

8:46 AM PST

We are verifying that all affected users are now reactivated. Our team will now begin work on restoring group membership and impacted integrations. We appreciate your patience while we work to get this resolved.

7:43 AM PST

We're still doing our best to restore all affected users and will share new updates here as soon as we have them.

We appreciate your continued patience while we work to get this resolved.

4:44 AM PST

We appreciate your patience as our team continues to work to restore all affected users.

We will keep you posted as soon as we have further updates to share.

11:59 PM PST

Our team is currently working on restoring all affected users.

We’ll be back once we have another update to share. Thank you for your patience as we continue to work towards a fix.

11:47 PM PST

Our team have now identified all affected users and workspaces. We're still monitoring the situation, and we'll report back with more information in 30 minutes. Thank you for holding tight while we work on this.

10:34 PM PST

We've identified the root cause of this issue, and SCIM events should now be working as expected. We are actively investigating remediation for affected customers.

Thank you for your patience while we look into this. We'll share another update in 30 minutes.

9:51 PM PST

We’re investigating an issue with SCIM deactivating users, and SCIM updates not working as expected. We’re looking into the cause and will provide more information as soon as it's available.

8:46 PM PST