SUMMARY
On September 20, 2022 from 12:28 UTC to 02:28 UTC, a small subset of Zendesk Sell customers may have experienced delays with:
- Creating external tasks
- Emailing campaigns to contacts and leads
Timeline
14:34 UTC | 07:34 PT
We are currently investigating an issue that might cause delays in Sell Reach’s email campaigns to contacts and leads and creating external tasks. We are working to understand the cause of this and will keep you updated as we find out more.
14:45 UTC | 07:45 PT
We are happy to report that the issue that potentially caused delays in Sell Reach’s email campaigns to contacts and leads and creating external tasks is now resolved. We thank you
POST-MORTEM
Root Cause Analysis
This incident was caused by a new deployment of a Sell service resulting in frozen database connections, preventing background jobs from being fetched.
Resolution
To fix this issue, we rolled back the newly deployed Sell service. A database failover was subsequently performed to clear all the stuck connections. We continued to monitor until recovery was complete.
Remediation Items
- Improve monitoring to make alerts more actionable [Scheduled]
FOR MORE INFORMATION
For current system status information about your Zendesk, check out our system status page. The summary of our post-mortem investigation is usually posted here a few days after the incident has ended. If you have additional questions about this incident, please log a ticket with us via ZBot Messaging within the Widget.