Post-Mortem of JetBrains YouTrack Zombie-Mode Issue
As you might have noticed, on Wednesday, November 16, we experienced the problem with our own JetBrains YouTrack installation. The problem caused significant slowdown of the tracker and its further unavailability for users.
What went wrong
In our tracker we have a number of custom workflows, attached to different projects. Due to erroneous configuration, one of the workflow rules got into infinite loop while generating notifications, and started to increase loading of the server, which led to system’s slowdown.
Fixing the problem
Being unable to stop executing the rule via UI, due to its unavailability, we had to restart the server, which caused system downtime.
Lessons learned and preventative actions
In order to prevent this problem in future, we decided to add the timeout for the workflow rules execution. This issue will be implemented ASAP.
We apologize for the inconvenience you might have experienced due to our system downtime. Though, it was a very good lesson to learn from, and we’ll do our best to prevent our customers from experiencing this kind of issues with their own YouTrack installations.
JetBrains YouTrack Team
Subscribe to Blog updates
Thanks, we've got you!
YouTrack Now With Improved Knowledge Base Collaboration
The YouTrack 2023.2 release brings powerful updates to article collaboration in the Knowledge Base, improves the experience of both support teams and customers within helpdesk projects, adds Turkish language support, and supercharges YouTrack’s performance for everyone working with tasks.
Helpdesk Projects Arrive in YouTrack
YouTrack 2023.1 introduces YouTrack Helpdesk, which enables you to streamline your customer support services for both external and internal clients.
YouTrack Roadmap 2023
Our product commitment and aspirations. What we’re working on. Broad goals for 2023 and beyond