YouTrack InCloud Unavailability Post-Mortem

Valerie Andrianova

Last Saturday, July 11th, some of our InCloud instances became unavailable. The problem was resolved for all instances by Monday morning, July 13th. Please accept our deepest apologies for the inconvenience you may have experienced during this downtime.

What happened?

On Saturday evening, Amazon restarted our server where one of our Nginx is located. Nginx restart took about half an hour. This unplanned restart and general infrastructure problem caused a massive backend restart. Our auto-recovery mechanism inside the InCloud management system couldn’t handle it. As a result, a number of InCloud instances failed to start automatically. We had to restart them manually.

Solution

The problem in our InCloud management system was detected and is already fixed. The solution will prevent such problems in future. Please accept our apologies once again.

Subscribe to YouTrack Blog updates

Subscribe form

By submitting this form, I agree to the JetBrains Privacy Policy Notification icon

By submitting this form, I agree that JetBrains s.r.o. ("JetBrains") may use my name, email address, and location data to send me newsletters, including commercial communications, and to process my personal data for this purpose. I agree that JetBrains may process said data using third-party services for this purpose in accordance with the JetBrains Privacy Policy. I understand that I can revoke this consent at any time in my profile. In addition, an unsubscribe link is included in each email.

Submit

Thanks, we've got you!