Is there an Virtuoso outage?
Virtuoso status: Systems Active
Last checked: 2 minutes ago
Get notified about any outages, downtime or incidents for Virtuoso and 1800+ other cloud vendors. Monitor 10 companies, for free.
Last checked: 2 minutes ago
Get notified about any outages, downtime or incidents for Virtuoso and 1800+ other cloud vendors. Monitor 10 companies, for free.
Outage and incident data over the last 30 days for Virtuoso.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage. It's completely free and takes less than 2 minutes!
Sign Up NowOutlogger tracks the status of these components for Xero:
| Component | Status |
|---|---|
| Application & API | Active |
| Bridge | Active |
| Cross browser and real device testing | Active |
| Integrations | Active |
| Jobs and bot cluster | Active |
View the latest incidents for Virtuoso and check for official updates:
Description: On Tuesday 16 July around 06:40 UTC, during a regular update of the platform on all environments we had a severe service degradation on the EU production environment. Usually this would trigger an automatic rollback of the update, but in this specific circumstance only a few of the services were able to return to the previous version, requiring manual intervention to restore full service availability. Alarms in place immediately warned the team that something unexpected occurred and some services were not being able to initialize the new versions. After analyzing the data available and impact of potential decisions, at 07:20 UTC the team triggered a manual downgrade of the service back to the previously known working version, restoring full availability at 08:10 UTC. We are sorry for the inconvenience caused to our customers affected by this outage. This falls below the standard of operational excellence that we wish to provide to our users. We have implemented and released a product change that hardened the automated capabilities of the platform to recover in the scenario described.
Status: Postmortem
Impact: Major | Started At: July 16, 2024, 6:50 a.m.
Description: On Wednesday 15 May at 14:31 in the production environment the Flow integration was deleted in error by an internal team member with elevated privileges. This caused the integration to be removed from all instances, meaning users could not see Flows and jobs did not trigger. At 16:31 the integration was made available again, but this new instance did not contain existing Flows. The team then worked to restore the configurations from a backup. At 19:10 this was completed and configurations were restored for most affected users. Further to this, a small number of customers had some configurations that were later restored following further review on Friday 24 May at 13:45. We are sorry for the inconvenience caused to our customers affected by this outage. This falls below the standard of operational excellence that we wish to provide to our users. We have implemented and released a product change that removes the ability to completely delete integrations when they are installed in organizations.
Status: Postmortem
Impact: Major | Started At: May 15, 2024, 1:54 p.m.
Description: On Wednesday 15 May at 14:31 in the production environment the Flow integration was deleted in error by an internal team member with elevated privileges. This caused the integration to be removed from all instances, meaning users could not see Flows and jobs did not trigger. At 16:31 the integration was made available again, but this new instance did not contain existing Flows. The team then worked to restore the configurations from a backup. At 19:10 this was completed and configurations were restored for most affected users. Further to this, a small number of customers had some configurations that were later restored following further review on Friday 24 May at 13:45. We are sorry for the inconvenience caused to our customers affected by this outage. This falls below the standard of operational excellence that we wish to provide to our users. We have implemented and released a product change that removes the ability to completely delete integrations when they are installed in organizations.
Status: Postmortem
Impact: Major | Started At: May 15, 2024, 1:54 p.m.
Description: This incident has been resolved.
Status: Resolved
Impact: Minor | Started At: March 4, 2024, 5:36 p.m.
Description: Executions are now continuing as normal.
Status: Resolved
Impact: Major | Started At: Dec. 15, 2023, 2:03 p.m.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage or down time. Join for free - no credit card required.
