Is there an QV Systems outage?
QV Systems status: Systems Active
Last checked: a minute ago
Get notified about any outages, downtime or incidents for QV Systems and 1800+ other cloud vendors. Monitor 10 companies, for free.
Last checked: a minute ago
Get notified about any outages, downtime or incidents for QV Systems and 1800+ other cloud vendors. Monitor 10 companies, for free.
Outage and incident data over the last 30 days for QV Systems.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage. It's completely free and takes less than 2 minutes!
Sign Up NowOutlogger tracks the status of these components for Xero:
| Component | Status |
|---|---|
| Cora API | Active |
| Accelerate Application | Active |
| Quotevine API | Active |
| Quotevine Dataloader | Active |
| Quotevine E-Signatures | Active |
| Quotevine Insight Database | Active |
| Quotevine Integrations | Active |
| Quotevine Online Applications | Active |
| Quotevine User Interface | Active |
| Funder Connect | Active |
| Alphabet | Active |
| Arval | Active |
| Investec (IAF) | Active |
| Investec (Quantum) | Active |
| Lex | Active |
| Novuna | Active |
| Siemens | Active |
View the latest incidents for QV Systems and check for official updates:
Description: This incident, and the incidents [**Delays in sending email and SMS**](/pages/481h0m6915rr/incidents/ff8t7rfnzh41), and [**Reduced Capacity**](/pages/481h0m6915rr/incidents/v4bfqvlf2vw8) all sprang from the same root cause. **Initial Failure** At approximately 10:35 on Tuesday the 9th of March 2021, a configuration file which manages the relationship between the machines that run our Oracle server cluster was accidentally overwritten by a bug in a script at our hosting partner. This lead to an immediate failure of the MT-PROD service which serves the majority of our broker customers. **Ongoing Performance Issues** While the service was restored by 10:55, the incident left an underlying problem with one of the machines in the cluster. Any write operations performed by this machine were significantly slower than normal, but its read performance was unaffected. This lead to our diagnostics reporting all services online and operating normally. After further reports of unacceptable performance from our customers we performed further analysis over the weekend of the 13th and 14th that eventually identified the problem. Following a restart of the affected machine at around 21:10 on the 14th, all user interface services were back to normal operation. **API Unavailability** However, as a consequence of the investigation, the API service was not restarted correctly, and this led to the APIs being unavailable on MT-PROD from around 20:45 on the 14th until 08:08 on the 15th. **Summary** We understand and apologise for the impact that these incidents have caused customers on the MT-PROD service. Our hosting partner is conducting its own internal postmortem to understand how this file was overwritten, and the following actions have already been undertaken: 1. The URL that our hosting partner uses to check for API availability has been changed to ensure an accurate picture is presented to them. 2. We are installing the Oracle service manager into DataDog, our monitoring platform, to enable us to add further monitoring which will enable a deeper set of diagnostics to be performed, to detect incidents like this more quickly. Further actions will be undertaken by both QV Systems and our hosting partner as the postmortem continues.
Status: Postmortem
Impact: Critical | Started At: March 15, 2021, 8:02 a.m.
Description: This incident has been resolved.
Status: Resolved
Impact: Minor | Started At: March 12, 2021, 4:27 p.m.
Description: This incident has been resolved.
Status: Resolved
Impact: None | Started At: March 9, 2021, 10:34 a.m.
Description: System load was increased to an unsustainable level due to a rogue user process. This began at 13:37 and was resolved at 14:09. A postmortem will be carried out to examine measures to prevent a recurrence.
Status: Resolved
Impact: Major | Started At: Jan. 21, 2021, 1:30 p.m.
Description: This incident has been resolved.
Status: Resolved
Impact: Minor | Started At: Dec. 16, 2020, 9:42 a.m.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage or down time. Join for free - no credit card required.
