Last checked: 3 minutes ago
Get notified about any outages, downtime or incidents for Invoca and 1800+ other cloud vendors. Monitor 10 companies, for free.
Outage and incident data over the last 30 days for Invoca.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage. It's completely free and takes less than 2 minutes!
Sign Up NowOutlogger tracks the status of these components for Xero:
Component | Status |
---|---|
Call Routing | Active |
Dynamic Number Insertion and Attribution | Active |
APIs | Active |
APIs | Active |
Bulk RingPool API | Active |
Call API | Active |
Call Ingestion API | Active |
Calls in Progress API | Active |
Network Integration API | Active |
Signal API | Active |
SMS Messaging API | Active |
Transactions API | Active |
Integrations | Active |
Active | |
Google Ads | Active |
Google Analytics | Active |
Integrations | Active |
Other Integrations | Active |
Webhooks | Active |
Invoca Europe | Active |
APIs | Active |
Call Routing | Active |
Dynamic Number Insertion and Attribution | Active |
Integrations | Active |
Invoca Europe | Active |
Platform Accessibility | Active |
Reporting | Active |
Signals | Active |
Voice | Active |
Platform Accessibility | Active |
Invoca UI | Active |
Platform Accessibility | Active |
SSO/SAML | Active |
User Creation | Active |
Reporting | Active |
Data Accessibility | Active |
Data Ingestion | Active |
Distributed Reporting | Active |
Enhanced Caller Profiles | Active |
Reporting | Active |
Signals | Active |
Rule-Based Signal Processing | Active |
Signal AI Processing | Active |
Signal AI Training | Active |
Signals | Active |
Voice | Active |
Call Ingestion | Active |
Call Recordings | Active |
Transcriptions | Active |
Voice | Active |
View the latest incidents for Invoca and check for official updates:
Description: Invoca Availability for January 2023: 100% Invoca Availability for Q1 2023: 100%
Status: Resolved
Impact: None | Started At: Feb. 17, 2023, 4:17 p.m.
Description: Invoca Availability for December 2022: 100% Invoca Availability for Q4 2022: 100%
Status: Resolved
Impact: None | Started At: Jan. 9, 2023, 6:18 p.m.
Description: Invoca Availability for November 2022: 100% Invoca Availability for Q4 2022: 100%
Status: Resolved
Impact: None | Started At: Dec. 13, 2022, 3:59 p.m.
Description: Invoca Availability for October 2022: 100% Invoca Availability for Q4 2022: 100%
Status: Resolved
Impact: None | Started At: Nov. 4, 2022, 1:27 p.m.
Description: **Summary** Between 12:13 and 18:55 PT on October 19th, 2022 the Invoca platform experienced disruptions to the following services: * Reporting availability * Reporting data freshness * Signal processing * Post-call webhooks * Invoca web portal login * Transaction Events API requests and ordering While reporting data was delayed, no data was lost. There were no impacts to call routing or other Invoca services not listed. Availability and functionality varied per service and are detailed further below. **Sequence of events** Our metrics quickly alerted us to a problem and our engineering team was able to begin coordination and mitigation right away. The timeline below provides a high-level overview of key events, service availability, and mitigation efforts: **12:25:** Automated monitoring notifies us of a problem in the data processing pipeline. **12:27:** Engineering teams start our incident response process. **12:31:** Isolation to a specific component in the data processing pipeline. **13:32:** First change deployed to attempt mitigation. Service for Invoca portal & Transaction Events API restored. Reports are still failing and new report data is delayed. **15:03:** Second change deployed for mitigation. This change enabled reports to be displayed on the portal, but new report data was still delayed. **16:01:** Incident fully mitigated. Final change deployed for mitigation. This change allowed the system to fully recover and report data started to catch up from this point. **18:55:** All reporting data was caught up, and the incident was fully resolved. **Why it happened** The main failure occurred in the backend used to move data for post-call processing and reporting. A recent change to a software library used in the backend introduced a defect in the logic used to re-queue failed data processing jobs. The retry logic would work for a typical amount of expected failures but could not slow down or stop retrying failed jobs when they accumulated. **What we did and what we’re doing** During the incident, we made a change to how the retry logic operates. This was key to resolving this incident both now and in the future. Post-incident, we’re planning additional changes: * Improvements in our ability to detect and troubleshoot issues in the data processing pipeline, allowing us to find problems sooner and resolve incidents faster * Removing the potential for a “snowball effect” to overwhelm the system with additional changes to retry logic for data processing * Speeding up our ability to deploy changes to the Invoca platform during incidents while maintaining our commitments to software lifecycle best practices
Status: Postmortem
Impact: Minor | Started At: Oct. 19, 2022, 8:11 p.m.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage or down time. Join for free - no credit card required.