Last checked: 5 minutes ago
Get notified about any outages, downtime or incidents for Kustomer and 1800+ other cloud vendors. Monitor 10 companies, for free.
Outage and incident data over the last 30 days for Kustomer.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage. It's completely free and takes less than 2 minutes!
Sign Up NowOutlogger tracks the status of these components for Xero:
Component | Status |
---|---|
Regional Incident | Active |
Prod1 (US) | Active |
Analytics | Active |
API | Active |
Bulk Jobs | Active |
Channel - Chat | Active |
Channel - Email | Active |
Channel - Facebook | Active |
Channel - Instagram | Active |
Channel - SMS | Active |
Channel - Twitter | Active |
Channel - WhatsApp | Active |
CSAT | Active |
Events / Audit Log | Active |
Exports | Active |
Knowledge base | Active |
Kustomer Voice | Active |
Notifications | Active |
Registration | Active |
Search | Active |
Tracking | Active |
Web Client | Active |
Web/Email/Form Hooks | Active |
Workflow | Active |
Prod2 (EU) | Active |
Analytics | Active |
API | Active |
Bulk Jobs | Active |
Channel - Chat | Active |
Channel - Email | Active |
Channel - Facebook | Active |
Channel - Instagram | Active |
Channel - SMS | Active |
Channel - Twitter | Active |
Channel - WhatsApp | Active |
CSAT | Active |
Events / Audit Log | Active |
Exports | Active |
Knowledge base | Active |
Kustomer Voice | Active |
Notifications | Active |
Registration | Active |
Search | Active |
Tracking | Active |
Web Client | Active |
Web/Email/Form Hooks | Active |
Workflow | Active |
Third Party | Active |
OpenAI | Active |
PubNub | Active |
View the latest incidents for Kustomer and check for official updates:
Description: This incident has been resolved.
Status: Resolved
Impact: Minor | Started At: March 1, 2024, 3:22 p.m.
Description: # Post Mortem: Early transfers in KIQ Customer Assist \(formerly Conversational Assistant\) in prod1 # **Summary** On February 8, 2024 1:20pm EST, Kustomer’s engineering team saw a large spike in 502 errors from the KIQ Customer Assist service in prod1. These errors were subsequently tied to customer reports of early transfers occurring in conversational assistants. After some adjustments to the resources available in this service and a precautionary rollback of an earlier deployment, the system had fully recovered and errors subsided completely by 3:20pm EST. **Root Cause** The root cause for the spike in errors is caused by performance of the service that required more resources but the service had been operating at maximum capacity. Inefficiencies were identified in certain high traffic endpoints in this incident which used more resources than normal. This issue was only present in the prod1 environment and prod2 was unaffected. The engineering team has also determined that the deployment was unrelated to the issue that customers faced during this incident. # **Timeline** 2/8/24 10:58am EST - Deployment reaches all production environments. 2/8/24 12:29pm EST - Initial spike in 502 Bad Gateway errors in KIQ Customer Assist service for prod1 detected in monitoring systems. Prod2 is unaffected. 2/8/24 12:38pm EST - Received customer reports about early transfer in various conversational assistants. 2/8/24 12:50pm EST - Issue escalated to on-call engineering team. 2/8/24 1:48pm EST - Precautionary rollback of deployment completed. 2/8/24 2:09pm EST - Scaled up resources for KIQ Customer Assist service. 2/8/24 3:20pm EST - System fully recovers with no remaining errors. **Lessons/Improvements** * \[DONE\] Provisioned more resources for the affected service * \[IN PROGRESS\] Reduce the page size for the /v1/assistants endpoint to 50 * \[PLANNED\] Overhaul the service to improve efficiency, scalability, and performance
Status: Postmortem
Impact: Minor | Started At: Feb. 8, 2024, 6:34 p.m.
Description: This incident has been resolved by our vendor.
Status: Resolved
Impact: Minor | Started At: Nov. 8, 2023, 2:44 p.m.
Description: This incident has been resolved by our vendor.
Status: Resolved
Impact: Minor | Started At: Nov. 8, 2023, 2:44 p.m.
Description: All errors have been redriven. After careful monitoring, our team has found that all affected areas are fully restored. Please reach out to support at [email protected] if you have additional questions or concerns.
Status: Resolved
Impact: Minor | Started At: Sept. 13, 2023, 4:31 p.m.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage or down time. Join for free - no credit card required.