Is there an Permutive outage?
Permutive status: Systems Active
Last checked: 2 minutes ago
Get notified about any outages, downtime or incidents for Permutive and 1800+ other cloud vendors. Monitor 10 companies, for free.
Last checked: 2 minutes ago
Get notified about any outages, downtime or incidents for Permutive and 1800+ other cloud vendors. Monitor 10 companies, for free.
Outage and incident data over the last 30 days for Permutive.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage. It's completely free and takes less than 2 minutes!
Sign Up NowOutlogger tracks the status of these components for Xero:
| Component | Status |
|---|---|
| AMP API | Active |
| Content Delivery Network | Active |
| Permutive Analytics | Active |
| Permutive API | Active |
| Permutive Dashboard | Active |
| Permutive SDKs | Active |
| Routing | Active |
| Third-Party Data API | Active |
View the latest incidents for Permutive and check for official updates:
Description: This incident has been resolved with no further downtime expected.
Status: Resolved
Impact: None | Started At: Aug. 15, 2024, 9:38 a.m.
Description: Incident resolved
Status: Resolved
Impact: Minor | Started At: June 28, 2024, 11:49 a.m.
Description: Incident resolved
Status: Resolved
Impact: Minor | Started At: June 28, 2024, 11:49 a.m.
Description: Our system has remained stable since 14th May with no additional customer impacted expected. Our team will be taking steps to mitigate against future service degradation.
Status: Resolved
Impact: Minor | Started At: May 7, 2024, 4:54 p.m.
Description: Over the past week, two separate incidents have impacted our platform. The first incident took place on March 5th 2024, when we experienced an API outage between 01:36 UTC and 06:49 UTC. The second incident occurred on March 10th 2024, with an API outage occurring between 07:50 UTC and 08:50 UTC. We anticipate minimal impact on campaign delivery as our SDK continued to segment and target users during these times. However, due to the API outage, no user events were collected. You may notice a drop in data in our Insights module and lower unique users and pageview numbers for March 5th and March 10th. If you utilise Routing, you will see a drop in event collection for the duration of the outages and those utilising our daily Routing to AWS S3 will also see a delay in their routed data for March 9th. At Permutive, we are proud of our platform’s stability. In the full year preceding these events, our core APIs achieved 100% uptime. So, on rare occasions when incidents occur, we aim to stay transparent with our customers and explain how we plan to avoid them in the future. We have carried out a thorough investigation into both incidents. While each incident had a similar level of impact on our services, the two incidents were unrelated and had different underlying causes. The incident on March 5th was caused by an internal error in our event handling API, which caused the API to scale down to where it was no longer able to handle traffic. We identified the issue just after 06:00am UTC on 5th March. Our team reacted swiftly and put a manual fix in place by 06:49am. The root cause of the incident on March 10th was a process failure that affected an internal service critical to the functioning of several externally facing services, including our event handling API. Our team was able to resolve this issue in just under an hour. Following these incidents, we are actively taking steps to prevent recurrences of similar outages: * We have implemented mitigations against the observed scaling issues during the incident on March 5th * We are taking steps to improve the resiliency of our critical APIs by minimising dependencies on downstream services * We have begun to introduce new monitoring and alerting for the process which failed on March 10th, to mitigate the risk of process failure * We are looking at ways to mitigate the risk of long-running outages. We are reviewing our processes for out-of-hours support and looking at ways to ensure a faster response in the event of a critical outage overnight We would like to apologise for any inconvenience these incidents may have caused you. If you have any questions, concerns, or further feedback, please do not hesitate to get in touch with [[email protected]](mailto:[email protected]).
Status: Postmortem
Impact: None | Started At: March 10, 2024, 8:57 a.m.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage or down time. Join for free - no credit card required.
