OpenMethods outages and incidents
Outage and incident data over the last 30 days for OpenMethods.
There have been 1 outages or incidents for OpenMethods in the last 30 days.
Severity Breakdown:
Tired of searching for status updates?
Join OutLogger to be notified when any of your vendors or the components you use experience an outage. It's completely free and takes less than 2 minutes!
Sign Up NowComponents and Services Monitored for OpenMethods
Outlogger tracks the status of these components for Xero:
| Component | Status |
|---|---|
| App Manager | Active |
| Configuration Server | Active |
| Experience Client | Active |
| Experience Designer | Active |
| OpenConnect | Active |
| Runtime API | Active |
| Workflow API | Active |
Latest OpenMethods outages and incidents.
View the latest incidents for OpenMethods and check for official updates:
Downgraded Workflow API Performance
Description: ## Summary PopFlows were unable to execute because of a database deadlock. ## What was impacted * PopFlow activities would have stalled, had latency, and stopped executing. ## Remediation A restart of database services was preformed to clear out a deadlock. * OpenMethods has introduced additional data-logging to help identify query performance.
Status: Postmortem
Impact: Major | Started At: Oct. 27, 2022, 12:34 a.m.
Updates:
-
Time: Oct. 27, 2022, 10:52 a.m.Status: PostmortemUpdate: ## Summary PopFlows were unable to execute because of a database deadlock. ## What was impacted * PopFlow activities would have stalled, had latency, and stopped executing. ## Remediation A restart of database services was preformed to clear out a deadlock. * OpenMethods has introduced additional data-logging to help identify query performance.
-
Time: Oct. 27, 2022, 1:22 a.m.Status: ResolvedUpdate: Database performance resolved.
-
Time: Oct. 27, 2022, 12:34 a.m.Status: InvestigatingUpdate: We are currently investigating this issue.
PopFlow Studio Testing
Description: The incident has been resolved.
Status: Resolved
Impact: None | Started At: Oct. 20, 2022, 4:50 p.m.
Updates:
-
Time: Oct. 20, 2022, 6:13 p.m.Status: ResolvedUpdate: The incident has been resolved.
-
Time: Oct. 20, 2022, 4:50 p.m.Status: IdentifiedUpdate: We are experiencing an intermittent issue with the PopFlow Studio and testing workflows. Consequently, users might be unable to use the "Send Test" within the studio. However, all workflows are operational and functioning. Our engineers are investigating the matter.
Downgraded Application Performance
Description: ## Summary * A 3rd party library had a recent update that affected the app manager UI. ## What was impacted * Experience Cloud: The Management & Provisioning sections of the site. ## Remediation * OpenMethods reverted the 3rd party library to the last operational version \(1.0.0\).
Status: Postmortem
Impact: Minor | Started At: Oct. 7, 2022, 12:51 a.m.
Updates:
-
Time: Oct. 7, 2022, 1:15 a.m.Status: PostmortemUpdate: ## Summary * A 3rd party library had a recent update that affected the app manager UI. ## What was impacted * Experience Cloud: The Management & Provisioning sections of the site. ## Remediation * OpenMethods reverted the 3rd party library to the last operational version \(1.0.0\).
-
Time: Oct. 7, 2022, 1:03 a.m.Status: ResolvedUpdate: The issue has been resolved.
-
Time: Oct. 7, 2022, 12:51 a.m.Status: IdentifiedUpdate: We are currently experiencing an intermittent issue with the App Manager. Consequently, some users might experience degraded services within the Experience Cloud. Our engineers are investigating the matter.
Downgraded Application Performance
Description: ## Summary The Connect API had latency causing an intermittent outage to the API connectivity and PopFlows. ## What was impacted * PopFlow \(Screenpops\) via Connect API ## Remediation OpenMethods implemented updates to the core code to resolve latency.
Status: Postmortem
Impact: Minor | Started At: July 13, 2022, 3:32 p.m.
Updates:
-
Time: July 14, 2022, 5:21 p.m.Status: PostmortemUpdate: ## Summary The Connect API had latency causing an intermittent outage to the API connectivity and PopFlows. ## What was impacted * PopFlow \(Screenpops\) via Connect API ## Remediation OpenMethods implemented updates to the core code to resolve latency.
-
Time: July 13, 2022, 3:50 p.m.Status: ResolvedUpdate: Connect API & PopFlow services are back to normal and operational. Our engineers will continue to monitor.
-
Time: July 13, 2022, 3:32 p.m.Status: IdentifiedUpdate: We are currently experiencing an intermittent issue with the Connect API. Consequently, users might not be able to design PopFlows and execute PopFlows. Our engineers are investigating the matter.
Downgraded Application Performance
Description: ## Summary The Connect API had a limitation in scaling, causing an intermittent outage to the API connectivity and PopFlows. ## What was impacted * PopFlow \(Screenpops\) via Connect API ## Remediation A rate limit function caused the root cause of the downgraded application performance that limited the ability to scale. The resolution removes the rate limitation. * OpenMethods has removed the rate-limiting functionality within Connect API. * OpenMethods will update the API and Service in a scheduled maintenance window.
Status: Postmortem
Impact: Minor | Started At: July 11, 2022, 2:10 p.m.
Updates:
-
Time: July 12, 2022, 3:58 p.m.Status: PostmortemUpdate: ## Summary The Connect API had a limitation in scaling, causing an intermittent outage to the API connectivity and PopFlows. ## What was impacted * PopFlow \(Screenpops\) via Connect API ## Remediation A rate limit function caused the root cause of the downgraded application performance that limited the ability to scale. The resolution removes the rate limitation. * OpenMethods has removed the rate-limiting functionality within Connect API. * OpenMethods will update the API and Service in a scheduled maintenance window.
-
Time: July 11, 2022, 3:27 p.m.Status: ResolvedUpdate: The incident has been resolved, all Connect API services are back to operational. If you have any questions or concerns, please feel free to reach out to OpenMethods Customer Care (https://www.openmethods.com/support). Thank you for your patience and understanding.
-
Time: July 11, 2022, 2:41 p.m.Status: MonitoringUpdate: A fix has been implemented and we are monitoring the results. The resolution may take 30 minutes to bring services back into operation. Please stand by for more updates.
-
Time: July 11, 2022, 2:30 p.m.Status: IdentifiedUpdate: Our engineers are currently implementing a fix.
-
Time: July 11, 2022, 2:10 p.m.Status: IdentifiedUpdate: We are currently experiencing an intermittent issue with the Connect API. Our engineers are investigating the matter.
