Is there an Zonos outage?
Zonos status: Systems Active
Last checked: 2 minutes ago
Get notified about any outages, downtime or incidents for Zonos and 1800+ other cloud vendors. Monitor 10 companies, for free.
Last checked: 2 minutes ago
Get notified about any outages, downtime or incidents for Zonos and 1800+ other cloud vendors. Monitor 10 companies, for free.
Outage and incident data over the last 30 days for Zonos.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage. It's completely free and takes less than 2 minutes!
Sign Up NowOutlogger tracks the status of these components for Xero:
| Component | Status |
|---|---|
| Classify | Active |
| Dashboard | Active |
| International Checkout | Active |
| Quoter | Active |
| Landed Cost | Active |
| Landed Cost API | Active |
| Landed Cost API (GraphQL) | Active |
| Landed Cost API (Legacy) | Active |
| Plugins | Active |
| BigCommerce Duty Tax | Active |
| Magento Duty Tax | Active |
| Salesforce Duty Tax | Active |
| Shopify Checkout | Active |
| Shopify Duty Tax | Active |
View the latest incidents for Zonos and check for official updates:
Description: **What products were affected and what was the impact?** * Checkout * Landed Cost \(Legacy\) * Landed Cost API Impact: * Checkout MAJOR OUTAGE * Landed Cost \(Legacy\) MAJOR OUTAGE * Landed Cost API SERVICE DEGRADATION **What timeframe did this issue occur?** | | **Date** | **Time** | | --- | --- | --- | | From: | December 13, 2023 | 3:02 MST | | To: | December 13, 2023 | 5:35 MST | **How was the issue detected?** There was increased database load and request timeouts. This was detected by the monitoring system and the team was notified. **What functionality was affected?** Shipping Quotes for the checkout process and Landed Cost \(Legacy\) API were directly affected. Landed Cost API was indirectly affected by the increased load on the database server. **What problems did this cause?** In the process of removing invalid data from the database a database table index became corrupted causing increased latency and load on the database server. The affected table was for providing flat rate shipping rates to the landed cost \(legacy\) service. The landed cost service is used by the checkout process to calculate shipping rates for international orders. This caused the landed cost \(legacy\) and checkout processes to fail when attempting to calculate shipping. This also caused landed cost API to fail intermittently with timeouts because of the increased load on the database. **What was the resolution of the problem and steps that are being taken for continued follow-up?** A patch was deployed to disable the flat rate charts and allow partial recovery and to allow for correcting the affected database table. The affected database table was restored and the flat rate charts were re-enabled. **What mitigation solutions will we put in place to prevent this issue from occurring in the future?** This issue occurred in our legacy database system. The data removal was done to improve query performance, and the operation should have been safe. Though index corruption is a very rare and unexpected outcome, we are doing two things to mitigate this risk and prevent future failure cases: 1. migrating legacy services to a more robust database technology, and 2. creating an additional review policy for potentially destructive database operations.
Status: Postmortem
Impact: Major | Started At: Dec. 13, 2023, 10:22 p.m.
Description: **What products were affected and what was the impact?** * Checkout * Landed Cost \(Legacy\) * Landed Cost API Impact: * Checkout MAJOR OUTAGE * Landed Cost \(Legacy\) MAJOR OUTAGE * Landed Cost API SERVICE DEGRADATION **What timeframe did this issue occur?** | | **Date** | **Time** | | --- | --- | --- | | From: | December 13, 2023 | 3:02 MST | | To: | December 13, 2023 | 5:35 MST | **How was the issue detected?** There was increased database load and request timeouts. This was detected by the monitoring system and the team was notified. **What functionality was affected?** Shipping Quotes for the checkout process and Landed Cost \(Legacy\) API were directly affected. Landed Cost API was indirectly affected by the increased load on the database server. **What problems did this cause?** In the process of removing invalid data from the database a database table index became corrupted causing increased latency and load on the database server. The affected table was for providing flat rate shipping rates to the landed cost \(legacy\) service. The landed cost service is used by the checkout process to calculate shipping rates for international orders. This caused the landed cost \(legacy\) and checkout processes to fail when attempting to calculate shipping. This also caused landed cost API to fail intermittently with timeouts because of the increased load on the database. **What was the resolution of the problem and steps that are being taken for continued follow-up?** A patch was deployed to disable the flat rate charts and allow partial recovery and to allow for correcting the affected database table. The affected database table was restored and the flat rate charts were re-enabled. **What mitigation solutions will we put in place to prevent this issue from occurring in the future?** This issue occurred in our legacy database system. The data removal was done to improve query performance, and the operation should have been safe. Though index corruption is a very rare and unexpected outcome, we are doing two things to mitigate this risk and prevent future failure cases: 1. migrating legacy services to a more robust database technology, and 2. creating an additional review policy for potentially destructive database operations.
Status: Postmortem
Impact: Major | Started At: Dec. 13, 2023, 10:22 p.m.
Description: **What products were affected and what was the impact?** Our Landed Cost APIs \(GraphQL\) were impacted. Impact: MAJOR OUTAGE **What timeframe did this issue occur?** | | **Date** | **Time** | | --- | --- | --- | | From: | Sep 19, 2023 | 15:30 MST | | To: | Sep 19, 2023 | 15:44 MST | **How was the issue detected?** Error rates triggered alarm monitors. **What functionality was affected?** Landed cost quotes for some stores could not be returned. **What problems did this cause?** Some merchants were unable to retrieve landed cost quotes. **What was the resolution of the problem and steps that are being taken for continued follow-up?** We discovered a configuration error in a previous release. Due to caching, scheduled synthetic test failures in the development environment lagged behind the deployment to the production environment. We fixed the configuration error, released the fix, and confirmed issue resolution via manual and automated testing. **What mitigation solutions will we put in place to prevent this issue from occurring in the future?** We will expire caches more quickly in the development environment for synthetic tests to identify potential problems prior to deployment to the production environment.
Status: Postmortem
Impact: Critical | Started At: Sept. 19, 2023, 9:36 p.m.
Description: **What products were affected and what was the impact?** Our Landed Cost APIs \(GraphQL\) were impacted. Impact: MAJOR OUTAGE **What timeframe did this issue occur?** | | **Date** | **Time** | | --- | --- | --- | | From: | Sep 19, 2023 | 15:30 MST | | To: | Sep 19, 2023 | 15:44 MST | **How was the issue detected?** Error rates triggered alarm monitors. **What functionality was affected?** Landed cost quotes for some stores could not be returned. **What problems did this cause?** Some merchants were unable to retrieve landed cost quotes. **What was the resolution of the problem and steps that are being taken for continued follow-up?** We discovered a configuration error in a previous release. Due to caching, scheduled synthetic test failures in the development environment lagged behind the deployment to the production environment. We fixed the configuration error, released the fix, and confirmed issue resolution via manual and automated testing. **What mitigation solutions will we put in place to prevent this issue from occurring in the future?** We will expire caches more quickly in the development environment for synthetic tests to identify potential problems prior to deployment to the production environment.
Status: Postmortem
Impact: Critical | Started At: Sept. 19, 2023, 9:36 p.m.
Description: **What products were affected and what was the impact?** Our Landed Cost APIs \(REST and GraphQL\) were impacted. During the outage, all API requests were unauthorized. Impact: MAJOR OUTAGE **What timeframe did this issue occur?** | | **Date** | **Time** | | --- | --- | --- | | From: | August 15, 2023 | 10:40 MST | | To: | August 15, 2023 | 11:02 MST | **How was the issue detected?** We were immediately alerted by our monitoring system. **What functionality was affected?** No landed cost quotes could be returned due to authentication failures. **What problems did this cause?** wrong auth URL. used the discovery instead of the public. **What was the resolution of the problem and steps that are being taken for continued follow-up?** We discovered a configuration error in a previous release. We fixed the configuration error, released the fix, and confirmed issue resolution via manual and automated testing. **What mitigation solutions will we put in place to prevent this issue from occurring in the future?** We are improving documentation on environment configuration, and clarifying how to properly configure service discovery. We are also improving testing procedures to catch similar issues before they are introduced into production.
Status: Postmortem
Impact: Critical | Started At: Aug. 22, 2023, 4:40 p.m.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage or down time. Join for free - no credit card required.
