Is there an Sauce Labs outage?
Sauce Labs status: Systems Active
Last checked: a minute ago
Get notified about any outages, downtime or incidents for Sauce Labs and 1800+ other cloud vendors. Monitor 10 companies, for free.
Last checked: a minute ago
Get notified about any outages, downtime or incidents for Sauce Labs and 1800+ other cloud vendors. Monitor 10 companies, for free.
Outage and incident data over the last 30 days for Sauce Labs.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage. It's completely free and takes less than 2 minutes!
Sign Up NowOutlogger tracks the status of these components for Xero:
| Component | Status |
|---|---|
| API Testing | Active |
| EU-Central | Active |
| US-West | Active |
| Automated Browser Testing | Active |
| EU-Central | Active |
| US-West | Active |
| Automated Real Device Testing | Active |
| EU-Central | Active |
| US-East | Active |
| US-West | Active |
| Automated Virtual Mobile Device Testing | Active |
| EU-Central | Active |
| US-West | Active |
| Billing | Active |
| EU-Central | Active |
| US-West | Active |
| Insights | Active |
| EU-Central | Active |
| US-West | Active |
| IPSec VPN | Active |
| EU-Central | Active |
| US-West | Active |
| Live Browser Testing | Active |
| EU-Central | Active |
| US-West | Active |
| Live Real Device Testing | Active |
| EU-Central | Active |
| US-East | Active |
| US-West | Active |
| Live Virtual Mobile Device Testing | Active |
| EU-Central | Active |
| US-West | Active |
| Mobile App Distribution (TestFairy) | Active |
| TestFairy Platform | Active |
| TestFairy UI | Active |
| Native Framework Mobile App Testing | Active |
| EU-Central | Active |
| US-East | Active |
| US-West | Active |
| Other | Active |
| saucelabs.com | Active |
| Sauce Labs Documentation | Active |
| support.saucelabs.com | Active |
| Sauce Connect | Active |
| EU-Central | Active |
| US-East | Active |
| US-West | Active |
| Sauce Labs Dashboard | Active |
| EU-Central | Active |
| US-West | Active |
| Sauce Labs REST API | Active |
| EU-Central | Active |
| US-West | Active |
| Sauce Orchestrate | Active |
| EU-Central | Active |
| US-West | Active |
| Visual Testing | Active |
| Legacy Visual Testing (Screener) UI | Active |
| Visual Testing Hub | Active |
| Visual Testing Infrastructure | Active |
| Visual Testing REST API | Active |
View the latest incidents for Sauce Labs and check for official updates:
Description: ### **Dates:** Tuesday September 12th 2023, 16:03 - 16:29 UTC ### **What happened:** Customers could not start tests in the EU-Central region and, after 15 minutes, in the US-West region. ### **Why it happened:** Tests failed to start due to an issue with starting the virtual machines they run on. The service responsible for creating the virtual machines had a bug that introduced a cyclical dependency, which prevented it from starting correctly. **How we fixed it:** To restore normal operation, we performed the following: 1. Deployed the previous known working version of the affected service to both EU and US data centers 2. Monitored to ensure that tests stopped timing out ### **What we are doing to prevent it from happening again:** We addressed the bug, tested it, and released the original intended change back in Production.
Status: Postmortem
Impact: None | Started At: Sept. 12, 2023, 2 p.m.
Description: ### **Dates:** Thursday September 7th 2023, 22:36 - 22:55 UTC ### **What happened:** Users experienced high wait times, followed by elevated error rates both as jobs timed out and after restoration as we handled the backlog of requests. This impacted Windows, Mac, iOS Simulator, and Android Emulator tests in the US West region. ### **Why it happened:** An internal service responsible for maintaining the virtual device state across our various platforms crashed due to a failover of MemoryStore during routine GCP maintenance. During this event, the service did not recover gracefully, and it caused another internal service responsible for pre-launching virtual devices based on demand to have connectivity issues with the cloud state service. Due to this connectivity issue, we did not pre-launch devices successfully for the duration of the incident leading to long device wait times. ### **How we fixed it:** We restarted the cloud state service and then, subsequently, the pre-launching service. After that action, all connections were re-established, and the services began running normally. ### **What we are doing to prevent it from happening again:** We are enhancing the cloud state service to handle a MemoryStore outage better, specifically introducing retry logic for reestablishing connectivity.
Status: Postmortem
Impact: Minor | Started At: Sept. 7, 2023, 11:49 p.m.
Description: ### **Dates:** Wednesday September 6th 2023, 18:35 UTC - Thursday September 7th 19:05 UTC ### **What happened:** A subset of customers were unable to run tests with specific uploaded apps in the EU region intermittently for the duration of the incident. ### **Why it happened:** During migrating users from regional to global teams, several organizations in the EU had their users moved to the default team, meaning they were unable to run tests using apps uploaded by another team. Various scripts were created to prepare and execute this migration, one of which was meant to determine a user’s region. This script had a bug in it and misconfigured 55 organizations. ### **How we fixed it:** We were able to restore the user configuration to restore service, and then we addressed the bug in the script and completed the migration. ### **What we are doing to prevent it from happening again:** We have addressed bugs in the migration pipeline and the scripts it leverages for future runs.
Status: Postmortem
Impact: Minor | Started At: Sept. 7, 2023, 3:03 p.m.
Description: ### **Dates:** Monday August 21st 2023, 07:50 - 08:17 UTC ### **What happened:** Customers experienced intermittent issues loading various components in the Sauce Labs web application. ### **Why it happened:** Some transient failures between our public cloud providers resulted in timeouts between components, leading to errors in the Sauce Labs web application. ### **How we fixed it:** The transient failures went away on their own. ### **What we are doing to prevent it from happening again:** No specific actions are being taken to prevent this in the future other than our continual focus on improving the resiliency of our architecture.
Status: Postmortem
Impact: Major | Started At: Aug. 21, 2023, 8:16 a.m.
Description: ### **Dates:** Wednesday July 19th 2023, 23:00 UTC - Thursday July 20th 2023, 18:45 UTC ### **What happened:** Customers reported automated Android tests failing with the message: "A failure occurred while attempting to upload the video, screenshots, and log files for your test.” ### **Why it happened:** After a deployment, there was a small increase in upload errors that gradually increased overnight. Once it became apparent that there was a problem with the system, we looked closely at all recent changes and determined the deployment referenced earlier introduced an issue with the process that is responsible for uploading test assets to our storage service. ### **How we fixed it:** Once the cause was identified, we rolled back to a previously working version. ### **What we are doing to prevent it from happening again:** We have updated the in-team dashboards to more clearly show upload and other errors over a longer period. These dashboards are one of the mechanisms we use to determine if the system is healthy post-deployment.
Status: Postmortem
Impact: Major | Started At: July 20, 2023, 5:19 p.m.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage or down time. Join for free - no credit card required.
