Time: Nov. 16, 2023, 6:45 p.m.

Status: Postmortem

Update: On November 12, 2023, at 13:33 UTC, we encountered an infrastructure issue affecting routing, which led to temporary service disruptions on multiple Pantheon-hosted sites. Our team quickly identified and addressed the root cause, restoring all services by 14:42 UTC. A brief recurrence of the issue occurred on November 13 at 02:06 UTC, which was rapidly resolved by our engineering team. We apologize for the impact caused to our customers and assure you that we are actively taking steps to enhance our systems to prevent similar incidents in the future. These improvements include strategic upgrades to our traffic management protocols, set to be implemented in November 2023, and refinement of our response strategies to ensure swift resolution of potential issues. At Pantheon, we remain committed to providing reliable and secure hosting services.

Time: Nov. 12, 2023, 4:35 p.m.

Status: Resolved

Update: The issue has been successfully resolved, and we anticipate no further disruptions. If you encounter any unexpected issues, please feel free to reach out to our support team for immediate assistance. We sincerely appreciate your patience and continued support during this incident.

Time: Nov. 12, 2023, 3:59 p.m.

Status: Monitoring

Update: A fix has been implemented and we are actively monitoring the situation as we observe a complete recovery in progress.

Time: Nov. 12, 2023, 3:29 p.m.

Status: Identified

Update: The issue has been identified and a fix is being implemented.

Time: Nov. 12, 2023, 2:54 p.m.

Status: Investigating

Update: We are currently investigating an infrastructure failure impacting customer sites. The identified symptoms include encountering 503 errors, resulting in site unavailability. For urgent issues, please contact [email protected]

Time: Nov. 5, 2023, 12:10 a.m.

Status: Resolved

Update: The issue has been successfully resolved and there should be no further disruptions. If you come across any unexpected issues, please don't hesitate to get in touch with our support team for immediate assistance.

Time: Nov. 4, 2023, 1:13 a.m.

Status: Monitoring

Update: While Pantheon's Front End Sites infrastructure remains available and stable, our team will remain vigilant around the clock to ensure the stability of our service.

Time: Nov. 3, 2023, 1:28 p.m.

Status: Monitoring

Update: While our infrastructure is running normally and remains stable, we're actively keeping an eye out for any possible issues.

Time: Nov. 3, 2023, 10:01 a.m.

Status: Monitoring

Update: While our infrastructure remains stable, we are actively monitoring for any possible problems

Time: Nov. 3, 2023, 5:48 a.m.

Status: Monitoring

Update: While our infrastructure remains stable, we are actively monitoring for any possible problems

Time: Nov. 3, 2023, 2:19 a.m.

Status: Monitoring

Update: While our infrastructure remains stable, we are actively monitoring for any possible problems

Time: Nov. 3, 2023, 1:19 a.m.

Status: Monitoring

Update: While our infrastructure remains stable, we are actively monitoring for any possible problems

Time: Nov. 3, 2023, 12:19 a.m.

Status: Monitoring

Update: While our infrastructure remains stable, we are actively monitoring for any possible problems.

Time: Nov. 2, 2023, 11:18 p.m.

Status: Monitoring

Update: While our infrastructure remains stable, we are actively monitoring for any possible problems.

Time: Nov. 2, 2023, 10:14 p.m.

Status: Monitoring

Update: While our infrastructure remains stable, we are actively monitoring for any possible problems.

Time: Nov. 2, 2023, 7:52 p.m.

Status: Monitoring

Update: While we are observing stability on our platform, we will continue to monitor for any potential issues.

Time: Nov. 2, 2023, 6:29 p.m.

Status: Monitoring

Update: The infrastructure remains in a stable. We are actively monitoring for any potential issues.

Time: Nov. 2, 2023, 5:19 p.m.

Status: Monitoring

Update: The fix has been implemented, and we are currently monitoring for stability. Should you have any concerns, please open a support chat or ticket and we will be happy to assist.

Time: Nov. 2, 2023, 4:25 p.m.

Status: Identified

Update: We are continuing to work on a fix for this issue, and we have identified that it specifically impacts Gatsby sites on Pantheon's Front End Sites. Rest assured, we will continue to provide you with frequent updates until the issue is completely resolved. We sincerely appreciate your patience as we work to mitigate the problem.

Time: Nov. 2, 2023, 3:20 p.m.

Status: Identified

Update: Work on an infrastructure fix is still in progress. We have narrowed down the impact scope and can confirm that the problem is limited to Gatsby sites on Pantheon's Front End Sites infrastructure. Next.js sites and all other services are operating normally. We are making progress and will continue to provide updates as we move closer to a resolution.

Time: Nov. 2, 2023, 1:49 p.m.

Status: Identified

Update: The issue has been identified and a fix is being implemented. We will keep providing regular updates until the issue is resolved, thank you for your patience as we work on mitigating the problem.

Time: Nov. 2, 2023, 1:28 p.m.

Status: Investigating

Update: We are actively investigating an infrastructure issue leading to occasional error displays on Front End Sites. This issue does not impact Drupal or WordPress sites but is specific to Next.js and Gatsby sites on Pantheon's Front End Sites infrastructure. The error may also be visible on docs.pantheon.io.

Time: Nov. 1, 2023, 3:01 a.m.

Status: Resolved

Update: This incident has been resolved.

Time: Nov. 1, 2023, 1:49 a.m.

Status: Monitoring

Update: A fix has been implemented and we are monitoring the results.

Time: Nov. 1, 2023, 12:59 a.m.

Status: Identified

Update: Our engineering team is in the final stages of resolving the issue, although this process may take some time to complete. We apologize for any inconvenience caused and wish to assure you that we are dedicated to addressing this matter to ensure the seamless functioning of the WP CLI. If you have any inquiries or encounter any issues, please feel free to contact our support team through the dashboard's ticketing system or chat.

Time: Oct. 31, 2023, 11:39 p.m.

Status: Identified

Update: We have detected a problem that is impacting some WordPress users when utilizing WP CLI via Terminus after a recent upgrade. We are actively remediating all affected site environments as swiftly as possible and will provide further updates as we gather more information. We apologize for any inconvenience and assure you that we are working diligently to ensure the smooth functioning of the WP CLI. If you have any questions or encounter any issues, please don't hesitate to contact the support team via a ticket or chat in the dashboard.

Time: Oct. 31, 2023, 10:20 p.m.

Status: Identified

Update: We've identified an issue where some WordPress customers may encounter the error: "WPCLI_URL environment variable not set" when using WP CLI via Terminus due to a recent upgrade. A fix is underway. We apologize for any inconvenience and are working swiftly to resolve this. If you have any questions or issues please reach out to the support team via a ticket or chat in the dashboard.

Time: Oct. 30, 2023, 9:52 p.m.

Status: Resolved

Update: The infrastructure issue affecting Front-End Sites has been resolved. Next.js and Gatsby sites on Pantheon's Front-End Sites infrastructure, including docs.pantheon.io, are now operating normally. We appreciate your patience and understanding during this time.

Time: Oct. 30, 2023, 8:40 p.m.

Status: Monitoring

Update: A fix has been implemented to the cloud workers and we are monitoring the results.

Time: Oct. 30, 2023, 8:28 p.m.

Status: Investigating

Update: We are currently investigating an infrastructure issue that is causing intermittent Error 1101 to be shown on Front End Sites only. This is not affecting Drupal or WordPress sites, only Next.js and Gatsby sites on Pantheon's Front End Sites infrastructure. You may see this error on docs.pantheon.io as well.

Time: Oct. 29, 2023, 4:59 p.m.

Status: Resolved

Update: The recent disruption has been resolved, and our system is now stable. We apologize for any inconvenience this may have caused and want you to know that we are actively working on a long-term solution to prevent similar incidents in the future. Your satisfaction remains our top priority, and we deeply appreciate your understanding and patience as we strive to enhance our services.

Time: Oct. 29, 2023, 4:03 p.m.

Status: Monitoring

Update: We've addressed the disruptions in Pantheon's infrastructure and are now monitoring for stability. Should you have any concerns, please open a support chat or ticket and we will be happy to assist.

Time: Oct. 29, 2023, 3:55 p.m.

Status: Investigating

Update: We’ve noticed multiple site outages and are actively working to address and prevent further occurrences. For immediate assistance, please initiate a chat or contact our support team at [email protected].