Time: Feb. 13, 2024, 2:49 p.m.

Status: Resolved

Update: We have not seen any errors since the fix was rolled out and are closing this incident as resolved.

Time: Feb. 13, 2024, 2:37 p.m.

Status: Monitoring

Update: We have rolled out a fix and are monitoring the results.

Time: Feb. 13, 2024, 1:36 p.m.

Status: Identified

Update: The issue has been identified and a fix is being implemented

Time: Feb. 13, 2024, 1:12 p.m.

Status: Investigating

Update: We are currently investigating the issue

Time: Dec. 4, 2023, 5:15 p.m.

Status: Resolved

Update: The systems are stable after the fix and monitoring for a specified duration

Time: Dec. 4, 2023, 4:59 p.m.

Status: Monitoring

Update: The issue was identified and a fix implemented. We are monitoring currently.

Time: Dec. 4, 2023, 4:54 p.m.

Status: Identified

Update: We are currently investigating an incident that result in outbound connections from Atlassian cloud in us-east-1 intermittently timing out. This affects Jira, Trello, Confluence, Ecosystem products. The features affected for these products are those that require opening a connection from Atlassian Cloud to public endpoints on the Internet

Time: Dec. 4, 2023, 4:43 p.m.

Status: Identified

Update: Including Atlassian Developer

Time: Dec. 4, 2023, 4:33 p.m.

Status: Identified

Update: We are currently investigating an incident that result in connection time outs on service egress proxy. This affects Jira, JSM, Confluence, BitBucket, Trello, Ecosystem products. The features affected for these products are those that require a connection to service egress.

Time: Dec. 4, 2023, 5:16 p.m.

Status: Resolved

Update: We can confirm the issue is now resolved and are closing the incident.

Time: Dec. 4, 2023, 4:41 p.m.

Status: Monitoring

Update: We have identified the issue and implemented a fix that should resolve the intermitted chart loading failures. We are now monitoring the recovery.

Time: Dec. 4, 2023, 3:18 p.m.

Status: Investigating

Update: We are investigating an issue causing intermittent chart loading failures on Atlassian Analytics. Will provide more updates in an hour

Time: Nov. 30, 2023, 2:09 a.m.

Status: Resolved

Update: We have identified and fixed the issue causing the delay. The data ingestion jobs are processing as expected and the Opsgenie data is back to normal.

Time: Nov. 29, 2023, 4:35 a.m.

Status: Investigating

Update: We are continuing to investigate the issue and speed up data processing jobs. Will provide further updates in the next 24 hours

Time: Nov. 28, 2023, 4:36 p.m.

Status: Investigating

Update: We are continuing to investigate the issue and speed up data processing jobs. We will provide more details as they are available in the next 12 hours.

Time: Nov. 28, 2023, 1 a.m.

Status: Investigating

Update: We are continuing to investigate the issue. While we look for the root cause of the slowness, we are also pursuing various solutions to speed up ingestion. We will provide more details in 4 hours.

Time: Nov. 27, 2023, 7:14 p.m.

Status: Investigating

Update: We are investigating an issue causing delays ingesting Opsgenie data into the Atlassian Data Lake. We will provide more details in the next 4 hours.

Time: Nov. 22, 2023, 5:12 p.m.

Status: Postmortem

Update: ### **SUMMARY** On November 11, 2023, between 9:07 and 10:03 UTC, customers using Atlassian Analytics were unable to view charts on their dashboards. The event was triggered by a routine upgrade of a database cluster used by the service responsible for querying the data used in Atlassian Analytics charts. The incident was detected within 10 minutes by our monitoring system and mitigated by redeploying the impacted services which put affected Atlassian systems into a known good state. The total time to resolution was about 56 minutes. ### **IMPACT** The overall impact was between 9:07 UTC and 10:03 UTC on November 11, 2023. The incident caused a service disruption for all customers using Atlassian Analytics during the outage window. More specifically, the service responsible for querying data to populate charts experienced errors leading to failures when viewing and creating charts. ### **ROOT CAUSE** The issue was triggered by a routine upgrade of a database cluster which caused an unexpected loss of connectivity with the service responsible for issuing queries for Atlassian Analytics. Investigation during the incident identified that this was due to the database cluster changing the IP address after the upgrade. The service did not react to this change in an expected manner ### **REMEDIAL ACTIONS PLAN & NEXT STEPS** We know that outages impact your productivity. While we design our services to be highly available and resilient to most failures, this scenario was not handled as expected. We are prioritizing the following actions to avoid repeating this type of incident: * Implement more robust automatic database failure recovery. * Improve existing and implement new monitoring processes in order to detect similar issues faster. * Improve our internal documentation to more quickly resolve similar issues. We apologize to customers whose services were impacted during this incident; we are taking immediate steps to improve the platform’s performance and availability. Thanks, Atlassian Customer Support

Time: Nov. 11, 2023, 10:09 a.m.

Status: Resolved

Update: Simple Between 09:05 UTC to 10:00 UTC, we experienced charts failing to load for Atlassian Analytics. The issue has been resolved and the service is operating normally. Detailed Between 09:05 UTC to 10:00 UTC, all customers experienced charts failing to load for Atlassian Analytics. The root cause was a upstream update that caused database connectivity problems. There is no impact to the Atlassian Data Lake. We have deployed a fix to mitigate the issue and have verified that the services have recovered. The conditions that cause the bug have been addressed and we’re actively working on a permanent fix. The issue has been resolved and the service is operating normally.

Time: Nov. 11, 2023, 10:02 a.m.

Status: Investigating

Update: We are investigating an issue with charts that is impacting Atlassian Analytics customers. We will provide more details within the next hour.