Last checked: 6 minutes ago
Get notified about any outages, downtime or incidents for Molecule and 1800+ other cloud vendors. Monitor 10 companies, for free.
Outage and incident data over the last 30 days for Molecule.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage. It's completely free and takes less than 2 minutes!
Sign Up NowOutlogger tracks the status of these components for Xero:
Component | Status |
---|---|
Europe | Active |
Amazon Web Services - Databases | Active |
Amazon Web Services - DNS | Active |
Amazon Web Services - EC2 | Active |
Amazon Web Services - EKS | Active |
Amazon Web Services - File Storage | Active |
Auth0 User Authentication | Active |
Molecule Europe | Active |
US | Active |
Amazon Web Services - Databases | Active |
Amazon Web Services - DNS | Active |
Amazon Web Services - EC2 | Active |
Amazon Web Services - EKS | Active |
Auth0 User Authentication | Active |
Molecule | Active |
View the latest incidents for Molecule and check for official updates:
Description: We have identified the root cause of this issue and have successfully updated and validated the impacted marks. The affected trades have been revalued. We will share details in a post-mortem soon. Thank you for your patience and understanding during this process.
Status: Resolved
Impact: Major | Started At: Oct. 23, 2024, 12:46 p.m.
Description: We implemented a code fix last night to prevent new trade updates from having this problem. Today we will run a script to fix trades with unrecognized user updates between 10/11 and 10/20. We will reach out on a customer-by-customer basis if we identify any trades that may cause large PnL swings.
Status: Resolved
Impact: None | Started At: Oct. 21, 2024, 5:20 p.m.
Description: **Summary of Incident** On September 9, 2024, between 18:22 UTC to approximately 18:37 UTC, a brief service disruption impacted our Europe-based users. We regret any inconvenience caused and thank you for your patience and understanding. \*\*What happened?\*\*An outage affected access to our system for users in Europe for a period of 15 minutes. \*\*Why?\*\*The outage occurred due to a human error while preparing for disaster recovery testing, which inadvertently led to the removal of critical system resources. **Corrective/Preventive Actions**To prevent similar incidents in the future, we are the following action: * **Enhanced Protections**: Implement additional safeguards in Molecule's test and production environments to prevent accidental removal or interruption of critical components. We sincerely appreciate your continued patience and understanding as we work to improve the reliability of our services.
Status: Postmortem
Impact: None | Started At: Sept. 9, 2024, 6:30 p.m.
Description: This incident has been resolved. We have not seen any issues with reconciliations or any 3rd party data.
Status: Resolved
Impact: None | Started At: July 19, 2024, 9:10 p.m.
Description: # **Incident Report: Incomplete Valuation Data - Resolved** **Date of Resolution:** July 1, 2024 ## **Summary** On Monday morning, July 1, 2024, an issue where certain trades were missing valuation entries was identified and addressed the same day. We apologize for any inconvenience this may have caused and appreciate your understanding. ## **What happened?** The Molecule application has a feature that limits how far into the future valuation entries will be created when trades are made. However, there was no mechanism to create entries for skipped as\_of dates when they became relevant. These previously excluded entries became relevant for the first time on July 1, and some customers began reporting the issue on Friday, June 28. ## **Why** * When implementing the as\_of\_date limits for entry building, a corresponding job to build skipped entries before they became relevant was not available to be run in production. * The system did not include sufficient checks to identify these issues ahead of time. ## **Corrective/Preventive Actions** * A script was deployed immediately to generate missing entries, addressing the issue and correcting the problem for impacted customers as soon as possible. This script will run daily to ensure all entries are built until we remove the limit for good. * An internal check has been created to catch missing entries ahead of time. We apologize for any inconvenience caused and appreciate your understanding as we work to improve our systems and prevent similar issues in the future.
Status: Postmortem
Impact: None | Started At: July 1, 2024, 7:16 p.m.
Join OutLogger to be notified when any of your vendors or the components you use experience an outage or down time. Join for free - no credit card required.