AO3 Status

[update] Resolved: We've caught up on the backlog! Emails, history, search, challenge matching, work and bookmark listings, and other background functions are now processing as normal. We appreciate your patience.

[update] Monitoring: We've resolved the underlying issue and are now working through the backlog of updates. No data has been lost. We appreciate your patience while we catch up!

[update] Investigating: #AO3 is aware of issues related to email notifications, searching, challenge matching, history, works and bookmarks showing in listings, and other background functions. We are working to resolve the issue and will keep you updated!

#AO3 is excited to announce that we're beginning to roll out translated email notifications, allowing you to receive emails from us in languages other than English! At the start, this will only be for Simplified Chinese, but we can't wait to add others! Read more at ao3-news.org/4w4r6mkz

[update] Resolved: AO3 is once again fully functional; all issues should be resolved, thank you for your patience! If you are still experiencing any issues past this point, please let us know.

[update] Investigating: AO3 is currently experiencing issues; those issues include uploading and/or viewing icons for profiles, collections, or skins. We are aware and are actively investigating.

#AO3's July releases included the big switch to 1.0, filters for user Collections pages, and a fix for a bug that caused blank word counts! Find out more about those and other changes in our latest release notes post: ao3-news.org/v-1-4-0

The planned #AO3 maintenance for August 21 has been canceled. It will be rescheduled for a later date.

[update] Scheduled: #AO3 will be down for about 2 hours starting at 08:00 UTC on August 21.

In June and early July, we updated the #AO3 Terms of Service FAQ and made improvements all around prompt memes and gift exchanges. We also improved skin previews and the AO3 admin area, along with a few other small fixes. Learn more at ao3.org/admin_posts/35936

In May, updates to #AO3 focused on improving skins, collections, and gift exchanges, boosting performance across #AO3, and addressing several security issues. Read more at: ao3-news.org/v-0-9-481

We have temporarily lifted the block preventing users from logging in to #AO3 with an insecure password. If you have been receiving the above message, please refer to our Tumblr post for information on what to do next: ao3-news.org/yu353wkr

If you are receiving a warning that your #AO3 password has appeared in a data breach from another site and is no longer secure, you will need to change your password before you can log back in. Read more on our Tumblr: ao3-news.org/bdzc9e3b

#AO3 has recently seen a wave of phishing comments claiming to be made by "AO3 Trust & Safety" notifying you that your account has been restricted. These claims are not true. Do not click on links in these comments or pay for verification. Read more at otw-news.org/5n972k6a

In April, we deployed improvements to tag search and several security fixes. We also made some progress on making more parts of #AO3 translatable. And of course, AO3 officially exited open beta in April as well! Read more at: ao3-news.org/v-0-9-473

#AO3's March code releases included a slew of collection, bookmark, and history bug fixes, as well as several improvements for site admins. Read more at ao3-news.org/v-0-9-468

[update] Resolved: We have resolved the issue that was causing slowness. #AO3 should be back to functioning normally for all users! If you are still experiencing any issues past this point, please let us know. Thank you for your patience!

[update] Monitoring: #AO3 is currently experiencing some slowness. We’ve resolved the issue and are monitoring. Some users on older devices may still encounter errors as we continue making adjustments.

#AO3's February releases included new admin tools for our Support and Policy & Abuse teams, as well as a bunch of challenge and collection fixes and a host of small updates and improvements. We also upgraded to Rails 8 and Elasticsearch 9! Read more at ao3-news.org/v-0-9-461

#AO3 is exiting open beta! Learn more about how far we've come since launching open beta, our future plans for improvement, and what you can do to contribute at otw-news.org/4w2dn3tc

To improve account security, we now alert you if your #AO3 password matches a password known to be compromised on other sites. If you see this banner when logging in, please change your password. For more advice on protecting your account: otw-news.org/y8jnay3v

#OTW Systems volunteers have published a postmortem about the issues behind the unplanned #AO3 downtime in early March. Check it out on AO3: ao3-news.org/2v2en3bf

[update] Resolved: #AO3 and #Fanlore are back! Our data center says they have disabled the upstream provider that was causing the outage, but we are continuing to monitor the situation.

[update] Investigating: #AO3 and #Fanlore are currently down. We are investigating.

[update] Resolved: The fix we applied 24 hours ago appears to be holding, so we are resolving this incident. We thank everyone for their patience!

[update] Monitoring: We have made some adjustments based on recommendations from our database vendor and will continue to monitor their impact on system stability.

[update] Investigating: Following guidance from our vendor, we've brought #AO3 back online to help troubleshoot. We expect the site will go back down, although we don't know when that will happen. If you choose to post or update your works while AO3 is up, we strongly recom...

[update] Investigating: AO3 is now fully down. After performing a software upgrade a few days ago, we've been unable to keep our server cluster healthy due to what we believe is a bug or issue with the new release of our database server software. We're working with our ve...

[update] Investigating: We are investigating reports of errors when trying to load AO3, including errors saying that AO3 is down, which seem to be related to the previous incident. We will update when we have more information!

[update] Resolved: We have resolved the underlying issue, and #AO3 should be behaving as normal for all users again.

[update] Monitoring: We have applied a fix, and #AO3 is accessible again for users. Potential slowness remains and certain VPNs may still be blocked until we verify everything is fully stable again.

[update] Investigating: #AO3 will remain down for at least several hours until we can consult our database vendor's support team and resolve the underlying issue. We're very sorry for the inconvenience.

[update] Investigating: We are investigating reports of errors when trying to load AO3, including errors saying that AO3 is down.

[update] Monitoring: #AO3 is back up! We appreciate your patience. We've got our protections against bot traffic turned up a bit higher than usual, so some users may experience problems if they're using a VPN or similar tools.

[update] Identified: We've identified the problem and are working on a fix. We expect to remain down for several more hours. We apologize for the inconvenience and appreciate your patience!

[update] Investigating: AO3 is currently down. We do not have an estimated return time currently. We're looking into it with one of our third-party support providers and will update when we have more information. Thank you for your patience!

[update] Investigating: We are continuing to investigate reports of slowness and errors when trying to load AO3, including errors saying that AO3 is down.

[update] Investigating: We are currently investigating reports of slowness and errors when trying to load AO3.

We released several batches of bug fixes and code updates in December, focusing on improvements to collections and challenges, error handling, and code optimization. ao3-news.org/v-0-9-452

[update] Resolved: AO3 is once again fully functional; all issues should be resolved. If you are still experiencing any issues past this point, please let us know. Thank you for your patience!

[update] Monitoring: We've made some adjustments to reduce the errors and are continuing to monitor the situation.

[update] Investigating: AO3 is currently experiencing slowness and errors. We are aware and are actively investigating.

To improve account security, #AO3 has updated our password change process to prevent users from choosing new passwords that are extremely short. We've also increased the maximum password length. To learn more about how to protect your account, check out: otw-news.org/y8jnay3v

[update] Resolved: This incident has been resolved.

[update] Monitoring: The vendor of our spam checking software has applied some changes, so fewer comments should be incorrectly marked as spam. We will continue to monitor the situation.

[update] Completed: The scheduled maintenance has been completed.

[update] In Progress: Scheduled maintenance is currently in progress. We will provide updates as necessary.