Dear Colnectors,
I'd like to apologize for the errors you may have seen during the last few days on Colnect. We have been facing some technical difficulties which caused outages mostly during Friday/Saturday and things are almost completely under control now and hopefully soon we'll be done with it and be back to near 100% availability as always.
What happened? Following a software upgrade we started getting random database crashes. We tried upgrading even further but it didn't help. Turns out there was malfunctioning RAM on one of the servers which was finally replaced. Due to upgrade compilations done with a faulty RAM, the entire system has become unstable and has to be rebuilt, which takes time. Meanwhile, we're serving Colnect to you with our database replica which keeps being in sync with the main one. Your data is safe.
What's next? We expect to finish the server rebuild and compilations by tomorrow. Until then, we're not expecting downtimes of more than a few minute while trying to make switches. As the main DB server was down, some regular maitinante tasks didn't complete properly but we expect to wrap it up today. We've noticed that some sales on the marketplace didn't automatically renew and we'll try to get this solved by today as well. For most Colnectors in most scenarios, everything works as it does normally.
I'm very sorry for the trouble experienced. They were worse due to limited availability during this weekend which made it the worst downtime of Colnect in years even though we're talking about a net of ~10 hours downtime. The team and I are doing the best to ensure service is always kept at the best possible level.
Thank you for your support and understanding
