Recent Issues

[xxMATTGxx]

Apologies for the long period of downtime across all the Habbox websites today starting from the early hours of this morning. We are still investigating why this has happened and also looking into our backup systems as they also started to fail recently. All the Habbox websites should now be back up and running although we do expect for you to see a number of issues on these sites caused by the downtime. If you do come across any of the issues please post them in the following Habbox Feedback thread located here.

[Recursion]

So I'm sure some of you are wondering what happened and why.

Basically at around 1am this morning our MySQL database server took on a large number of queries, six times more than usual (even whilst pulling backups) and then subsequently died a rather unforgiving death, taking out some tables in our Habbox Forum database, the Habbox Live staff panel database and the HabboxV7 development database. Luckily, the data was still in tact and it was the InnoDB engine that took the grunt of the problem. Luckily, this meant we could simply export our data, delete all our databases, then recreate the databases and reimport the data in tact. But what this did highlight was that our backups weren't working as we thought they were. When I went to check on them our entire database backup was only 576 bytes. Something that has now been fixed for future issues. We got lucky this time.

Here's our normal weekly graph. As you can see the maximum queries per second we push is ~300 on a bad day:


Now looking at the daily graph, you can see last night we managed to pull up to 1,200 queries per second before MySQL died at around 1:40am:


Our log files show nothing interesting so the mystery remains yet to be solved...