Should Habbox move database backups to Amazon RDS?

[Chippiewill]

Vote yes.

[xxMATTGxx]

Even if the majority of the forum vote yes, it's not a decision the community can have a decision in. As at the end of the day it's the owners of Habbox who will have to pay for this. I'm not saying we shouldn't but I wouldn't get your hopes up.

[Chippiewill]

$2 p/m isn't unreasonable.

[xxMATTGxx]

$2 p/m isn't unreasonable.

I never said it wasn't.

[lemons]

Potato

[myles]

i votesd yes because it seems sensible

[Kyle]

can you explain for people that aren't experts like you and I what the benefits would be

[Chippiewill]

can you explain for people that aren't experts like you and I what the benefits would be

We would have a slave database running on Amazon's AWS, it would make a copy of Habbox's mysql server in real-time, on top of that daily backups would be made of the server from the AWS end. The result being that if the database becomes ****** on the Habbox server like it has now just done twice in a month, then there would be a perfect drop-in backup.

[FlyingJesus]

I voted no because I'm a rebel, also like Matt said these sort of things shouldn't be democratic

[Kyle]

We would have a slave database running on Amazon's AWS, it would make a copy of Habbox's mysql server in real-time, on top of that daily backups would be made of the server from the AWS end. The result being that if the database becomes ****** on the Habbox server like it has now just done twice in a month, then there would be a perfect drop-in backup.
ok and what are the possible cons/reasons given for not doing it

[Chippiewill]

ok and what are the possible cons/reasons given for not doing it

Pros:
Foolproof Backups that are actually simpler than the current system

Cons:
Costs $2 per month

[Kyle]

ok that settles it for me.

voted potato

[Storking]

potato

[sex]

potato cause irish

[iBlueBox]

what type of potato is it before i make a decision?

[e5]

ok and what are the possible cons/reasons given for not doing it

Dunno what I'm voting for but yes

[lRhyss]

what type of potato is it before i make a decision?
Estima

[xxMATTGxx]

I think the potato is the better option here

[Kyle]

I think the potato is the better option here
good job habbox seems to be hosted on a potato lately then. everybody's happy.

[Storking]

hope it's a jersey royal

[Mr-Trainor]

Pros:
Foolproof Backups that are actually simpler than the current system

Cons:
Costs $2 per month
From how you've described it, it seems like a suitable solution to go for. But what's the actual difference (including cost) between that and what Habbox uses at the moment :P?

[Chippiewill]

Currently Habbox performs a database dump every day at 2AM GMT (Or thereabouts) using Xtrabackup, this is then backed up somewhere remotely (Though I'm not actually sure where). Current backup cost is whatever the remote storage costs. Downside being the backup is performed only once a day and more prone to failure / corruption.

[Chippiewill]

Forum DB just broke.. again

[xxMATTGxx]

Forum DB just broke.. again

Yes we know.

[Chippiewill]

Just making my point patently clear.

[xxMATTGxx]

Just making my point patently clear.

Yes but it doesn't help when the server itself also has an issue and reboots either which causes all of these problems in the first place.

[Recursion]

And moving to RDS will solve none of the current issues at hand.

[xxMATTGxx]

And moving to RDS will solve none of the current issues at hand.

Oh snap.

[GoldenMerc]

XenForo is the way forward, pay a guy to fix the DB up. Then move acrossssss

[xxMATTGxx]

XenForo is the way forward, pay a guy to fix the DB up. Then move acrossssss

Nothing to do with vBulletin...

[Chippiewill]

And moving to RDS will solve none of the current issues at hand.

RDS would allow us to ignore the current issues at hand.

[FlyingJesus]

Move to Geocities

[GoldenMerc]

But why is Habbox's DB so broken? I mean theres boards out there with hundreds of thousands of members. Why is Habbox's so unreliable?

[Chippiewill]

But why is Habbox's DB so broken? I mean theres boards out there with hundreds of thousands of members. Why is Habbox's so unreliable?

Recursion and I both think its a hardware issue that's corrupted the databases.

[Recursion]

But why is Habbox's DB so broken? I mean theres boards out there with hundreds of thousands of members. Why is Habbox's so unreliable?

Because there's a hardware fault SOMEWHERE that means when the server dies it corrupts any current databases transactions. Luckily the forum hasn't been irrecoverably hit yet.

Unfortunately it means whilst some of the tables are broken we can't run our automated backups.

[wordofwisdom]

go back to amazon i'll even buy the ******* hosting monthly

[Recursion]

go back to amazon i'll even buy the ******* hosting monthly

We've never been on Amazon...

[GoldenMerc]

Recursion and I both think its a hardware issue that's corrupted the databases.


Because there's a hardware fault SOMEWHERE that means when the server dies it corrupts any current databases transactions. Luckily the forum hasn't been irrecoverably hit yet.

Unfortunately it means whilst some of the tables are broken we can't run our automated backups.
So if its hardware, Why not try run a mirror copy of Habbox on another server, See if it shows the same results?
OR
Has the hardware damaged the database?

go back to amazon i'll even buy the ******* hosting monthly
What the hell... Atleast try stay ontopic, Didn't actually know Amazon did web hosting;
http://aws.amazon.com/websites/

We've never been on Amazon...

[Chippiewill]

So if its hardware, Why not try run a mirror copy of Habbox on another server, See if it shows the same results?
OR
Has the hardware damaged the database?
......:

Recursion and I both think its a hardware issue that's corrupted the databases.

[scottish]

Why is the server dying in the first place that causes the subsequent corruption..

There's quite a few issues that need to be resolved it seems..

[Chippiewill]

Why is the server dying in the first place that causes the subsequent corruption..
Fluke chance.

[GoldenMerc]

Fluke chance.

Fluke or just people who don't actually know what they are doing with servers (mind Recursion) Every other techie such as HU, Skynus(?) and previous ones have never actually been trained or work in that industry?

[Chippiewill]

Fluke or just people who don't actually know what they are doing with servers (mind Recursion) Every other techie such as HU, Skynus(?) and previous ones have never actually been trained or work in that industry?

No one else has had the level of access to cause this kind of damage.

[xxMATTGxx]

Fluke or just people who don't actually know what they are doing with servers (mind Recursion) Every other techie such as HU, Skynus(?) and previous ones have never actually been trained or work in that industry?

HotelUser or Skynus has never had server root access.

[GoldenMerc]

HotelUser or Skynus has never had server root access.

What about Baving, Just-one, Think the list goes on, JRH, Wayne_J

[xxMATTGxx]

What about Baving, Just-one, Think the list goes on, JRH, Wayne_J

You do realise those members haven't been staff for a very long time Habbox has moved servers on a number of occasions. If those people did anything specific back then you would have seen the issues back then, not now..

[GoldenMerc]

You do realise those members haven't been staff for a very long time Habbox has moved servers on a number of occasions. If those people did anything specific back then you would have seen the issues back then, not now..

Who was staff when the issues appeared? HU?

[xxMATTGxx]

Who was staff when the issues appeared? HU?

What issues? This issue is nothing to do with the past or HotelUser.

[Recursion]

Don't you have some sort of SMS system to be working on? GoldenMerc;

[Chippiewill]

Yeah, why is sms2paypal having so many issues lately. Who are the people who managed the server, did they break it?

[GoldenMerc]

Don't you have some sort of SMS system to be working on? GoldenMerc;
Not to work on, Called waiting on funds...

Yeah, why is sms2paypal having so many issues lately. Who are the people who managed the server, did they break it?

Pretty immature to attack people surely you have servers to be fixing & tables to be rebuilding?

[Chippiewill]

Pretty immature to attack people surely you have servers to be fixing & tables to be rebuilding?

Actually no, I'm not Habbox staff. Sort out your **** mate.

[GoldenMerc]

Actually no, I'm not Habbox staff. Sort out your **** mate.

Wasn't that because you were a lazy slob... Fired by skynus is even more embarrassing.

[Chippiewill]

Wasn't that because you were a lazy slob... Fired by skynus is even more embarrassing.

ikr, skynus did even less work than I did.

[Reality]

Erm, I voted potato it only seems logical because it's as about as idle as this thread.

[FlyingJesus]

This is such a lame fight

[Chippiewill]

PSA Server's going down in five minutes for a MEMTEST

[scottish]

Who made you staff

[Chippiewill]

No one, I'm not staff.

[xxMATTGxx]

Who made you staff

He's a nobody, just ignore him that's what everyone else does.

[Chippiewill]

Due to timezone conversions, five minutes is now five weeks.

[Chippiewill]

It has now been concluded that quantum fluctuations emanating from the server have created a localised 'time dilation bubble' creating inconsistencies in the database, as a result we can expect the tech to reach the server with the crash cart in a time asymptomatically approaching infinite as he gets closer to the server.

Unfortunately Experts at CERN have given us estimates of four weeks before before the whole of the UK have succumbed to the effects of the rapidly expanding bubble. By the time we have launched Bruce Willis in a rocket in order to destroy the server with a thermonuclear device it may already be too late. On the plus side, if he succeeds the simultaneous explosion and implosion will be contained by the time dilation bubble meaning only 1/4 of the Manchester metropolitan area will be levelled.

[Inseriousity.]

time dilation bubble?
timey wimey wibbly wobbly sounds better

[Chippiewill]

what a long memtest that was.

[scottish]

You sure do pick the best time to perform maintenance that you know will take hours.

What was the results of the initial memory test? Did it provide results that would indicate there's faults in the memory hence why you decided to perform a longer memory test? Have you replaced memory due to faults?

The announcement summed up is 'we performed short memory test to see if it has any issues, we then performed a full memory test, as you can see the forum is stable'.. well the forum appeared to be stable the rest of the time, apart from when it was dead so not really helping but yeah

Which databases were corrupt? Was there any data loss? Was the reboots down to issue with RAM? Has this now been fixed? How many times did the reboots corrupt databases before it was fixed? How do you plan on avoiding this in future if there is similar RAM issues?

[Chippiewill]

They need to wait for Jin for the results of the test. They started the tests at 9AM because that was the earliest convenient time and Recursion has already spent enough time rebuilding databases to wait longer.

As for which databases were corrupt, from the ones Recursion has named I can't think of any which weren't corrupt, there may have been some recoverable data loss. I believe there were two unexpected restarts/shutdowns and they corrupted another time in the middle of fixing one of them. I suspect similar RAM issues are unlikely (If there even are RAM issues, which there probably aren't since it's ECC).

[scottish]

How come you provide us with more information than any actual staff member lol..

There must have been some indication of RAM issue if they prompted for a full memory test though, otherwise doing a short one followed by a full one was just stupid when you could go for the full one first and take a lot less time.

Was there any unrecoverable data loss?

[xxMATTGxx]

Will hasn't really provided much extra information then what is already out there by either me or Tom. We also stated the following:


We shall also post more information about the recent issues once we have all of the Habbox websites back up and running.

Considering this isn't over then a lot of the information hasn't been published at this moment in time. Not like the majority of the forum userbase would understand it either if it was just full of technical terms.

[scottish]

I will so post it

[xxMATTGxx]

I will so post it

Yeah sure, later.

[Chippiewill]

How come you provide us with more information than any actual staff member lol..
Because I'm chatting with Recursion about it and he cba to post on the forum.


There must have been some indication of RAM issue if they prompted for a full memory test though, otherwise doing a short one followed by a full one was just stupid when you could go for the full one first and take a lot less time.I think the idea being that if they find an issue quickly on the short test then they don't have to wait for a long test to finish before replacing the RAM.


Was there any unrecoverable data loss?
The only table that I know of that might have been unrecoverable is one of the V7 ones but there's a backup for it anyway.

[xxMATTGxx]

Because I'm chatting with Recursion about it and he cba to post on the forum.

I think the idea being that if they find an issue quickly on the short test then they don't have to wait for a long test to finish before replacing the RAM.


The only table that I know of that might have been unrecoverable is one of the V7 ones but there's a backup for it anyway.

There's the image uploader the staff use but is nothing to worry about as we'll just reinstall that anyway.

[Chippiewill]

There's the image uploader the staff use but is nothing to worry about as we'll just reinstall that anyway.

It was only the album tables that got corrupt, I wasn't under the impression you used those anyway.

[xxMATTGxx]

It was only the album tables that got corrupt, I wasn't under the impression you used those anyway.

We don't, hence why I said "nothing to worry about"

[Recursion]

I'm still sorting databases. I'll post more info before I go to bed.

[Recursion]

http://www.habboxforum.com/showthread.php?t=803958&p=8200793#post8200793
Chippiewill; scottish;

[Reality]

Is this thread still going on... Let's just remember that it's not going to happen

[lemons]

http://thestriveforhappiness.files.wordpress.com/2010/07/potato_heart_mutation.jpg

[Jack!]

Instead of paying more money per month.. you could you know... do something drastic and just try and fix the current issues instead of covering them in gloss.

EDIT: Didn't read thread.. #yolo

[Reality]

They're already trying to resolve additional issues as well as main ones but they take time to fix and the forum isn't in the best state because of some of these issues but they do try their best to fix the issues

[Jack!]

They're already trying to resolve additional issues as well as main ones but they take time to fix and the forum isn't in the best state because of some of these issues but they do try their best to fix the issues


http://cdn.memegenerator.net/instances/400x/37862921.jpg

You basically repeated yourself three times in that sentence.. just saying.

[Reality]

http://cdn.memegenerator.net/instances/400x/37862921.jpg

Basically yeah

[Jack!]

So I take it that its nothing to do with the RAM then anyway if nothing came up on the short test?

Windows Server? Linux? (CentOS, etc etc) I'm assuming for arguments sake thats its some form of Linux though.

[Recursion]

So I take it that its nothing to do with the RAM then anyway if nothing came up on the short test?

Windows Server? Linux? (CentOS, etc etc) I'm assuming for arguments sake thats its some form of Linux though.

CentOS. I'd be much happier with Windows Server ;)

[scottish]

If they pay whatever stupid price cpanel is per year I'm sure they'll pay for windows server license lol.

Also


Tomorrow I will be working to restore our automated backups and provide SQL redundancy across a VPN to another server of ours.

I thought habbox only has one server now?

[Recursion]

If they pay whatever stupid price cpanel is per year I'm sure they'll pay for windows server license lol.

Also



I thought habbox only has one server now?
xxMATTGxx; kindly provides me with a VPS on his server, so not strictly Habbox's. We backup to this VPS and Jin's Amazon S3 bucket nightly.

[xxMATTGxx]

xxMATTGxx; kindly provides me with a VPS on his server, so not strictly Habbox's. We backup to this VPS and Jin's Amazon S3 bucket nightly.

High five!

[akeel$]

i voted potato
idk about this nowadays the forum is always down!