Conquer Club

Server Downtime and Data Loss

Archival storage for Announcements. Peruse old Announcements here!

Moderator: Community Team

Forum rules
Please read the Community Guidelines before posting.

Re: Server Downtime and Data Loss

Postby denominator on Fri Oct 04, 2013 10:57 am

blakebowling wrote:
Butcher89 wrote:Why the role back?

Why not just pick up where you left off at?!!

This "roll back" (which is BS), might cause a winning game to turn into a losing game.

Terrible management and structure by the Conquer Club Staff.

I'm not sure you understand the situation.

Due to a data loss in one of our core system tables, games were unable to be played. The only way to restore functionality was to restore the database from a backup.

"Picking up where we left off at" wasn't an option.

I do apologize for the inconvenience this issue has caused and we are taking steps to increase the frequency of backups, which will help to minimize the lapse in a restoration should a similar event occur in the future.


Do you have any idea what caused the data loss? Is it something that is likely (or even possible) to happen again in the next 24 hours?

Otherwise, I think the rest of us should count ourselves lucky that we only lost 24 hours of data. It could have been much, much worse on a site that sees this much traffic on an hourly/daily basis. Thanks to the admin team for being so transparent about it, and fixing it promptly.
Image
User avatar
Sergeant 1st Class denominator
 
Posts: 1796
Joined: Thu May 24, 2007 9:41 am
Location: Fort St John

Re: Server Downtime and Data Loss

Postby Vondue on Fri Oct 04, 2013 11:04 am

Well done guys.

As an IT Disaster Recovery operation specialist, I completely understand the how and why this could happen, and I'm glad that you have backup procedures for recovery. I'd love to hear the technical details, and would like to offer my advice (if any) on infrastructure or process improvements.

Based purely on this thread, it sounds like a corruption of the database (I presume a logical corruption would be fixable with an application patch) that made the db unreadable or inconsistent, and that the last consistent image was from the previous backup. In addition to increasing the frequency of the backup (hot-backup mode?), a journalling transaction log could improve the fidelity. That all depends on how quickly the corruption was identified.

Good Luck!
Sergeant 1st Class Vondue
 
Posts: 3
Joined: Wed Mar 02, 2011 5:14 am

Re: Server Downtime and Data Loss

Postby Wolfreal on Fri Oct 04, 2013 11:06 am

Good work people. That kind of stuff is inevitable.
Corporal 1st Class Wolfreal
 
Posts: 73
Joined: Mon Jul 16, 2012 12:31 pm

Re: Server Downtime and Data Loss

Postby Griffelinos on Fri Oct 04, 2013 11:10 am

I paid premium yesterday and got it, but today my premium is gone. I have the Receipt from paypal, but who should i contact for activating the account again.
Corporal 1st Class Griffelinos
 
Posts: 3
Joined: Thu Jan 24, 2013 10:34 am

Re: Server Downtime and Data Loss

Postby Gamefreakguy on Fri Oct 04, 2013 11:11 am

This has been the weirdest feeling of deja vu coming back to yesterday's turns... and a sad deja vu when yesterday's captured bonuses were not able to be taken this time around. Ah well. No hard feelings of course.
"Never let your fear decide your fate."
"He who controls others may be powerful but he who has mastered himself is mightier still." Lao Tzu
User avatar
Major Gamefreakguy
 
Posts: 419
Joined: Sat Aug 25, 2007 5:11 pm

Re: Server Downtime and Data Loss

Postby osman76 on Fri Oct 04, 2013 11:12 am

I was playing a tournament game that was a 99% loss. Now with dice help i managed to make it a 90% win. My opponent is complaining and says that it would be fair to let him win. I am a player with 80+ active games so some games i was winning yesterday now they didn't even started!
Which option is fairest?
1. Win the game
2. Lose the game
3. Request from TO to replay the game

I think option 3 is the the golden section, but i need some opinions, especially from administrators.
User avatar
Major osman76
 
Posts: 738
Joined: Wed Feb 09, 2011 2:34 pm
233

Re: Server Downtime and Data Loss

Postby pinkrose2012 on Fri Oct 04, 2013 11:15 am

I'm just thankful for all you that work hard to insure the site is up and running. No matter the changes that may have occurred during the fix, it could always be worse. And at least conquer club isn't gone for good. :D

Cheers,
Pinky
User avatar
Sergeant 1st Class pinkrose2012
 
Posts: 26
Joined: Wed Aug 29, 2012 2:33 pm
2

Re: Server Downtime and Data Loss

Postby laughingcavalier on Fri Oct 04, 2013 11:15 am

osman76 wrote:I was playing a tournament game that was a 99% loss. Now with dice help i managed to make it a 90% win. My opponent is complaining and says that it would be fair to let him win. I am a player with 80+ active games so some games i was winning yesterday now they didn't even started!
Which option is fairest?
1. Win the game
2. Lose the game
3. Request from TO to replay the game

I think option 3 is the the golden section, but i need some opinions, especially from administrators.

Play the game as it is now. You win some, you lose some. I am sure this little episode will help us all appreciate random a bit more.
Image
Major laughingcavalier
 
Posts: 1112
Joined: Mon Mar 12, 2007 4:31 pm

Re: Server Downtime and Data Loss

Postby joriki on Fri Oct 04, 2013 11:16 am

Gee, cool -- I got to nuke a stack of 9, and now I get to do it again :-)

Thanks for the hard work!
General joriki
 
Posts: 198
Joined: Fri Jul 11, 2008 2:07 pm

Re: Server Downtime and Data Loss

Postby scotthansen1 on Fri Oct 04, 2013 11:19 am

I would say if you were at a 99% ( by your own admission ) loss then you should lose the game
Captain scotthansen1
 
Posts: 12
Joined: Sat Oct 29, 2011 2:43 pm
Location: virginia beach, va

Re: Server Downtime and Data Loss

Postby scotthansen1 on Fri Oct 04, 2013 11:22 am

well I hope I have the same rolls as I had before , cause I had just turned the tide
Captain scotthansen1
 
Posts: 12
Joined: Sat Oct 29, 2011 2:43 pm
Location: virginia beach, va

Re: Server Downtime and Data Loss

Postby Paul Tabinor on Fri Oct 04, 2013 11:24 am

Thanks to all you guys at CC for keeping this going.
Just had to win an 8 player escalating all over again. Luckily remembered how I did it yesterday. :D
User avatar
Major Paul Tabinor
 
Posts: 72
Joined: Sat May 23, 2009 10:42 am
Location: North Staffordshire, England.

Re: Server Downtime and Data Loss

Postby AquilesGT on Fri Oct 04, 2013 11:29 am

Well, this is a major issue, but not a frequent one, I am glad you are back online and working, I think you guys do a great job and I have enjoyed this site very much for some years by now. By the consistent and smooth way your business is running, I guess this is an experience and I guess we all have things to learn and to deal with that allow us to grow.

I am saying this, since I have read some complains, and I am sure that some guys fought a lot to win games that they have to fight again. I share their concern and understand their feelings about having to do all over again, and that they have a right to get the best possible service. So I am with you guys that sometimes, the best possible service now is the response you do to assure people you are doing something to improve whatever happen. I believe you're doing it, and it would be good for all of us that you share it.
User avatar
Sergeant 1st Class AquilesGT
 
Posts: 4
Joined: Thu May 27, 2010 8:51 pm
Location: Guatemala City

Re: Server Downtime and Data Loss

Postby jesuso 1 on Fri Oct 04, 2013 11:31 am

Hi
I think the administration have to take a decision fair for everyone, for example I win game 13028870 and now I return to the past
Cheers
Major jesuso 1
 
Posts: 8
Joined: Sun Jan 10, 2010 5:16 pm

Re: Server Downtime and Data Loss

Postby _sabotage_ on Fri Oct 04, 2013 11:34 am

two sure wins: one restarted, one sent back to round four.
User avatar
Captain _sabotage_
 
Posts: 1250
Joined: Wed Aug 24, 2011 10:21 am

Re: Server Downtime and Data Loss

Postby waltero on Fri Oct 04, 2013 11:34 am

Please see here regarding the recent database issue and its impact on your games.

OK?

Oh well, I tried. You suck!
Later...NOT
User avatar
Cook waltero
 
Posts: 211
Joined: Wed Jul 04, 2012 11:54 pm

Re: Server Downtime and Data Loss

Postby cooney on Fri Oct 04, 2013 11:46 am

We all suffer issues on occasion. Good job getting it back up as soon as you did.
You guys work hard to keep this a good site. Rough day I know ..... Well done.
User avatar
Major cooney
 
Posts: 12
Joined: Tue Jun 05, 2007 7:41 pm
Location: Florida Gulf Coast

Re: Server Downtime and Data Loss

Postby Griffelinos on Fri Oct 04, 2013 11:50 am

bigWham wrote:In the late evening of Oct 3 (CC Time) one of our core system data tables suffered data loss and could not be recovered.

Unfortunately all data from the period between the backup and the event has been lost, including moves made, games started, chat, private messages and forum posts.

Sincerely,
A weary Admin crew.


Yes its ok, but people who paid premium membership in the last 24 hours also lost that ??
Could you please tell me who i should contact to get the premium membership back..

/Lasse
Corporal 1st Class Griffelinos
 
Posts: 3
Joined: Thu Jan 24, 2013 10:34 am

Re: Server Downtime and Data Loss

Postby spiesr on Fri Oct 04, 2013 11:52 am

Griffelinos wrote:Yes its ok, but people who paid premium membership in the last 24 hours also lost that ??
Could you please tell me who i should contact to get the premium membership back..

/Lasse
I recommend that you Open a Support Ticket.
User avatar
Captain spiesr
 
Posts: 2809
Joined: Mon May 08, 2006 10:52 am
Location: South Dakota

Re: Server Downtime and Data Loss

Postby Griffelinos on Fri Oct 04, 2013 11:53 am

Ok thanks i will try that..
Corporal 1st Class Griffelinos
 
Posts: 3
Joined: Thu Jan 24, 2013 10:34 am

Re: Server Downtime and Data Loss

Postby waltero on Fri Oct 04, 2013 11:55 am

Delete.
Why it goes to last page when I enter I will never know...Does not do that all the time (if ever)
Last edited by waltero on Fri Oct 04, 2013 11:58 am, edited 1 time in total.
User avatar
Cook waltero
 
Posts: 211
Joined: Wed Jul 04, 2012 11:54 pm

Re: Server Downtime and Data Loss

Postby michiganmike on Fri Oct 04, 2013 11:57 am

Yeah that really messed
my game and I needed that win....
Cook michiganmike
 
Posts: 1
Joined: Sat Jan 28, 2012 10:22 pm

Re: Server Downtime and Data Loss

Postby Agent 86 on Fri Oct 04, 2013 12:00 pm

Griffelinos wrote:
bigWham wrote:In the late evening of Oct 3 (CC Time) one of our core system data tables suffered data loss and could not be recovered.

Unfortunately all data from the period between the backup and the event has been lost, including moves made, games started, chat, private messages and forum posts.

Sincerely,
A weary Admin crew.


Yes its ok, but people who paid premium membership in the last 24 hours also lost that ??
Could you please tell me who i should contact to get the premium membership back..

/Lasse


Premium restored, the team is working really hard ;)
Image
We are the Fallen, an unstoppable wave of Darkness.
User avatar
Major Agent 86
 
Posts: 1193
Joined: Mon Dec 29, 2008 6:15 pm
Location: Cone of silence

Re: Server Downtime and Data Loss

Postby bigWham on Fri Oct 04, 2013 12:03 pm

Griffelinos wrote:
bigWham wrote:In the late evening of Oct 3 (CC Time) one of our core system data tables suffered data loss and could not be recovered.

Unfortunately all data from the period between the backup and the event has been lost, including moves made, games started, chat, private messages and forum posts.

Sincerely,
A weary Admin crew.


Yes its ok, but people who paid premium membership in the last 24 hours also lost that ??
Could you please tell me who i should contact to get the premium membership back..

/Lasse


Apologies Griffelinos, We did handle this but missed a few. They have now been fixed.
User avatar
Colonel bigWham
Webmaster
Webmaster
 
Posts: 2867
Joined: Mon Aug 26, 2013 12:08 pm

Re: Server Downtime and Data Loss

Postby SlavaBogu on Fri Oct 04, 2013 12:10 pm

i won like 5 games and suddenly they got reloaded
Sergeant 1st Class SlavaBogu
 
Posts: 1
Joined: Thu Apr 12, 2012 5:45 pm

PreviousNext

Return to Announcement Archives

Who is online

Users browsing this forum: No registered users