Ugh oh.. trouble

[Update: Trouble is gone – sorry for the downtime!]Looks like something went wrong. You may have trouble accessing your games. We are looking into it but might need a while to activate the right people on a Friday night. Really sorry for the interruption!


  1. vectorhive
    Posted January 11, 2008 at 18:11 | Permalink

    i’ll be patiently hitting command-R all day :)

    good luck fixing it!

  2. Lodi Yolo
    Posted January 11, 2008 at 18:18 | Permalink

    Seriously – how does your app go from working great to not working great so quickly? Is the app that brittle or are you guys deploying code before testing it? Simply a curiosity to me, since things were going so good for weeks now – what gives?

    Well, you *did* write this in Java, so I guess that is part of the problem.


  3. vectorhive
    Posted January 11, 2008 at 18:24 | Permalink

    I am no coding genius but i think this is a pretty big database recording a s&#t-ton of events. i was amazed at the size of the transfer Alex and Bert did in December when they migrated to the new servers. I’m guessing the errors of the complexities of dealing with such large amounts of data.

    I would be curious to hear more about what happened too.

  4. Posted January 11, 2008 at 18:32 | Permalink

    I’d just like these blog posts to have a time associated with them, too.

  5. Posted January 11, 2008 at 19:03 | Permalink

    It might be interesting, for those of us that are developers, to understand what happened – just for the sake of learning something and satisfying our curiosity!

  6. Pluto
    Posted January 11, 2008 at 19:18 | Permalink

    Cause and effect ??

    things were working fine – the tournament started – things are not working fine

  7. K8daGr8
    Posted January 11, 2008 at 19:26 | Permalink

    hmm… that is suspicious Plato… hopefully it was just bad luck though…

    BTW, is the post-down time effect kind of going to be like when you guys are updating and all clocks are reset?

  8. spadequack
    Posted January 11, 2008 at 20:32 | Permalink

    Good luck devs! Hope to see the game up and running again shortly.

    I place my bets on an overflow of some sort. Too much old data? Filled up log files?

  9. Tim
    Posted January 11, 2008 at 21:28 | Permalink

    Being that weewar runs on a distributed architecture, I bet there was some sort of concurrency problem between the servers.

  10. dbthaw
    Posted January 11, 2008 at 21:49 | Permalink

    Can we put some type of a “time-hold” on ongoing games so opponents can’t use the downtime as an advantage to remove us for going over the limit?

  11. Bert
    Posted January 11, 2008 at 22:02 | Permalink

    We’re on it and have figured out what it was that caused weewar to break. It’s got to do with the update process and the way things are deployed to the live system. Some premature lines of code have somehow found a way out of the testing sandbox.

  12. Alex
    Posted January 11, 2008 at 22:10 | Permalink

    Will be resetting the round times once we are back so to not affect tournament and other games negatively (or more negatively as this downtime already has).

    An ETA is difficult to give at this point but under the circumstance we have some hope to be back in about 30 minutes.

  13. Posted January 11, 2008 at 22:33 | Permalink

    Time’s up!  :-)

  14. luckymustard
    Posted January 11, 2008 at 22:44 | Permalink

    “Alex (weewar team) on 11 January, 2008 at 10:10 pm……….hope to be back in about 30 minutes.”

    ok futureman!  :) it’s currently 6:51pm, 11 Jan., 08, where i am – US east coast.  so that means it won’t be back until 10:40pm tonight your time, but how does that relate to my time?  ;)

  15. Alex
    Posted January 11, 2008 at 23:07 | Permalink

    ok.. we did not make the 30 minutes.. and it was not overly clever to not also post a time zone. But what I really meant is that we would be back just about now. Because we are ;)

    Really sorry for the downtime. We’ll do some further monitoring to make sure things stay. Btw it is 1.16 am (GMT+1) over here.

  16. Tim
    Posted January 12, 2008 at 00:08 | Permalink

    I don’t think the trouble is gone yet. The following happens when I try to click on a community game:

    An Error Occurred:

    /splitChat.xhtml: /join.xhtml @104,66 value=”#{startGameBean.chatId}”: Error reading ‘chatId’ on type com.weewar.web.jsfbeans.StartGameJSFBean

  17. vectorhive
    Posted January 12, 2008 at 01:49 | Permalink

    same result here.

  18. spadequack
    Posted January 12, 2008 at 02:49 | Permalink

    The three games that I think were started when there was that bug do not work and generate the error stated above. New games on the community page seem to work fine though.

  19. Alex
    Posted January 12, 2008 at 10:17 | Permalink

    Looks like spadequack’s assessment was correct. Those games had been started when the site was broken and were subsequently ill-formated. We have removed them now. The same might apply to invite only games you have started during the time. Let us know if it happened to one of your game and we’ll sort it out.

Post a Comment

Required fields are marked *


Get every new post delivered to your Inbox.

Join 78 other followers

%d bloggers like this: