FerrariChat.com Outage Information... | FerrariChat

FerrariChat.com Outage Information...

Discussion in 'Ferrari Discussion (not model specific)' started by rob lay, Dec 13, 2004.

This site may earn a commission from merchant affiliate links, including eBay, Amazon, Skimlinks, and others.

  1. rob lay

    rob lay Administrator
    Staff Member Admin Miami 2018 Owner Social Subscribed

    Dec 1, 2000
    64,108
    Southlake, TX
    Full Name:
    Rob Lay
    FerrariChat.com had a hard drive failure on our main application server about 5pm CST Sunday, December 12th. The board was completely down until 7:30pm CST Monday, December 13th.

    Right now the majority of functionality has returned and all posts are available. The following is still not available and it's possible it may take quite a bit more time...

    1) All past images, although you may post new images.
    2) Old FerrariChat.com Archives. Some links may work, but Search is down.
    3) Banner ads.
    4) Custom pages, like View All Sponsors and many links under Resources.

    The hard drive failed, which happens about once a year and usually a quick install of a new drive and upload from backup will have site up in a few hours. However, the backup file has become so large that it was corrupted and the host has been working non-stop since 5pm yesterday to restore the file. If they can't recover 100% of the file, then it's possible we'll try to recover the actual hard drive.

    The reason posts and user accounts have been restored is those are stored on our 2nd database server which experienced no problems. The reason the software is back up is because I installed it again from scratch.

    So we're missing a little, but for the most part all functionality has returned.

    I apologize for the outage and when the site is 100% recovered we'll do a complete analysis and make changes so this doesn't happen again.

    Thank you for being patient,
    rob
     
  2. Ricambi America

    Ricambi America F1 World Champ
    Sponsor Owner

    Shame on the host. System redundancy, fail-over, backup verification, and rotating tapes are basic 101 principals of IT.

    No knock on Rob of course... if anything, he should be applauded for keeping us informed with the little "white page" throughout the day. ROB: thanks for getting us our "fix" before anyone did anything foolish !!!


    -Daniel
     
  3. Miltonian

    Miltonian F1 Veteran

    Dec 11, 2002
    5,966
    Milton, Wash.
    Full Name:
    Jeff B.
    Thank YOU, Rob!
     
  4. GoodWood

    GoodWood Formula Junior

    Oct 2, 2004
    351
    SE Florida/Indiana
    Full Name:
    Steve
    Need my daily fix of Fchat, you know ;)
     
  5. matteo

    matteo F1 World Champ

    Aug 1, 2002
    13,748
    On a plane somewhere
    Full Name:
    Heir Butt
    Thanks Rob
     
  6. Buttuz4eva

    Buttuz4eva F1 Rookie
    BANNED

    Dec 14, 2003
    2,717
    LONG ISLAND N.Y.
    Full Name:
    Challenge Farrelle
    no old pics ?

    carbon is going to be bummed
     
  7. DrStranglove

    DrStranglove FChat Assassin
    Owner Rossa Subscribed

    Oct 31, 2003
    31,589
    Google Maps
    Full Name:
    DrS
    Has NNO had a heart attack?
     
  8. Dave328

    Dave328 Formula 3

    Nov 24, 2002
    2,133
    Katy
    Full Name:
    Dave
    OH MY GOD!!!!!!!!!!!!!!!
    The Bikini thread!!!!!!!!!!!!!!!!!!!!!!!!
    ;)
    Dave
     
  9. rob lay

    rob lay Administrator
    Staff Member Admin Miami 2018 Owner Social Subscribed

    Dec 1, 2000
    64,108
    Southlake, TX
    Full Name:
    Rob Lay
    #9 rob lay, Dec 13, 2004
    Last edited by a moderator: Sep 7, 2017
  10. LSU348

    LSU348 Formula 3

    Dec 19, 2003
    1,047
    Sugar Land
    Full Name:
    Mike
    PLEASE set yourself up on a RAID 5 system...do it for the bikinis man!!!!

     
  11. rob lay

    rob lay Administrator
    Staff Member Admin Miami 2018 Owner Social Subscribed

    Dec 1, 2000
    64,108
    Southlake, TX
    Full Name:
    Rob Lay
    BTW, my email is still down, but you can reach me by PM. Thanks.

    I have not received any emails from 11am yesterday (Sunday) and don't know if I will, probably not.
     
  12. rob lay

    rob lay Administrator
    Staff Member Admin Miami 2018 Owner Social Subscribed

    Dec 1, 2000
    64,108
    Southlake, TX
    Full Name:
    Rob Lay
    Oh yea, forgot, FC will be running a few times slower than usual because of work being done to fix and load the backup.
     
  13. coolestkidever

    coolestkidever F1 Veteran

    Feb 28, 2004
    5,538
    NJ
    Full Name:
    Patrick
    i saw the tubi ad and some pics were back in the bikini thread just now
     
  14. boxerman

    boxerman F1 World Champ
    Silver Subscribed

    May 27, 2004
    19,857
    FL
    Full Name:
    Sean
    welcome back, was suffering dt's.wife was happy though.
     
  15. kdross

    kdross Formula Junior
    Silver Subscribed

    Feb 10, 2002
    887
    NJ
    Full Name:
    Ken
    Rob:

    What doesn't the Ferrarichat server have mirrored hard drives? When one drive crashes, the other keeps going without the server going down. You then replace the damaged drive and keep going without any down time. Seems to be a cheap and simple soultion. Just my two cents.

    Ken
     
  16. rob lay

    rob lay Administrator
    Staff Member Admin Miami 2018 Owner Social Subscribed

    Dec 1, 2000
    64,108
    Southlake, TX
    Full Name:
    Rob Lay
    Sounds good to me. I'm upgrading servers anyway this winter.

    I thought the offsite backups were enough protection, but who would have guessed the backup was corrupt. I guess they should have known that with how large the file was getting. They messed up and know it, so they've been very very helpful and nice. We'll see how fast it takes to return 100%.
     
  17. maranelloman

    maranelloman Guest

    Thanks for what must have been a superhuman effort, Rob.
     
  18. Texas Forever

    Texas Forever Eight Time F1 World Champ
    BANNED Rossa Subscribed

    Apr 28, 2003
    85,600
    Texas!
    As a non-geek who hates computers, I have often wondered about this myself. Seeing how cheap hard drives are, why fool with all these werid backup systems? Why not just run dual, triple, or quad hard drives?

    But everytime I bring this up to the geeks, I just get a bunch of "Geeze, what a dumbass" look.

    Dale
     
  19. thecarreaper

    thecarreaper F1 World Champ
    Silver Subscribed

    Sep 30, 2003
    18,094
    Savannah
    thank you ROB for the info and all your hard work.
     
  20. JSMDMD

    JSMDMD Formula Junior

    Nov 27, 2003
    309
    I need to sit down....
    I am agreeing with something Maranelloman said! ;)
    Seriously, it's good to see that you are back up.
     
  21. Brian C. Stradale

    Brian C. Stradale F1 Rookie
    Lifetime Rossa

    Mar 17, 2002
    3,615
    Dallas, TX, USA
    Either they are pulling your chain, Dale, or they are lame geeks.

    There's a widely used protocol for running mirrored disks... called RAID... any true computer geek is fully aware of it... I would definitely have anything with critical, active data on a RAID system... disk fails, you don't even have to pause the machine... just pull the drive and put in a new one.

    Further, you can implement RAID using multiple disks to either OR both increase speed OR increase reliability.
     
  22. 2000YELLOW360

    2000YELLOW360 F1 World Champ

    Jun 5, 2001
    19,800
    Full Name:
    Art
    Rob:

    Good to see that you're back up. Must have been a great effort.
    Somehow I seemed to have gotten a lot done today, don't know why though.

    Art
     
  23. Texas Forever

    Texas Forever Eight Time F1 World Champ
    BANNED Rossa Subscribed

    Apr 28, 2003
    85,600
    Texas!
    Makes perfect sense to me, but what do I know?

    Dr "Clueless" Who
     
  24. PaulfromPA

    PaulfromPA Karting

    Mar 3, 2004
    166
    Lancaster, PA
    Full Name:
    Paul Grabowski
    Thanks for getting everything back in a timely fashion rob:).

    Just one idea... can pm's be set-up to automatically forward to an email address, as I communicate with some friends on here largely through pm?

    Fchat is back!!
     
  25. 134282

    134282 Four Time F1 World Champ
    BANNED

    Aug 3, 2002
    40,647
    California
    Full Name:
    Carbon McCoy
    Hey, Rob, FYI, the chatroom is down, too...
     

Share This Page