What is meta? ×
Meta Stack Exchange is where users like you discuss bugs, features, and support issues that affect the software powering all 130 Stack Exchange communities.

Practically all SE sites I tried, except Meta, are failing to load for me, with the exception of MSO.

Additionally, all chats are offline and MSO's visit chat acknowledges this by not advertising any room.


Rebuild full-text catalog In progress ...

waffles

share|improve this question

closed as too localized by NullUserException อ_อ Oct 31 '12 at 2:55

This question is unlikely to help any future visitors; it is only relevant to a small geographic area, a specific moment in time, or an extraordinarily narrow situation that is not generally applicable to the worldwide audience of the internet. For help making this question more broadly applicable, visit the help center.If this question can be reworded to fit the rules in the help center, please edit the question.

    
Yeah, I also tried downforeveryoneorjustme ;) –  badp Oct 9 '10 at 10:19
1  
Area51 is up, though. –  Gelatin Oct 9 '10 at 10:23
22  
The hamsters powering the server farm finally gave up. –  Pëkka Oct 9 '10 at 10:32
    
The blog also appears down. Now where do we go and complain about the down time? –  Yi Jiang Oct 9 '10 at 10:33
    
Where's Jeff Atwood? –  Prasoon Saurav Oct 9 '10 at 10:41
1  
Additionally, shouldn't this be tagged [bug] ? ;) –  Yi Jiang Oct 9 '10 at 10:43
3  
҉ –  Nick Dandoulakis Oct 9 '10 at 10:44
2  
THE WEB SITE! IT DOES NOTHING! P.S. Thanks for posting so I didn't have to. –  Mark C Oct 9 '10 at 10:53
5  
Well, it DOES SOMETHING again for me. –  Arjan Oct 9 '10 at 10:56
1  
The Tavern is alive again –  Yi Jiang Oct 9 '10 at 11:00
    
Yippee! –  Mark C Oct 9 '10 at 11:00
9  
Nooo, my 30-day consecutive login silver badge is in the mercy of ISP power issues! –  Herman Oct 9 '10 at 11:29
1  
StackOverflow.com is still down for me. ServerFault.com won't log me in... and I can't vote on SuperUser. I think I'll go do some chores and come back later today ;-) –  The Unhandled Exception Oct 9 '10 at 13:36
    
how much time will take for repair? –  mahesh Oct 9 '10 at 14:49
    
@user152148 - I'm hoping they cover this for the users affected: meta.stackexchange.com/questions/67109/… –  Nick Craver Oct 9 '10 at 15:40

6 Answers 6

up vote 12 down vote accepted

The database is "suspect" we are running through our disaster recovery plans.

The power outage took the db into a suspect mode. After we recovered it the full text index was corrupt beyond recovery.

We rebuilt it from scratch and all should be good now.

We lost 4 hours of data, and are working on recovering it at the moment

share|improve this answer
2  
It's still acting up for me. I get the front page in high speed, but nothing beyond that. The requests all time out –  Pëkka Oct 9 '10 at 13:03
    
I'm getting 500's when editing as well here –  Nick Craver Oct 9 '10 at 13:05
5  
By the way, I would have found it much more fitting if Meta's database had been marked "Suspect". Because that one really is, even when it's not broken :) –  Pëkka Oct 9 '10 at 14:13
    
Has the team considered any kind of redundant power solution, so in case of a power failure, the system could at least shut down gracefully? –  Jon Seigel Oct 9 '10 at 14:55
    
Are there some data lost? I've lost 3 upvotes today. –  KennyTM Oct 9 '10 at 14:59
    
Actually, it's not that upvotes are lost, but questions are gone, e.g. stackoverflow.com/questions/3896462/… and stackoverflow.com/questions/3896071/… –  KennyTM Oct 9 '10 at 15:03
    
@KennyTM - See: meta.stackexchange.com/questions/67110/… –  Nick Craver Oct 9 '10 at 15:37

Hmmm, there's one good thing about this downtime. I never knew Chrome does this:

Other users are also experiencing difficulties connecting to this site, so you may have to wait a few minutes.

It actually doesn't show this on my Mac, but surely it tells Google which sites I visit? So, Google Chrome Is The New “Down For Everyone Or Just Me”. This indeed seems to be part of the privacy setting for "Suggestions for navigation errors":

In order to offer suggestions of alternative or similar webpages, the browser sends Google the URL of the page you're trying to reach whenever the web address does not resolve or a connection cannot be made. Information is logged and anonymized in the same manner as Google web searches. Any parameters in the URL are removed before the URL is sent. The logs are used to ensure and improve the quality of the feature.

share|improve this answer
    
It doesn't show it for me on Windows 7. It could be because I have phoning-home option disabled (see privacy options). –  Gelatin Oct 9 '10 at 10:29
    
This kind of thing is exactly why I stopped using Chrome. Who knows what else it's doing that I don't find out about? –  Pops Oct 9 '10 at 15:25

Update #4 (13:17 Zulu): There appear to be lingering issues with posting/editing at least, possibly other areas, site is offline again.

Update #3 (12:58 Zulu): Looks like SO is back online: http://stackoverflow.com/

Update #2 (10:54 Zulu): Getting the SO error page now, she breathes!

Update #1 (10:50 Zulu): Confirmed on twitter by @Geoff Dalgas:

StackOverflow is down - ISP power issues - we will be back up soon


Remember that meta was migrated to NYC recently, so it's still up, looks like everything in the old datacenter is offline at the moment, for whatever reason :)

  • stackoverflow.com - 69.59.196.211
  • serverfault.com - 69.59.196.211
  • superuser.com - 69.59.196.211

These (and most of the other sites) are all being routed through the HA Proxy in the old datacenter.

  • meta.stackoverflow.com - 64.34.119.12
  • area51.stackexchange.com - 64.34.119.12

These sites are in the NYC (new) datacenter, and still online.

share|improve this answer
2  
Looks like you have an extra Server Fault in there. –  Mark C Oct 9 '10 at 10:55
6  
Hah! What did I say. It was the hamsters. –  Pëkka Oct 9 '10 at 10:56
    
@Mark - woops, should have been SU, fixed :) –  Nick Craver Oct 9 '10 at 10:56
    
SF, SU are back .. only SO is down .. –  Gaby Oct 9 '10 at 12:04
    
SO is back too. :) –  Prasoon Saurav Oct 9 '10 at 13:03
1  
@Prasoon, and back down once more :( (i am getting withdrawal symptoms..) –  Gaby Oct 9 '10 at 13:29
    
And back again ;-) –  Prasoon Saurav Oct 9 '10 at 14:56

Now i get the

Stack Overflow is currently offline for maintenance alt text

while ServerFault and SuperUser are working fine now..

share|improve this answer
    
@OTZ, Oh, i know it is just an image to show the site is in maintenance.. i just posted it here to show that it had changed from the other error with the cat .. –  Gaby Oct 9 '10 at 12:13
    
What you think? How much time will take for repair? –  mahesh Oct 9 '10 at 14:47
    
@mahesh, i wouldn't know at the time ... but it is up and running now :) –  Gaby Oct 9 '10 at 15:15

Another good thing about the downtime. It prompted me to move my flair over to the new image based system. The old flair was causing all my pages that used it to redirect to the SO 404 page ;).

share|improve this answer

Not the answer you're looking for? Browse other questions tagged .