Practically all SE sites I tried, except Meta, are failing to load for me, with the exception of MSO.
Additionally, all chats are offline and MSO's visit chat acknowledges this by not advertising any room.
Rebuild full-text catalog In progress ...
6 Answers
The database is "suspect" we are running through our disaster recovery plans.
The power outage took the db into a suspect mode. After we recovered it the full text index was corrupt beyond recovery.
We rebuilt it from scratch and all should be good now.
We lost 4 hours of data, and are working on recovering it at the moment
-
2It's still acting up for me. I get the front page in high speed, but nothing beyond that. The requests all time out– PekkaOct 9, 2010 at 13:03
-
-
5By the way, I would have found it much more fitting if Meta's database had been marked "Suspect". Because that one really is, even when it's not broken :)– PekkaOct 9, 2010 at 14:13
-
Has the team considered any kind of redundant power solution, so in case of a power failure, the system could at least shut down gracefully? Oct 9, 2010 at 14:55
-
-
Actually, it's not that upvotes are lost, but questions are gone, e.g. stackoverflow.com/questions/3896462/… and stackoverflow.com/questions/3896071/…– kennytmOct 9, 2010 at 15:03
-
Update #4 (13:17 Zulu): There appear to be lingering issues with posting/editing at least, possibly other areas, site is offline again.
Update #3 (12:58 Zulu): Looks like SO is back online: https://stackoverflow.com/
Update #2 (10:54 Zulu): Getting the SO error page now, she breathes!
Update #1 (10:50 Zulu): Confirmed on twitter by @Geoff Dalgas:
StackOverflow is down - ISP power issues - we will be back up soon
Remember that meta was migrated to NYC recently, so it's still up, looks like everything in the old datacenter is offline at the moment, for whatever reason :)
- stackoverflow.com - 69.59.196.211
- serverfault.com - 69.59.196.211
- superuser.com - 69.59.196.211
These (and most of the other sites) are all being routed through the HA Proxy in the old datacenter.
- meta.stackoverflow.com - 64.34.119.12
- area51.stackexchange.com - 64.34.119.12
These sites are in the NYC (new) datacenter, and still online.
answered Oct 9, 2010 at 10:48
-
2
-
6
Hmmm, there's one good thing about this downtime. I never knew Chrome does this:
Other users are also experiencing difficulties connecting to this site, so you may have to wait a few minutes.
It actually doesn't show this on my Mac, but surely it tells Google which sites I visit? So, Google Chrome Is The New “Down For Everyone Or Just Me”. This indeed seems to be part of the privacy setting for "Suggestions for navigation errors":
In order to offer suggestions of alternative or similar webpages, the browser sends Google the URL of the page you're trying to reach whenever the web address does not resolve or a connection cannot be made. Information is logged and anonymized in the same manner as Google web searches. Any parameters in the URL are removed before the URL is sent. The logs are used to ensure and improve the quality of the feature.
Another good thing about the downtime. It prompted me to move my flair over to the new image based system. The old flair was causing all my pages that used it to redirect to the SO 404 page ;).
answered Oct 9, 2010 at 11:48
Now i get the
Stack Overflow is currently offline for maintenance
while ServerFault and SuperUser are working fine now..
[bug]? ;)