Meta Stack Exchange is where users like you discuss bugs, features, and support issues that affect the software powering all 158 Stack Exchange communities.

What is meta?
Here's how it works:
  1. Any Stack Exchange user can ask a question
  2. The community provides support, votes on ideas, and reports bugs
  3. Your voice helps shape the way Stack Exchange operates

It's currently been about 3 weeks since the last data migration to data.stackexchange.

The help page says that data is updated weekly. Why hasn't that been happening?

Surely this should be an automated process, run by crontab?!

share|improve this question
It's supposed to be updated weekly, but this hasn't been happening since Data Explorer moved, so this is a bug. – Tim Stone Aug 6 '13 at 14:00
bug as well as Feature-request :) – Azik Aug 6 '13 at 14:00
It's not updated automatically, dev has to do it manually. I saw Nick saying this somewhere. – Shadow Wizard Aug 6 '13 at 14:02
@azi - A bug request! – Lix Aug 6 '13 at 14:02
@ShaWizDowArd The process is automated now, after Nick cleaned it up some months ago. – Tim Stone Aug 6 '13 at 14:05
@Tim so it got broken in the latest codebase update. Great, now we have to wait another 10 months for the next codebase update. :( – Shadow Wizard Aug 6 '13 at 14:08
@ShaWizDowArd I assume it's not working because of the move from Oregon to NY, but I don't know if the automatic process being disabled is temporarily intentional or not. – Tim Stone Aug 6 '13 at 14:12
Server moves are fun! :D ... :p – Danny Beckett Aug 6 '13 at 14:22
@Tim oh well, we'll know is 6 to 8 weeks. :) – Shadow Wizard Aug 6 '13 at 17:49
It looks like someone kicked off the job, so the data is currently backfilling (only a few sites left to update) – Tim Stone Aug 6 '13 at 18:12
@Bohemian Surely this should be a manual process so the cron won't fall offline!? – djechlin Aug 6 '13 at 18:21
up vote 5 down vote accepted

Oops, yeah this was busted on 2 levels. The part where the job crashed and burned annnnnnd the part that emails me telling me that, double fail.

It's working now, should be about 2 hour for SO to finish a refresh. After that finishes, it will run weekly on Sundays.

share|improve this answer
Awesome! So does this fix the performance problems I mentioned here? – Mysticial Aug 6 '13 at 18:17
Send email: Job crashed; Send email: Email failed; Send email: Email failed; Send email: Email failed – animuson Aug 6 '13 at 18:19
I've been there myself... :/ – Bohemian Aug 6 '13 at 22:01
@Nick Craver Any updates on this? The data explorer is still pretty unusable. Every single non-trivial query times out and has been doing so since it moved back to New York. – Mysticial Aug 18 '13 at 17:49
@Mysticial we simply don't have good hardware in NY for this, it's on it's own server out in Oregon, we'll get it back out there soon as we can. – Nick Craver Aug 18 '13 at 18:01
@NickCraver Ah. Thanks for the info. No rush though, since I was just looking for some closure on this. – Mysticial Aug 18 '13 at 18:03
Are the edits that vanished in the move lost forever? – Gilles Aug 18 '13 at 18:13

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .