Meta Stack Exchange is where users like you discuss bugs, features, and support issues that affect the software powering all 158 Stack Exchange communities.

What is meta?
Here's how it works:
  1. Any Stack Exchange user can ask a question
  2. The community provides support, votes on ideas, and reports bugs
  3. Your voice helps shape the way Stack Exchange operates

Due to a (meanwhile fixed) bug concerning the January 2011 data-dump, I've recently asked Why is the data-dump generation not (more or less) fully automated?. The question has been closed as a duplicate by Geoff, since his very welcome answer explaining the cause of the bug implied, that there is indeed an automation process in place already.

However, Geoff didn't answer my (implied) sub question, why generating the dumps apparently still amounts to quite a bit of work regardless, resulting in the unfortunate shift to a bi-monthly dump schedule.

Could you please elaborate on that? Maybe this work could be delegated to the community in case?

I realize, that providing a data-dump monthly had been an arbitrary choice - still a monthly dump cycle is a pretty obvious choice regarding common use cases as well (think e.g. archiving, data analysis etc.) and I'd therefore very much prefer, if it could stay that way. Thanks!

share|improve this question

Why is the data-dump still 'quite a bit of work', despite being (more or less) fully automated?

For one it requires a 3.5 gig upload, which takes forever and sometimes fails. The increased size means the export is slower.

Overall it when doing a data-dump you are stuck context switching multiple times a day, a 1 minute interruption 5-6 times in a day can pretty much kill hours of productivity. is updated monthly, in general people still have access to the same level of data they used to.

share|improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .