What is meta? ×
Meta Stack Exchange is where users like you discuss bugs, features, and support issues that affect the software powering all 133 Stack Exchange communities.

I see a lot of talk around here regarding the Stack Overflow public data dump.

Where is it? How can I play with it?

Return to FAQ index

share|improve this question
    
easily search able here on MSO. This question has been asked repeatedly. –  Stu Thompson Sep 2 '09 at 8:30
1  
    
@Stu, could you provide links? –  Pops Sep 6 '10 at 2:58
1  
@Popular Demand: Via above link, via blog.stackoverflow.com/category/cc-wiki-dump and via media10.simplex.tv/content/xtendx/stu/stackoverflow –  Stu Thompson Sep 7 '10 at 9:20
    
@Stu, none of those are links to Meta questions. Your initial comment said "easily searchable here on MSO." –  Pops Sep 7 '10 at 12:51
    
@Popular Demain: "Let me MSO Search that for you": meta.stackoverflow.com/search?q=public+data+dump Many of which lead to the two links I posted above. Sorry for trying to help. (Very entertaining that this Question is the first to show up.) –  Stu Thompson Sep 8 '10 at 5:45
2  
@Stu, yes, but there are no dupes. All that info is buried. I still think this question is important. –  Pops Sep 8 '10 at 6:14

5 Answers 5

It's actually at ClearBits:

http://www.clearbits.net/creators/146-stack-overflow-data-dump

The announcement was made in this post of Stack Overflow's blog:

Creative Commons Data Dump Aug 10

Please note that the Stack Overflow trilogy data dumps are now hosted at ClearBits! (prevously legaltorrents.com) You can subscribe via RSS and be notified every time a new dump is available.

To play with the data dump, go to Stack Exchange Data Explorer.

share|improve this answer
1  
Sadly, ClearBits seems to be going away permanently. –  Pops Jan 16 at 16:52

The actual data dump:

  1. The BitTorrent URLs are announced on the Stack Overflow blog. The latest at the time of writing is http://www.legaltorrents.com/get/1042-mar-10.torrent.

  2. Versions that can be downloaded using plain HTTP transfers can be found at (but has not been updated for some time): http://media10.simplex.tv/content/xtendx/stu/stackoverflow

share|improve this answer
    
I update it every now and then. Sorry for slacking. –  Stu Thompson Sep 7 '10 at 9:20
    
@Stu Thompson: no problem. I very much appreciate the resource and your efforts. –  Peter Mortensen Sep 7 '10 at 17:56
    
Thanks. I actually get emails every now and then to that effect from the archive. Appreciation is motivating. –  Stu Thompson Sep 8 '10 at 18:29
    
@Stu Thompson: I tried to download the latest, media10.simplex.tv/content/xtendx/stu/trilogy-export-2010-08.7z, and I got a 404. I also get a 404 for the other 14. –  Peter Mortensen Sep 12 '10 at 0:18
1  
Thanks for the heads up. That's what happens when I hand edit HTML, it seams <:O Fixed. –  Stu Thompson Sep 12 '10 at 6:15

As described in the Stack Overflow Blog the most recent Stack Overflow data dump is located on this page (toward the middle, in the form Creative Commons Data Dump MON YEAR

All four..... trilogy sites are in the datadump: Stack Overflow, Server Fault, Super User, and Meta Stack Overflow.

To play with a data dump by running TSQL queries on it, head on over to the Stack Exchange Data Explorer.

There seems to be somewhat of a lag in when the Data Explorer receives the newest dump and when the newest dump becomes available.

share|improve this answer
1  
The "MON DAY" format is actually "MON YEAR" where the year is 2 digits. This has been bugging me, too, because at first I thought it was the day as well. –  Jon Seigel Sep 7 '10 at 17:15
    
@Jon - Thanks. That makes a lot more sense ;) –  Peter Ajtai Sep 7 '10 at 18:08
    
    
It will be moving to Amazon. –  Peter Mortensen Jan 14 '13 at 17:47

I've also got a publicly accessible SQL Server with the data dumps for Server Fault, Stack Overflow, Super User, and Meta Stack Overflow. The connection information is here:

http://www.brentozar.com/archive/2010/02/querying-the-stackoverflow-data-dump/

share|improve this answer

Forage through the tag [data-dump] and read up a plenty while you sit back, relax and engorge yourself with cherry ripes and data dumps.

Related: Better know a schema.

And might be good to check out the blog at least once a month. Especially when they squeeze out a good sized dump of the data.

share|improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .