Meta Stack Exchange is where users like you discuss bugs, features, and support issues that affect the software powering all 155 Stack Exchange communities.

What is meta?
Here's how it works:
  1. Any Stack Exchange user can ask a question
  2. The community provides support, votes on ideas, and reports bugs
  3. Your voice helps shape the way Stack Exchange operates

I want to use the Stack Overflow database for a data classification project. How do I dump the Stack Overflow database?

share|improve this question

migrated from stackoverflow.com Oct 20 '09 at 7:05

This question came from our site for professional and enthusiast programmers.

You can download the data dump (produced monthly) at: http://blog.stackoverflow.com/category/cc-wiki-dump/

You will need a 7zip decompressor, XML parsing code, and probably a database to load the data into.

You may also be interested in http://data.stackexchange.com/ which has already done all this for you.

share|improve this answer
    
There is an RSS feed here: feed://www.clearbits.net/feeds/creator/146-stack-overflow-data-dump.rss – Ameer Deen Jun 14 '11 at 5:12
    
Stackql.net is no longer available. Do you know another site that provides this functionality? – Marcel Korpel Nov 15 '12 at 16:26
2  
@Marcel: SE now runs a regularly-updated interactive query thingamajig here: data.stackexchange.com – Shog9 Dec 30 '12 at 3:38
    
@Shog9 thanks! the thingamajig is awesome! Is the (code.google.com/p/stack-exchange-data-explorer) also up-to-date? maybe we should link to that as well. – d-_-b Dec 30 '12 at 4:56

I just made a slow Python script to import the dump to a SQLite3 database.

It's designed to run on my RAMless netbook, so it doesn't make a single COMMIT for all INSERTs, but rather COMMITs every INSERT. I'll make a fast RAM sucker version tomorrow.

share|improve this answer

If you are using MySQL I have a schema and a script written in ruby that will load the data. Just grab the latest data dump, create a database, load this schema, modify this loader script to point to your database and then run the script. It only takes a few minutes to load all the data.

share|improve this answer
    
Your script and schema worked like a charm. – Snehal Nov 5 '12 at 2:27
    
Cannot access the database files anymore. Anyone know what's wrong? There are backups? Wanna map full site to search offline :) – erm3nda Aug 5 '15 at 12:18

Just tell her you think you should see other people, but that you still want to be friends. (Don't actually call, though)

share|improve this answer
8  
It's MySQL Server isn't it? You've been seeing that hussy haven't you? – random Oct 20 '09 at 8:36
6  
Actually, I would call. Her number is 646-826-3879 and try and be sensitive. – Tom Ritter Oct 20 '09 at 11:52
3  
Have you discussed who will get Access? – Danyal Aytekin Oct 11 '10 at 12:16

You must log in to answer this question.