What is meta? ×
Meta Stack Exchange is where users like you discuss bugs, features, and support issues that affect the software powering all 150 Stack Exchange communities.

I want to use the Stack Overflow database for a data classification project. How do I dump the Stack Overflow database?

share|improve this question

migrated from stackoverflow.com Oct 20 '09 at 7:05

This question came from our site for professional and enthusiast programmers.

4 Answers 4

You can download the data dump (produced monthly) at: http://blog.stackoverflow.com/category/cc-wiki-dump/

You will need a 7zip decompressor, XML parsing code, and probably a database to load the data into.

You may also be interested in http://data.stackexchange.com/ which has already done all this for you.

share|improve this answer
There is an RSS feed here: feed://www.clearbits.net/feeds/creator/146-stack-overflow-data-dump.rss – Ameer Deen Jun 14 '11 at 5:12
Stackql.net is no longer available. Do you know another site that provides this functionality? – Marcel Korpel Nov 15 '12 at 16:26
@Marcel: SE now runs a regularly-updated interactive query thingamajig here: data.stackexchange.com – Shog9 Dec 30 '12 at 3:38
@Shog9 thanks! the thingamajig is awesome! Is the (code.google.com/p/stack-exchange-data-explorer) also up-to-date? maybe we should link to that as well. – d-_-b Dec 30 '12 at 4:56

Just tell her you think you should see other people, but that you still want to be friends. (Don't actually call, though)

share|improve this answer
It's MySQL Server isn't it? You've been seeing that hussy haven't you? – random Oct 20 '09 at 8:36
Actually, I would call. Her number is 646-826-3879 and try and be sensitive. – Tom Ritter Oct 20 '09 at 11:52
Have you discussed who will get Access? – Danyal Aytekin Oct 11 '10 at 12:16

If you are using MySQL I have a schema and a script written in ruby that will load the data. Just grab the latest data dump, create a database, load this schema, modify this loader script to point to your database and then run the script. It only takes a few minutes to load all the data.

share|improve this answer
Your script and schema worked like a charm. – Snehal Nov 5 '12 at 2:27
Cannot access the database files anymore. Anyone know what's wrong? There are backups? Wanna map full site to search offline :) – erm3nda Aug 5 at 12:18

I just made a slow Python script to import the dump to a SQLite3 database.

It's designed to run on my RAMless netbook, so it doesn't make a single COMMIT for all INSERTs, but rather COMMITs every INSERT. I'll make a fast RAM sucker version tomorrow.

share|improve this answer

You must log in to answer this question.