16

I want to use the Stack Overflow database for a data classification project. How do I dump the Stack Overflow database?

migrated from stackoverflow.com Oct 20 '09 at 7:05

This question came from our site for professional and enthusiast programmers.

22

You can download the data dump (produced monthly) at: http://blog.stackoverflow.com/category/cc-wiki-dump/

You will need a 7zip decompressor, XML parsing code, and probably a database to load the data into.

You may also be interested in http://data.stackexchange.com/ which has already done all this for you.

  • There is an RSS feed here: feed://www.clearbits.net/feeds/creator/146-stack-overflow-data-dump.rss – Ameer Deen Jun 14 '11 at 5:12
  • Stackql.net is no longer available. Do you know another site that provides this functionality? – Marcel Korpel Nov 15 '12 at 16:26
  • 2
    @Marcel: SE now runs a regularly-updated interactive query thingamajig here: data.stackexchange.com – Shog9 Dec 30 '12 at 3:38
  • @Shog9 thanks! the thingamajig is awesome! Is the (code.google.com/p/stack-exchange-data-explorer) also up-to-date? maybe we should link to that as well. – d-_-b Dec 30 '12 at 4:56
20

Just tell her you think you should see other people, but that you still want to be friends. (Don't actually call, though)

  • 8
    It's MySQL Server isn't it? You've been seeing that hussy haven't you? – random Oct 20 '09 at 8:36
  • 6
    Actually, I would call. Her number is 646-826-3879 and try and be sensitive. – Tom Ritter Oct 20 '09 at 11:52
  • 3
    Have you discussed who will get Access? – Danyal Aytekin Oct 11 '10 at 12:16
3

If you are using MySQL I have a schema and a script written in ruby that will load the data. Just grab the latest data dump, create a database, load this schema, modify this loader script to point to your database and then run the script. It only takes a few minutes to load all the data.

  • Your script and schema worked like a charm. – Snehal Nov 5 '12 at 2:27
  • Cannot access the database files anymore. Anyone know what's wrong? There are backups? Wanna map full site to search offline :) – erm3nda Aug 5 '15 at 12:18
0

I just made a slow Python script to import the dump to a SQLite3 database.

It's designed to run on my RAMless netbook, so it doesn't make a single COMMIT for all INSERTs, but rather COMMITs every INSERT. I'll make a fast RAM sucker version tomorrow.

You must log in to answer this question.