89

I know how to download the latest release of the Stack Exchange Creative Commons Data Dump, but I'm interested in downloading a past release and don't see those listed. Where can I find them?

0

3 Answers 3

115
+500

All known releases of the Stack Exchange Network's Creative Commons Community Data Dump, containing all non-deleted posts from non-beta communities, with links to download using BitTorrent or from the Internet Archive. Some releases are no longer available.

The primary version of each release is a collection of XML files in compressed 7ZIP containers, representing the database schema described in this post. These are available in an unofficial Torrent RSS Feed. Some releases are also available as unofficial conversions to other formats.

Torrents and Internet Archive items that were created by the company are indicated with the 🏢 emoji, while those created by community members are indicated with the 👥 emoji.

Release Size Type Torrent File Magnet Link Internet Archive
September 2024 366 files 90 GiB XML 745b43ba 👥 745b43ba 👥 Archived 👥
June 2024 366 files 78 GiB XML 530a2ef6 👥 530a2ef6 👥 Archived 👥
…initial buggy release 364 files 90 GiB XML 5afacf7e 👥 5afacf7e 👥 Archived 👥
…as JSON 370 files 72 GiB JSON d3caab0e 👥 d3caab0e 👥 Archived 👥
…as SQLite database 365 files 82 GiB SQLite e97c4bf9 👥 e97c4bf9 👥 Archived 👥
April 2024 383 files 92 GiB XML 2ef5246c 🏢 2ef5246c 🏢 Archived 👥
…as JSON 372 files 71 GiB JSON 8e412899 👥 8e412899 👥 Archived 👥
…as SQLite database 366 files 81 GiB SQLite a9396346 👥 a9396346 👥 Archived 👥
…as SQLite (no FKs) 365 files 76 GiB SQLite b86780fe 👥 b86780fe 👥 Archived 👥
…as Postgres database 5096 files 66 GiB pg_dump 3e618152 👥 3e618152 👥 Archived 👥
…initial buggy release 383 files 103 GiB XML ab12faae 🏢 ab12faae 🏢 Archived 👥
March 2024 383 files 85 GiB XML 5a3d9b0c 🏢 5a3d9b0c 🏢 Archived 👥
December 2023 383 files 84 GiB XML 414f55d7 🏢 414f55d7 🏢 Archived 👥
September 2023 383 files 83 GiB XML d884b3a9 🏢 d884b3a9 🏢 Archived 👥
June 2023 379 files 82 GiB XML 93d9b232 🏢 93d9b232 🏢 Archived 👥
March 2023 379 files 81 GiB XML 263d19f9 🏢 263d19f9 🏢 Archived 👥
December 2022 379 files 72 GiB XML 1c65c4a7 🏢 1c65c4a7 🏢 Archived 👥
October 2022 379 files 80 GiB XML b369adf8 🏢 b369adf8 🏢 Archived 👥
June 2022 377 files 79 GiB XML 8225cdd0 🏢 8225cdd0 🏢 Archived 👥
March 2022 368 files 77 GiB XML 5854d890 🏢 5854d890 🏢 Archived 👥
December 2021 363 files 75 GiB XML 677a281a 🏢 677a281a 🏢 Archived 👥
September 2021 363 files 75 GiB XML 27689c6b 🏢 27689c6b 🏢 Archived 👥
June 2021 364 files 73 GiB XML ee64468a 🏢 ee64468a 🏢 Archived 👥
March 2021 362 files 71 GiB XML 03ae768e 🏢 03ae768e 🏢 Archived 👥
December 2020 361 files 70 GiB XML 3fa542ce 🏢 3fa542ce 🏢 Archived 👥
September 2020 362 files 68 GiB XML a321f0df 🏢 a321f0df 🏢 Archived 👥
June 2020 362 files 66 GiB XML daceb39f 🏢 daceb39f 🏢 Archived 👥
March 2020 358 files 64 GiB XML a6266395 🏢 a6266395 🏢 Archived 👥
December 2019 358 files 62 GiB XML fd11cc26 🏢 fd11cc26 🏢 Archived 👥
September 2019 358 files 61 GiB XML 8cec36af 🏢 Archived 👥
June 2019 358 files 59 GiB XML 576097b0 🏢 576097b0 🏢 Archived 👥
March 2019 358 files 57 GiB XML f8b00f75 🏢 f8b00f75 🏢 Archived 👥
December 2018 362 files 55 GiB XML d1623b9e 🏢 d1623b9e 🏢 Archived 👥
September 2018 XML bddb28e2 🏢
June 2018 XML 8e6a46cc 🏢
March 2018 358 files 50 GiB XML 4ad8edb2 🏢 4ad8edb2 🏢 Archived 👥
December 2017 352 files 48 GiB XML e73b7025 🏢 e73b7025 🏢 Archived 👥
June 2017 340 files 45 GiB XML fa38c0e9 🏢 fa38c0e9 🏢
March 2017 338 files 42 GiB XML 586eebe6 🏢 586eebe6 🏢
December 2016 334 files 40 GiB XML fd86cb81 🏢 fd86cb81 🏢
September 2016 330 files 37 GiB XML be15f508 🏢 be15f508 🏢
June 2016 324 files 36 GiB XML e1a5e02e 🏢 e1a5e02e 🏢
March 2016 314 files 33 GiB XML 57ceb5ac 🏢 57ceb5ac 🏢
March 2015 281 files 25 GiB XML 0ea39049 🏢 0ea39049 🏢 Archived 👥
September 2014 264 files 22 GiB XML b1a458cb 🏢 b1a458cb 🏢
May 2014 250 files 20 GiB XML 3aed037c 🏢 3aed037c 🏢
January 2014 231 files 18 GiB XML cc28f62b 🏢 cc28f62b 🏢
September 2013 96 files 15 GiB XML c472a68f 🏢 c472a68f 🏢
June 2013 92 files 13 GiB XML 5ede0d56 🏢 5ede0d56 🏢 Archived 👥
March 2013 91 files 12 GiB XML 47e02c81 🏢 47e02c81 🏢 Archived 👥
August 2012 - 1/2 50 files 7707 MiB XML ecf5ec6d 🏢 ecf5ec6d 🏢
August 2012 - 2/2 37 files 44 MiB XML b06fff72 🏢 b06fff72 🏢 Archived 👥
May 2012 76 files 6369 MiB XML c0ecc66e 🏢 c0ecc66e 🏢 Archived 👥
December 2011 - 1/3 45 files 4997 MiB XML 77ccfd34 🏢 77ccfd34 🏢 Archived 👥
December 2011 - 2/3 3 files 156 MiB XML ccb07610 🏢 ccb07610 🏢
December 2011 - 3/3 25 files 284 MiB XML de13c16e 🏢 de13c16e 🏢 Archived 👥
September 2011 66 files 4413 MiB XML 64d052f7 🏢 64d052f7 🏢 Archived 👥
June 2011 55 files 3666 MiB XML cdb37ea2 🏢 cdb37ea2 🏢 Archived 👥
April 2011 57 files 3987 MiB XML ec636f7e 🏢 ec636f7e 🏢 Archived 👥
January 2011 42 files 3209 MiB XML 16e7c286 🏢 16e7c286 🏢 Archived 👥
November 2010 18 files 2076 MiB XML f26b0ae2 🏢 f26b0ae2 🏢 Archived 👥
October 2010 4 files 1020 MiB XML b549412a 🏢 b549412a 🏢 Archived 👥
September 2010 4 files 1027 MiB XML 8f5c7a0b 🏢 8f5c7a0b 🏢 Archived 👥
August 2010 4 files 887 MiB XML 53c3bf7f 🏢 53c3bf7f 🏢 Archived 👥
July 2010 4 files 824 MiB XML fe29a5a7 🏢 fe29a5a7 🏢 Archived 👥
June 2010 4 files 764 MiB XML 2c802d00 🏢 2c802d00 🏢 Archived 👥
May 2010 4 files 710 MiB XML f318086e 🏢 f318086e 🏢 Archived 👥
April 2010 4 files 658 MiB XML 53adea3f 🏢 53adea3f 🏢 Archived 👥
March 2010 4 files 599 MiB XML a790a8ab 🏢 a790a8ab 🏢 Archived 👥
February 2010 4 files 546 MiB XML cec670fa 🏢 cec670fa 🏢 Archived 👥
January 2010 4 files 500 MiB XML 5127f67f 🏢 5127f67f 🏢 Archived 👥
December 2009 4 files 454 MiB XML 11a2a48f 🏢 11a2a48f 🏢 Archived 👥
November 2009 4 files 407 MiB XML 107f674c 🏢 107f674c 🏢 Archived 👥
October 2009 4 files 337 MiB XML 61b882a5 🏢 61b882a5 🏢 Archived 👥
September 2009 4 files 302 MiB XML 395bb1a8 🏢 395bb1a8 🏢 Archived 👥
August 2009 1 file 267 MiB XML d348861b 🏢 d348861b 🏢 Archived 👥
…reupload 4 files 267 MiB XML f6ec47fb 🏢 f6ec47fb 🏢 Archived 👥
July 2009 1 file 230 MiB XML 2dca38c1 🏢 2dca38c1 🏢 Archived 👥
June 2009 1 file 206 MiB XML 68d22f0f 🏢 68d22f0f 🏢 Archived 👥
May 2009 1 file 200 MiB XML ea45080e 🏢 ea45080e 🏢 Archived 👥

Special Releases

Release Size Type Torrent File Magnet Link Internet Archive
Closed Sites 46 files 97 MiB XML 3983ede3 👥 3983ede3 👥 Archived 👥
Documentation 3 files 35 MiB JSON 7b4762eb 🏢 7b4762eb 🏢 Archived 🏢
Teams 3 files 122 KiB JSON 6e8f46d3 🏢 6e8f46d3 🏢 Archived 🏢
Uploaded Images 65 files 800 GiB images Archived 👥
17
  • 4
    Shameless plug: if anybody is curious, I have recently written a Stack Overflow answer explaining how BitTorrent magnet links work.
    – Jeremy
    Commented Mar 11, 2014 at 15:26
  • 1
    I need a StackOverflow Data Dump in which MD5 e-mail checksum are visible. Can you confirm that a kind of this is still availble? Thanks :)
    – gios91
    Commented Mar 30, 2015 at 9:18
  • 4
    @gios91 Unfortunately for that use case, the email hashes haven't been included since either the January 2014 or March 2013 dump (I'm not sure which). As this change was made to increase privacy, it's unlikely to ever be changed back. If you have an academic use intended for it, and affiliations with an academic institution, I think Stack Exchange might provide more complete dumps under an NDA, but I don't remember where I read that, so I can't confirm right now.
    – Jeremy
    Commented Apr 1, 2015 at 15:52
  • 1
    It looks like there Internet Archive's public log files include the infohashes of all generated torrents. You can see one here. So that should allow this list to be maintained even if some updates are missed at the time.
    – Jeremy Staff
    Commented Feb 1, 2017 at 17:01
  • 1
    "The contents may or may not be available." -> Hosting all Stack Exchange data dumps on archive.org Commented Jan 27, 2018 at 23:45
  • 1
    Do we know if the new dump is complete?
    – Nemo
    Commented Jan 18, 2020 at 13:14
  • @Nemo please define "complete"? What are you missing?
    – rene Mod
    Commented Mar 28, 2020 at 9:22
  • 1
    @rene That's my question: "what are we missing?" We don't know until someone tests. A more recent update is at meta.stackexchange.com/a/342634/248268
    – Nemo
    Commented Mar 29, 2020 at 8:20
  • 1
    What happened in-between the October 2022 and December 2022 data dumps? That was a huge slump totaling almost 8 GiB of data! Was there a mass deletion of content or a huge improvement in the 7z compression algorithm during that time?
    – Gao
    Commented Aug 6 at 12:50
  • @Gao IIRC, the December 2022 dump had an export error. I don't remember the details from that discussion. Probably missing a few parts Commented Aug 6 at 13:30
  • @gao IIRC the Stack Overflow PostHistory table is incomplete in that release, and there were some other inconsistencies that indicate something went wrong, but I’m not sure of the full details.
    – Jeremy
    Commented Aug 6 at 13:43
  • Will this answer continue to be updated in the new world of data dumps? Commented Sep 16 at 1:26
  • @DavidRoberts Yes Commented Sep 16 at 2:24
  • @Zoe-Savethedatadump thanks, I didn't realise the June dump came under the new regime, since the announcement was in July. Commented Sep 16 at 3:00
  • @DavidRoberts I know it's hard to read because we're trying to cram a lot of details into a small table. I tried to indicate that with the "👥" emoji beside the latest releases, indicating that they're aggregated by community members, while the torrents from the previous releases from the company are marked with "🏢" instead.
    – Jeremy
    Commented Sep 16 at 14:35
30

The older dumps from 2009 to 2011 are available here:

https://tejp.de/files/so/dbdump (mirror)

2
  • 5
    Just curious - who is hosting these? Commented Mar 1, 2018 at 9:02
  • 20
    @JourneymanGeek: I am :)
    – sth
    Commented Mar 1, 2018 at 13:24
4

Here are the data after December 2017

https://empirical-software.engineering/sotorrent/

1
  • 4
    This only contains StackOverflow data.
    – a3nm
    Commented Apr 10, 2021 at 19:48

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .