I know how to download the latest release of the Stack Exchange Creative Commons Data Dump, but I'm interested in downloading a past release and don't see those listed. Where can I find them?
3 Answers
All known releases of the Stack Exchange Network's Creative Commons Community Data Dump, containing all non-deleted posts from non-beta communities, with links to download using BitTorrent or from the Internet Archive. Some releases are no longer available.
The primary version of each release is a collection of XML files in compressed 7ZIP containers, representing the database schema described in this post. These are available in an unofficial Torrent RSS Feed. Some releases are also available as unofficial conversions to other formats.
Torrents and Internet Archive items that were created by the company are indicated with the 🏢 emoji, while those created by community members are indicated with the 👥 emoji.
Release | Size | Type | Torrent File | Magnet Link | Internet Archive |
---|---|---|---|---|---|
September 2024 366 files | 90 GiB | XML | 745b43ba 👥 | 745b43ba 👥 | Archived 👥 |
June 2024 366 files | 78 GiB | XML | 530a2ef6 👥 | 530a2ef6 👥 | Archived 👥 |
…initial buggy release 364 files | 90 GiB | XML | 5afacf7e 👥 | 5afacf7e 👥 | Archived 👥 |
…as JSON 370 files | 72 GiB | JSON | d3caab0e 👥 | d3caab0e 👥 | Archived 👥 |
…as SQLite database 365 files | 82 GiB | SQLite | e97c4bf9 👥 | e97c4bf9 👥 | Archived 👥 |
April 2024 383 files | 92 GiB | XML | 2ef5246c 🏢 | 2ef5246c 🏢 | Archived 👥 |
…as JSON 372 files | 71 GiB | JSON | 8e412899 👥 | 8e412899 👥 | Archived 👥 |
…as SQLite database 366 files | 81 GiB | SQLite | a9396346 👥 | a9396346 👥 | Archived 👥 |
…as SQLite (no FKs) 365 files | 76 GiB | SQLite | b86780fe 👥 | b86780fe 👥 | Archived 👥 |
…as Postgres database 5096 files | 66 GiB | pg_dump | 3e618152 👥 | 3e618152 👥 | Archived 👥 |
…initial buggy release 383 files | 103 GiB | XML | ab12faae 🏢 | ab12faae 🏢 | Archived 👥 |
March 2024 383 files | 85 GiB | XML | 5a3d9b0c 🏢 | 5a3d9b0c 🏢 | Archived 👥 |
December 2023 383 files | 84 GiB | XML | 414f55d7 🏢 | 414f55d7 🏢 | Archived 👥 |
September 2023 383 files | 83 GiB | XML | d884b3a9 🏢 | d884b3a9 🏢 | Archived 👥 |
June 2023 379 files | 82 GiB | XML | 93d9b232 🏢 | 93d9b232 🏢 | Archived 👥 |
March 2023 379 files | 81 GiB | XML | 263d19f9 🏢 | 263d19f9 🏢 | Archived 👥 |
December 2022 379 files | 72 GiB | XML | 1c65c4a7 🏢 | 1c65c4a7 🏢 | Archived 👥 |
October 2022 379 files | 80 GiB | XML | b369adf8 🏢 | b369adf8 🏢 | Archived 👥 |
June 2022 377 files | 79 GiB | XML | 8225cdd0 🏢 | 8225cdd0 🏢 | Archived 👥 |
March 2022 368 files | 77 GiB | XML | 5854d890 🏢 | 5854d890 🏢 | Archived 👥 |
December 2021 363 files | 75 GiB | XML | 677a281a 🏢 | 677a281a 🏢 | Archived 👥 |
September 2021 363 files | 75 GiB | XML | 27689c6b 🏢 | 27689c6b 🏢 | Archived 👥 |
June 2021 364 files | 73 GiB | XML | ee64468a 🏢 | ee64468a 🏢 | Archived 👥 |
March 2021 362 files | 71 GiB | XML | 03ae768e 🏢 | 03ae768e 🏢 | Archived 👥 |
December 2020 361 files | 70 GiB | XML | 3fa542ce 🏢 | 3fa542ce 🏢 | Archived 👥 |
September 2020 362 files | 68 GiB | XML | a321f0df 🏢 | a321f0df 🏢 | Archived 👥 |
June 2020 362 files | 66 GiB | XML | daceb39f 🏢 | daceb39f 🏢 | Archived 👥 |
March 2020 358 files | 64 GiB | XML | a6266395 🏢 | a6266395 🏢 | Archived 👥 |
December 2019 358 files | 62 GiB | XML | fd11cc26 🏢 | fd11cc26 🏢 | Archived 👥 |
September 2019 358 files | 61 GiB | XML | 8cec36af 🏢 | Archived 👥 | |
June 2019 358 files | 59 GiB | XML | 576097b0 🏢 | 576097b0 🏢 | Archived 👥 |
March 2019 358 files | 57 GiB | XML | f8b00f75 🏢 | f8b00f75 🏢 | Archived 👥 |
December 2018 362 files | 55 GiB | XML | d1623b9e 🏢 | d1623b9e 🏢 | Archived 👥 |
September 2018 | XML | bddb28e2 🏢 | |||
June 2018 | XML | 8e6a46cc 🏢 | |||
March 2018 358 files | 50 GiB | XML | 4ad8edb2 🏢 | 4ad8edb2 🏢 | Archived 👥 |
December 2017 352 files | 48 GiB | XML | e73b7025 🏢 | e73b7025 🏢 | Archived 👥 |
June 2017 340 files | 45 GiB | XML | fa38c0e9 🏢 | fa38c0e9 🏢 | |
March 2017 338 files | 42 GiB | XML | 586eebe6 🏢 | 586eebe6 🏢 | |
December 2016 334 files | 40 GiB | XML | fd86cb81 🏢 | fd86cb81 🏢 | |
September 2016 330 files | 37 GiB | XML | be15f508 🏢 | be15f508 🏢 | |
June 2016 324 files | 36 GiB | XML | e1a5e02e 🏢 | e1a5e02e 🏢 | |
March 2016 314 files | 33 GiB | XML | 57ceb5ac 🏢 | 57ceb5ac 🏢 | |
March 2015 281 files | 25 GiB | XML | 0ea39049 🏢 | 0ea39049 🏢 | Archived 👥 |
September 2014 264 files | 22 GiB | XML | b1a458cb 🏢 | b1a458cb 🏢 | |
May 2014 250 files | 20 GiB | XML | 3aed037c 🏢 | 3aed037c 🏢 | |
January 2014 231 files | 18 GiB | XML | cc28f62b 🏢 | cc28f62b 🏢 | |
September 2013 96 files | 15 GiB | XML | c472a68f 🏢 | c472a68f 🏢 | |
June 2013 92 files | 13 GiB | XML | 5ede0d56 🏢 | 5ede0d56 🏢 | Archived 👥 |
March 2013 91 files | 12 GiB | XML | 47e02c81 🏢 | 47e02c81 🏢 | Archived 👥 |
August 2012 - 1/2 50 files | 7707 MiB | XML | ecf5ec6d 🏢 | ecf5ec6d 🏢 | |
August 2012 - 2/2 37 files | 44 MiB | XML | b06fff72 🏢 | b06fff72 🏢 | Archived 👥 |
May 2012 76 files | 6369 MiB | XML | c0ecc66e 🏢 | c0ecc66e 🏢 | Archived 👥 |
December 2011 - 1/3 45 files | 4997 MiB | XML | 77ccfd34 🏢 | 77ccfd34 🏢 | Archived 👥 |
December 2011 - 2/3 3 files | 156 MiB | XML | ccb07610 🏢 | ccb07610 🏢 | |
December 2011 - 3/3 25 files | 284 MiB | XML | de13c16e 🏢 | de13c16e 🏢 | Archived 👥 |
September 2011 66 files | 4413 MiB | XML | 64d052f7 🏢 | 64d052f7 🏢 | Archived 👥 |
June 2011 55 files | 3666 MiB | XML | cdb37ea2 🏢 | cdb37ea2 🏢 | Archived 👥 |
April 2011 57 files | 3987 MiB | XML | ec636f7e 🏢 | ec636f7e 🏢 | Archived 👥 |
January 2011 42 files | 3209 MiB | XML | 16e7c286 🏢 | 16e7c286 🏢 | Archived 👥 |
November 2010 18 files | 2076 MiB | XML | f26b0ae2 🏢 | f26b0ae2 🏢 | Archived 👥 |
October 2010 4 files | 1020 MiB | XML | b549412a 🏢 | b549412a 🏢 | Archived 👥 |
September 2010 4 files | 1027 MiB | XML | 8f5c7a0b 🏢 | 8f5c7a0b 🏢 | Archived 👥 |
August 2010 4 files | 887 MiB | XML | 53c3bf7f 🏢 | 53c3bf7f 🏢 | Archived 👥 |
July 2010 4 files | 824 MiB | XML | fe29a5a7 🏢 | fe29a5a7 🏢 | Archived 👥 |
June 2010 4 files | 764 MiB | XML | 2c802d00 🏢 | 2c802d00 🏢 | Archived 👥 |
May 2010 4 files | 710 MiB | XML | f318086e 🏢 | f318086e 🏢 | Archived 👥 |
April 2010 4 files | 658 MiB | XML | 53adea3f 🏢 | 53adea3f 🏢 | Archived 👥 |
March 2010 4 files | 599 MiB | XML | a790a8ab 🏢 | a790a8ab 🏢 | Archived 👥 |
February 2010 4 files | 546 MiB | XML | cec670fa 🏢 | cec670fa 🏢 | Archived 👥 |
January 2010 4 files | 500 MiB | XML | 5127f67f 🏢 | 5127f67f 🏢 | Archived 👥 |
December 2009 4 files | 454 MiB | XML | 11a2a48f 🏢 | 11a2a48f 🏢 | Archived 👥 |
November 2009 4 files | 407 MiB | XML | 107f674c 🏢 | 107f674c 🏢 | Archived 👥 |
October 2009 4 files | 337 MiB | XML | 61b882a5 🏢 | 61b882a5 🏢 | Archived 👥 |
September 2009 4 files | 302 MiB | XML | 395bb1a8 🏢 | 395bb1a8 🏢 | Archived 👥 |
August 2009 1 file | 267 MiB | XML | d348861b 🏢 | d348861b 🏢 | Archived 👥 |
…reupload 4 files | 267 MiB | XML | f6ec47fb 🏢 | f6ec47fb 🏢 | Archived 👥 |
July 2009 1 file | 230 MiB | XML | 2dca38c1 🏢 | 2dca38c1 🏢 | Archived 👥 |
June 2009 1 file | 206 MiB | XML | 68d22f0f 🏢 | 68d22f0f 🏢 | Archived 👥 |
May 2009 1 file | 200 MiB | XML | ea45080e 🏢 | ea45080e 🏢 | Archived 👥 |
Special Releases
Release | Size | Type | Torrent File | Magnet Link | Internet Archive |
---|---|---|---|---|---|
Closed Sites 46 files | 97 MiB | XML | 3983ede3 👥 | 3983ede3 👥 | Archived 👥 |
Documentation 3 files | 35 MiB | JSON | 7b4762eb 🏢 | 7b4762eb 🏢 | Archived 🏢 |
Teams 3 files | 122 KiB | JSON | 6e8f46d3 🏢 | 6e8f46d3 🏢 | Archived 🏢 |
Uploaded Images 65 files | 800 GiB | images | Archived 👥 |
-
4Shameless plug: if anybody is curious, I have recently written a Stack Overflow answer explaining how BitTorrent magnet links work.– JeremyCommented Mar 11, 2014 at 15:26
-
1I need a StackOverflow Data Dump in which MD5 e-mail checksum are visible. Can you confirm that a kind of this is still availble? Thanks :)– gios91Commented Mar 30, 2015 at 9:18
-
4@gios91 Unfortunately for that use case, the email hashes haven't been included since either the January 2014 or March 2013 dump (I'm not sure which). As this change was made to increase privacy, it's unlikely to ever be changed back. If you have an academic use intended for it, and affiliations with an academic institution, I think Stack Exchange might provide more complete dumps under an NDA, but I don't remember where I read that, so I can't confirm right now.– JeremyCommented Apr 1, 2015 at 15:52
-
1It looks like there Internet Archive's public log files include the infohashes of all generated torrents. You can see one here. So that should allow this list to be maintained even if some updates are missed at the time.– Jeremy StaffCommented Feb 1, 2017 at 17:01
-
1"The contents may or may not be available." -> Hosting all Stack Exchange data dumps on archive.org Commented Jan 27, 2018 at 23:45
-
1
-
-
1@rene That's my question: "what are we missing?" We don't know until someone tests. A more recent update is at meta.stackexchange.com/a/342634/248268– NemoCommented Mar 29, 2020 at 8:20
-
1What happened in-between the October 2022 and December 2022 data dumps? That was a huge slump totaling almost 8 GiB of data! Was there a mass deletion of content or a huge improvement in the 7z compression algorithm during that time?– GaoCommented Aug 6 at 12:50
-
@Gao IIRC, the December 2022 dump had an export error. I don't remember the details from that discussion. Probably missing a few parts Commented Aug 6 at 13:30
-
@gao IIRC the Stack Overflow PostHistory table is incomplete in that release, and there were some other inconsistencies that indicate something went wrong, but I’m not sure of the full details.– JeremyCommented Aug 6 at 13:43
-
Will this answer continue to be updated in the new world of data dumps? Commented Sep 16 at 1:26
-
-
@Zoe-Savethedatadump thanks, I didn't realise the June dump came under the new regime, since the announcement was in July. Commented Sep 16 at 3:00
-
@DavidRoberts I know it's hard to read because we're trying to cram a lot of details into a small table. I tried to indicate that with the "👥" emoji beside the latest releases, indicating that they're aggregated by community members, while the torrents from the previous releases from the company are marked with "🏢" instead.– JeremyCommented Sep 16 at 14:35
The older dumps from 2009 to 2011 are available here:
-
5
-
20
Here are the data after December 2017
-
4