72

The original ClearBits link to the September 2011 data dump has broken. How can I access it and other previous data dumps? The Internet Archive only has the latest one.

Improve this question
0

3 Answers 3

Reset to default
82

Here are the torrents for each data dump release. The contents may or may not be available.

Stack Exchange Network Data Dumps

Release          BitTorrent Infohash and Magnet Link
2009 May         ea45080eab61ab465f647e6366f775bf25f69a61  in Internet Archive

2009 June        68d22f0f856ca5056e009ac53597a66c0cb03068  in Internet Archive
2009 July        2dca38c1c9724462ad4cedb42a1569805ab80f0c  in Internet Archive
2009 August      d348861b6d72c280f299e03fe9f9e8f3258eff19  in Internet Archive
2009 …rerelease  f6ec47fba06823e22ede500511ab7c60ceddd91d  in Internet Archive
2009 September   395bb1a89607fa05a9774bd7683eb3b6052989f7  in Internet Archive
2009 October     61b882a518f21344ca82d4632f89a1dcafcbd3ed  in Internet Archive
2009 November    107f674c9b6a481eef7c81910228bc773246035b  in Internet Archive
2009 December    11a2a48f204497f4222ff5edaf790f1d38a651fe  in Internet Archive
2010 January     5127f67fb6099d322b6467bd85a1363fe8a73c3f  in Internet Archive
2010 February    cec670fa3c54bf8403bef2d0801a6f9478fb2c68  in Internet Archive
2010 March       a790a8ab30f91c344c5b400579acd5643b2bb25c  in Internet Archive
2010 April       53adea3f9acb1972201f059604c4bdad5e3e0a8c  in Internet Archive
2010 May         f318086e65e7873d1a44de07e6d3ef4de0da0004  in Internet Archive
2010 June        2c802d003e59f84776a40b361584e1125d4eb877  in Internet Archive
2010 July        fe29a5a7278960002cae679024f0175db3e470f1  in Internet Archive
2010 August      53c3bf7f3b2ba1675acf3ac21bbaf84c63ca94c7  in Internet Archive
2010 September   8f5c7a0bac4f5ee27b7cd7a1c179ba0ba66eb847  in Internet Archive
2010 October     b549412a5e8aa70421756f0348f8063638994114  in Internet Archive
2010 November    f26b0ae2b975254676a02bdfb0fd4b7f6f78b951  in Internet Archive
2011 January     16e7c2867f7b5be3d7dbe7c3f707601b16c5f2c5  in Internet Archive
2011 April       ec636f7edc262053429653edfdf47e806f14e72f  in Internet Archive
2011 June        cdb37ea243e09fcaf54e6b7f19764765a706724c  in Internet Archive
2011 September   64d052f755e01d1c947848ad3d22180476a71a94  in Internet Archive
2011 December    77ccfd3451c442590bf5bd940362a121a16ee5a3
2011 …part 2     ccb07610f73f994b15399acdd507778dce964111
2011 …part 3     de13c16eb98bc8e95a77ed7e0ff6953d60bf90ba
2012 April       c0ecc66e8f1d630cbcd39bf523b3381a7779daa3
2012 August      ecf5ec6d0a2a3a5b582b1ef684a5fe4552ff1c8b
2012 …part 2     b06fff722ce06520b59a9db72cab9f7d008ff8c3
2013 March       47e02c81368acd9fa0f884439c00fa8439ef971f
2013 September   c472a68f39cd333816098e53ae353e8d90c3e9d3
2014 January     cc28f62bb9eb1da79ca2a782960f86f64d8ceb87
2014 May         3aed037c4c0a73d2f3eb244b99c1cd842bc88142
2014 September   b1a458cba5af9525d4012c20f9c51b35a15f0984
2015 March       0ea39049afdbaaea255ca1d0af662e2a0d503098
2016 March       57ceb5ac3e22cbf4e4de8b94f9814e809f0765bb
2016 June        e1a5e02efb60d9514c8822b1f9d3e605436caac9
2016 September   be15f50878cb77028b119a9f922f02e439481030
2016 December    fd86cb81c9ab08bd3a0969d4c700555ec7814328
2017 March       586eebe6f3c19db48a5ea471579b96d3bd3ba6e3
2017 June        fa38c0e9bbbb060927a7a7ca1f9325aa98466e1f
2017 December    e73b7025a2af72124ae49d184fa3e8cec3f66016
2018 March       4ad8edb2e0781d381d110778036703da988de71a  in Internet Archive
2018 June        8e6a46cc6290ee3dc93cec299b6e28b7ee2f3228
2018 September   bddb28e2bc5fecdc2acf83c76e7941797fc98b2e
2018 December    d1623b9edd9ee6787fdb614299d14baa94e24d80
2019 March       f8b00f75393b2fca5e8796e48cfe89c2f0536fa2
2019 June        593cf931e968c608f953b3b62d513d2365d68aa2
2019 September   8cec36af3037f78e793057eeb38b684048d043de
2019 December    fd11cc265a7964b42ac80f21c216420372c9cada
2020 March       a6266395a2bb85fecde76ee8324bc05827554e81
2020 June        daceb39faefc3f797005488f56e3b01c57c5af91
2020 September   a321f0dfa7d037db155590fa89ff118271d07a85
2020 December    3fa542ce4c9322df301e2c89a1d9c2bc87541015
2021 March       03ae768efe49a064e3b7fe5bb554203258383689  in Internet Archive
2021 June        ee64468a824040067d468d57f51e63ae9cf1aaa6  in Internet Archive
2021 September   27689c6b23a5b606987114abc3e9ba2668f93755  in Internet Archive
2021 December    677a281a1b9bcbc4684f1f5659db0e6de0f1488e  in Internet Archive
2022 March       5854d890b3c845b75b1c67e96eecbdc38d6db883  in Internet Archive
2022 June        8225cdd03712ddf0c3f0261bf982fc21d7647221  in Internet Archive
2022 October     1c65c4a7ccfdd77bc542d7220a28b99893c6fa3d  in Internet Archive
2022 December    b369adf8a6da002537e8b0c49e187448e0138281  in Internet Archive
2023 March       263d19f9188a146b150648cd1975820f3ebbd38e  in Internet Archive
2023 June        93d9b232af49082b59693e6e07f6d05ea8e99ec8  in Internet Archive
2023 September   d884b3a9235ca1196f0646ad0cdcb17b201bc3cc

Other Data Dumps

Release          BitTorrent Infohash and Download Link
Teams Beta       49f231796a07e783782ddc38fc750530f289514b  in Internet Archive

Docs Beta        ea3383630fa76399d135856f030aee0177bebd8a  in Internet Archive

// Generates Stack Exchange Network Data Dumps table above

class Release {
  constructor(infohash, year, month, announcement = null, nameSuffix = '', iaItemName = null) {
    this.infohash = infohash;
    this.year = year;
    this.month = month;
    this.announcement = announcement;
    this.nameSuffix = nameSuffix;
    this.iaItemName = iaItemName;
  }
}

const releases = [
  new Release(
    'ea45080eab61ab465f647e6366f775bf25f69a61', 2009, "May",
    'https://liveweb.archive.org/web/20090611145537/https://blog.stackoverflow.com/2009/06/stack-overflow-creative-commons-data-dump',
    '', 'stackexchange-ea45080eab61ab465f647e6366f775bf25f69a61'
  ), new Release(
    '68d22f0f856ca5056e009ac53597a66c0cb03068', 2009, "June",
    'https://liveweb.archive.org/web/20090611145537/https://blog.stackoverflow.com/2009/06/stack-overflow-creative-commons-data-dump',
    '', 'stackexchange-68d22f0f856ca5056e009ac53597a66c0cb03068'
  ), new Release(
    '2dca38c1c9724462ad4cedb42a1569805ab80f0c', 2009, "July",
    'https://liveweb.archive.org/web/20090709135537/https://blog.stackoverflow.com/2009/07/creative-commons-data-dump-july-09/',
    '', 'StackExchange2009-2011',
  ), new Release(
    'd348861b6d72c280f299e03fe9f9e8f3258eff19', 2009, "August",
    'https://liveweb.archive.org/web/20100723003527/https://blog.stackoverflow.com/2009/08/creative-commons-data-dump-aug-09/',
    '', 'StackExchange2009-2011',
  ), new Release(
    'f6ec47fba06823e22ede500511ab7c60ceddd91d', 2009, "August",
    'https://liveweb.archive.org/web/20100723003527/https://blog.stackoverflow.com/2009/08/creative-commons-data-dump-aug-09/',
    "rerelease", 'StackExchange2009-2011',
  ), new Release(
    '395bb1a89607fa05a9774bd7683eb3b6052989f7', 2009, "September",
    'https://liveweb.archive.org/web/20091107195235/https://blog.stackoverflow.com/2009/09/creative-commons-data-dump-sep-09/',
    '', 'StackExchange2009-2011',
  ), new Release(
    '61b882a518f21344ca82d4632f89a1dcafcbd3ed', 2009, "October",
    'https://liveweb.archive.org/web/20091014190329/https://blog.stackoverflow.com/2009/10/creative-commons-data-dump-oct-09',
    '', 'StackExchange2009-2011',
  ), new Release(
    '107f674c9b6a481eef7c81910228bc773246035b', 2009, "November",
    'https://liveweb.archive.org/web/20101114080034/https://blog.stackoverflow.com/2009/11/creative-commons-data-dump-nov-09/',
    '', 'StackExchange2009-2011',
  ), new Release(
    '11a2a48f204497f4222ff5edaf790f1d38a651fe', 2009, "December",
    'https://liveweb.archive.org/web/20100308032107/https://blog.stackoverflow.com/2009/12/creative-commons-data-dump-dec-09/',
    '', 'StackExchange2009-2011',
  ), new Release(
    '5127f67fb6099d322b6467bd85a1363fe8a73c3f', 2010, "January",
    'https://liveweb.archive.org/web/20101127005212/https://blog.stackoverflow.com/2010/01/creative-commons-data-dump-jan-10',
    '', 'StackExchange2009-2011',
  ), new Release(
    'cec670fa3c54bf8403bef2d0801a6f9478fb2c68', 2010, "February",
    'https://liveweb.archive.org/web/20100408002215/https://blog.stackoverflow.com/2010/02/creative-commons-data-dump-feb-10/',
    '', 'StackExchange2009-2011',
  ), new Release(
    'a790a8ab30f91c344c5b400579acd5643b2bb25c', 2010, "March",
    'https://liveweb.archive.org/web/20100926214909/https://blog.stackoverflow.com/2010/03/creative-commons-data-dump-mar-10/',
    '', 'StackExchange2009-2011',
  ), new Release(
    '53adea3f9acb1972201f059604c4bdad5e3e0a8c', 2010, "April",
    'https://liveweb.archive.org/web/20100812014035/https://blog.stackoverflow.com/2010/04/creative-commons-data-dump-apr-10/',
    '', 'StackExchange2009-2011',
  ), new Release(
    'f318086e65e7873d1a44de07e6d3ef4de0da0004', 2010, "May",
    'https://liveweb.archive.org/web/20101104093225/https://blog.stackoverflow.com/2010/05/creative-commons-data-dump-may-10/',
    '', 'StackExchange2009-2011',
  ), new Release(
    '2c802d003e59f84776a40b361584e1125d4eb877', 2010, "June",
    'https://liveweb.archive.org/web/20101212205817/https://blog.stackoverflow.com/2010/06/creative-commons-data-dump-jun-10/',
    '', 'StackExchange2009-2011',
  ), new Release(
    'fe29a5a7278960002cae679024f0175db3e470f1', 2010, "July",
    'https://liveweb.archive.org/web/20101108003200/https://blog.stackoverflow.com/2010/07/creative-commons-data-dump-jul-10/',
    '', 'StackExchange2009-2011',
  ), new Release(
    '53c3bf7f3b2ba1675acf3ac21bbaf84c63ca94c7', 2010, "August",
    'https://liveweb.archive.org/web/20101012054011/https://blog.stackoverflow.com/2010/08/creative-commons-data-dump-aug-10/',
    '', 'StackExchange2009-2011',
  ), new Release(
    '8f5c7a0bac4f5ee27b7cd7a1c179ba0ba66eb847', 2010, "September",
    'https://liveweb.archive.org/web/20101109045417/https://blog.stackoverflow.com/2010/09/creative-commons-data-dump-sept-10/',
    '', 'StackExchange2009-2011',
  ), new Release(
    'b549412a5e8aa70421756f0348f8063638994114', 2010, "October",
    'https://liveweb.archive.org/web/20101113193850/https://blog.stackoverflow.com/2010/10/creative-commons-data-dump-oct-10',
    '', 'StackExchange2009-2011',
  ), new Release(
    'f26b0ae2b975254676a02bdfb0fd4b7f6f78b951', 2010, "November",
    'https://liveweb.archive.org/web/20101203005658/https://blog.stackoverflow.com/2010/11/creative-commons-data-dump-nov-10/',
    '', 'StackExchange2009-2011',
  ), new Release(
    '16e7c2867f7b5be3d7dbe7c3f707601b16c5f2c5', 2011, "January",
    'https://stackoverflow.blog/2011/01/creative-commons-data-dump-jan-11/',
    '', 'StackExchange2009-2011',
  ), new Release(
    'ec636f7edc262053429653edfdf47e806f14e72f', 2011, "April",
    'https://liveweb.archive.org/web/20110410104736/https://blog.stackoverflow.com/2011/04/creative-commons-data-dump-apr-11/',
    '', 'StackExchange2009-2011',
  ), new Release(
    'cdb37ea243e09fcaf54e6b7f19764765a706724c', 2011, "June",
    'https://liveweb.archive.org/web/20110914082314/https://blog.stackoverflow.com/2011/06/creative-commons-data-dump-jun-11/',
    '', 'StackExchange2009-2011',
  ), new Release(
    '64d052f755e01d1c947848ad3d22180476a71a94', 2011, "September",
    'https://stackoverflow.blog/2011/09/creative-commons-data-dump-sep-11/',
    '', 'StackExchange2009-2011',
  ), new Release(
    '77ccfd3451c442590bf5bd940362a121a16ee5a3', 2011, "December",
    'https://meta.stackexchange.com/questions/116369/several-sites-are-missing-from-the-december-2011-data-dump'
  ), new Release(
    'ccb07610f73f994b15399acdd507778dce964111', 2011, "December",
    'https://meta.stackexchange.com/questions/116369/several-sites-are-missing-from-the-december-2011-data-dump',
    "part 2"
  ), new Release(
    'de13c16eb98bc8e95a77ed7e0ff6953d60bf90ba', 2011, "December",
    'https://meta.stackexchange.com/questions/116369/several-sites-are-missing-from-the-december-2011-data-dump',
    "part 3"
  ), new Release(
    'c0ecc66e8f1d630cbcd39bf523b3381a7779daa3', 2012, "April"
  ), new Release(
    'ecf5ec6d0a2a3a5b582b1ef684a5fe4552ff1c8b', 2012, "August",
    'https://meta.stackexchange.com/questions/143709/are-all-the-meta-sites-intended-to-be-included-in-the-data-dump'
  ), new Release(
    'b06fff722ce06520b59a9db72cab9f7d008ff8c3', 2012, "August",
    'https://meta.stackexchange.com/questions/143709/are-all-the-meta-sites-intended-to-be-included-in-the-data-dump',
    "part 2"
  ), new Release(
    '47e02c81368acd9fa0f884439c00fa8439ef971f', 2013, "March"
  ), new Release(
    'c472a68f39cd333816098e53ae353e8d90c3e9d3', 2013, "September"
  ), new Release(
    'cc28f62bb9eb1da79ca2a782960f86f64d8ceb87', 2014, "January",
    'https://stackoverflow.blog/2014/01/stack-exchange-cc-data-now-hosted-by-the-internet-archive/'
  ), new Release(
    '3aed037c4c0a73d2f3eb244b99c1cd842bc88142', 2014, "May"
  ), new Release(
    'b1a458cba5af9525d4012c20f9c51b35a15f0984', 2014, "September",
    'https://meta.stackexchange.com/questions/240139/stack-exchange-september-2014-data-dump-is-available'
  ), new Release(
    '0ea39049afdbaaea255ca1d0af662e2a0d503098', 2015, "March"
  ), new Release(
    '57ceb5ac3e22cbf4e4de8b94f9814e809f0765bb', 2016, "March"
  ), new Release(
    'e1a5e02efb60d9514c8822b1f9d3e605436caac9', 2016, "June"
  ), new Release(
    'be15f50878cb77028b119a9f922f02e439481030', 2016, "September"
  ), new Release(
    'fd86cb81c9ab08bd3a0969d4c700555ec7814328', 2016, "December"
  ), new Release(
    '586eebe6f3c19db48a5ea471579b96d3bd3ba6e3', 2017, "March"
  ), new Release(
    'fa38c0e9bbbb060927a7a7ca1f9325aa98466e1f', 2017, "June"
  ), new Release(
    'e73b7025a2af72124ae49d184fa3e8cec3f66016', 2017, "December",
    'https://meta.stackexchange.com/questions/302786/stack-exchange-data-dump-no-longer-available-via-bittorrent-since-june-2017/'
  ), new Release(
    '4ad8edb2e0781d381d110778036703da988de71a', 2018, "March",
    '', '', 'stackexchange-snapshot-2018-03-14'
  ), new Release(
    '8e6a46cc6290ee3dc93cec299b6e28b7ee2f3228', 2018, "June",
  ), new Release(
    'bddb28e2bc5fecdc2acf83c76e7941797fc98b2e', 2018, "September",
  ), new Release(
    'd1623b9edd9ee6787fdb614299d14baa94e24d80', 2018, "December"
  ), new Release(
    'f8b00f75393b2fca5e8796e48cfe89c2f0536fa2', 2019, "March"
  ), new Release(
    '593cf931e968c608f953b3b62d513d2365d68aa2', 2019, "June"
  ), new Release(
    '8cec36af3037f78e793057eeb38b684048d043de', 2019, "September"
  ), new Release(
    'fd11cc265a7964b42ac80f21c216420372c9cada', 2019, "December"
  ), new Release(
    'a6266395a2bb85fecde76ee8324bc05827554e81', 2020, "March"
  ), new Release(
    'daceb39faefc3f797005488f56e3b01c57c5af91', 2020, "June"
  ), new Release(
    'a321f0dfa7d037db155590fa89ff118271d07a85', 2020, "September"
  ), new Release(
    '3fa542ce4c9322df301e2c89a1d9c2bc87541015', 2020, "December"
  ), new Release(
    '03ae768efe49a064e3b7fe5bb554203258383689', 2021, "March",
    '', '', 'stackexchange_20210301'
  ), new Release(
    'ee64468a824040067d468d57f51e63ae9cf1aaa6', 2021, "June",
    '', '', 'stackexchange_20210607'
  ), new Release(
    '27689c6b23a5b606987114abc3e9ba2668f93755', 2021, "September",
    "https://meta.stackexchange.com/questions/369502/data-dump-in-the-internet-archive-is-no-longer-available-what-has-happened#comment1233074_369521", '',
    'stackexchange_20210907'
  ), new Release(
    '677a281a1b9bcbc4684f1f5659db0e6de0f1488e', 2021, "December",
    '', '', 'stackexchange_20211206',
  ), new Release(
    '5854d890b3c845b75b1c67e96eecbdc38d6db883', 2022, "March",
    "https://meta.stackexchange.com/questions/377171/waiting-for-march-2022-dump/",
    '', 'stackexchange_20220307',
  ), new Release(
    '8225cdd03712ddf0c3f0261bf982fc21d7647221', 2022, "June",
    '', '', 'stackexchange_20220606'
  ), new Release(
    '1c65c4a7ccfdd77bc542d7220a28b99893c6fa3d', 2022, "October",
    '', '', 'stackexchange_20221005'
  ), new Release(
    'b369adf8a6da002537e8b0c49e187448e0138281', 2022, "December",
    '', '', 'stackexchange_20221206'
  ), new Release(
    '263d19f9188a146b150648cd1975820f3ebbd38e', 2023, "March",
    '', '', 'stackexchange_20230308'
  ), new Release(
    '93d9b232af49082b59693e6e07f6d05ea8e99ec8', 2023, "June",
    'https://meta.stackexchange.com/questions/389922/june-2023-data-dump-is-missing/390200#390200',
    '', 'stackexchange_20230614'
  ), new Release(
    'd884b3a9235ca1196f0646ad0cdcb17b201bc3cc', 2023, "September",
    'https://meta.stackexchange.com/questions/392720/possible-delay-in-data-dump-release-now-targeting-september-5th'
  ),
];

const pad = (x, length) => {
  let s = String(x);
  while (s.length < length) s += ' ';
  return s;
};

const lines = [];

lines.push(`<pre><code><b>Release          BitTorrent Infohash and Magnet Link</b></code></pre><pre><code>`);

for (const r of releases) {
  const label = !r.nameSuffix ? `${pad(r.year, 4)} ${pad(r.month)}` : r.year + ' …' + r.nameSuffix;
  const dn = `${r.month} ${r.year} Stack Exchange Data Dump${r.nameSuffix ? ' (' + r.nameSuffix + ')' : ''}`;
  let labelCode =
    r.announcement ? `<a href="${r.announcement}">${label}</a>` : label;
  for (let i = label.length; i < 16; i++) {
    labelCode += ' ';
  }
  // We use a redirect at https://dash.deno.com/playground/mag
  // because stack exchange doesn't allow direct magnet links
  // in post bodies.
  const download = `https://mag.deno.dev/magnet:?xt=urn:btih:${r.infohash}&dn=${encodeURIComponent(dn)}`;
  if (r.infohash) {
    lines.push(`${labelCode} <a href="${download}">${pad(r.infohash, 20)}</a>`);
  } else {
    lines.push(`${labelCode} <i>${"torrent unknown".padEnd(40)}</i>`)
  }
  if (r.iaItemName) {
    lines.push(`  <a href="https://archive.org/download/${r.iaItemName}">in Internet Archive</a>`);
  }
  lines.push('\n');
}

lines.push(`</code></pre>`);
const generated = lines.join('')

const source = document.createElement('pre');
source.textContent = generated;
source.style.userSelect = 'all';
document.body.appendChild(source);

const hr = document.createElement('hr');
document.body.appendChild(hr);

const preview = document.createElement('div');
preview.innerHTML = generated;
document.body.appendChild(preview);

The list above omits some releases which had errors and were immediately replaced.

Improve this answer
8
  • 2
    Shameless plug: if anybody is curious, I have recently written a Stack Overflow answer explaining how BitTorrent magnet links work.
    – Jeremy
    Mar 11, 2014 at 15:26
  • 1
    I need a StackOverflow Data Dump in which MD5 e-mail checksum are visible. Can you confirm that a kind of this is still availble? Thanks :)
    – gios91
    Mar 30, 2015 at 9:18
  • 3
    @gios91 Unfortunately for that use case, the email hashes haven't been included since either the January 2014 or March 2013 dump (I'm not sure which). As this change was made to increase privacy, it's unlikely to ever be changed back. If you have an academic use intended for it, and affiliations with an academic institution, I think Stack Exchange might provide more complete dumps under an NDA, but I don't remember where I read that, so I can't confirm right now.
    – Jeremy
    Apr 1, 2015 at 15:52
  • It looks like there Internet Archive's public log files include the infohashes of all generated torrents. You can see one here. So that should allow this list to be maintained even if some updates are missed at the time.
    – Jeremy
    Feb 1, 2017 at 17:01
  • 1
    "The contents may or may not be available." -> Hosting all Stack Exchange data dumps on archive.org
    – Franck Dernoncourt
    Jan 27, 2018 at 23:45
  • 1
    Do we know if the new dump is complete?
    – Nemo
    Jan 18, 2020 at 13:14
  • @Nemo please define "complete"? What are you missing?
    – rene
    Mar 28, 2020 at 9:22
  • 1
    @rene That's my question: "what are we missing?" We don't know until someone tests. A more recent update is at meta.stackexchange.com/a/342634/248268
    – Nemo
    Mar 29, 2020 at 8:20
24

The older dumps from 2009 to 2011 are available here:

https://tejp.de/files/so/dbdump (mirror)

Improve this answer
2
  • 4
    Just curious - who is hosting these?
    – Journeyman Geek Mod
    Mar 1, 2018 at 9:02
  • 16
    @JourneymanGeek: I am :)
    – sth
    Mar 1, 2018 at 13:24
3

Here are the data after December 2017

https://empirical-software.engineering/sotorrent/

Improve this answer
1
  • 2
    This only contains StackOverflow data.
    – a3nm
    Apr 10, 2021 at 19:48

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .