275 votes
Accepted

June 2023 Data Dump is missing

Update 2023-06-18 The Data Dump has been re-enabled. The latest data dump is available on The Internet Archive. It was uploaded at 2023-06-14, and contains data up to 2023-06-03. Additionally, a ...
AMtwo's user avatar
  • 7,752
153 votes

June 2023 Data Dump is missing

Few things have made me more livid than what we've just learned through the answer given by AMtwo. The data dump is one of the main reasons why I'm still participating to this day and has been part of ...
curious's user avatar
  • 3,794
152 votes

The company's commitment to the data dumps, the API, and SEDE

(Note: the quoted sentence was edited after I posted my answer. I am leaving this answer unedited and undeleted, so that it is available for folks reading the revision history.) From the original ...
AMtwo's user avatar
  • 7,752
126 votes

June 2023 Data Dump is missing

Friday evening That's it, and the dump is uploaded. Many thanks to the stackers involved, especially Aaron Bertrand, who babysat the thing for days. Update as of Friday morning (2023-06-16 12:29:39Z)...
Philippe's user avatar
  • 20.7k
117 votes

Shifting the data dump schedule: A proposal

Disclaimer: I don't actually use the dumps, so my approval doesn't mean that much. But, as the author of the comment that sparked this proposal, let me confirm that this is exactly how I'd expect the ...
Fabio says Reinstate Monica's user avatar
88 votes

June 2023 Data Dump is missing

We are looking for ways to gate access to the Dump, APIs, and SEDE, that will allow individuals access to the data while preventing misuse by organizations looking to profit from the work of our ...
wizzwizz4's user avatar
  • 18.1k
63 votes

June 2023 Data Dump is missing

To highlight the significance that the data dump may have held for me and others: I signed up to Stack Overflow in order to contribute to a free library of knowledge for everyone, knowing that the ...
NoDataDumpNoContribution's user avatar
55 votes

The company's commitment to the data dumps, the API, and SEDE

I echo starball's statement, but I want to elaborate a bit more than a comment would allow. The statements of "long-term" and "foreseeable future" are incredibly vague and often ...
Thomas Owens's user avatar
  • 49.1k
53 votes

Database schema documentation for the public data dump and SEDE

The Schema Visualized The Entity Relationship Diagram (ERD) above was constructed using the data found in the information_schema.columns table. (Thank you to ashleedawg for paring the table down to ...
49 votes
Accepted

Is SE in violation of the CC BY-SA 4.0 license by not providing data dumps?

I am not a lawyer, but I'm pretty much 100% sure Stack Exchange is not required to provide data dumps except that they promised the community they would do so way back when. CC BY-SA just describes ...
goldPseudo's user avatar
  • 4,390
49 votes

The company's commitment to the data dumps, the API, and SEDE

Many words have been written around the company's commitment (or perceived lack thereof) to the ongoing existence of the data dumps, the API, and the Stack Exchange Data Explorer (SEDE). Much of that ...
Makoto's user avatar
  • 58.3k
46 votes

June 2023 Data Dump is missing

The resumption of these dumps is very welcome, and I'm glad the company has decided to listen to the community on this issue. That said, there's something in Phillipe's answer which doesn't sound ...
kaya3's user avatar
  • 6,236
45 votes

June 2023 Data Dump is missing

Stack Overflow senior leadership is working on a strategy to protect be able to solely monetize Stack Overflow data from being misused by charging companies building LLMs extortionate amounts of money....
Script47's user avatar
  • 17.2k
42 votes

The company's commitment to the data dumps, the API, and SEDE

If you are really committed to maintaining the data dumps, free API and SEDE, you don't need to use phrase "foreseeable future". Probably not even the phrase "long-term". It just ...
Resistance Is Futile's user avatar
41 votes

Where are the Stack Exchange data dumps?

The latest release of the data dump lives on archive.org. A version of it (updated weekly) can be viewed and queried online at data.stackexchange.com - the data here forms the basis for the quarterly ...
Oded's user avatar
  • 155k
32 votes
Accepted

Waiting for March 2022 dump

This is solved (more or less). Our account has been restored. Most data dumps are available (thanks Andy Mallon, aka AMtwo!), with the following exceptions: Monero, which we skipped intentionally ...
Aaron Bertrand's user avatar
  • 40.8k
31 votes

The company's commitment to the data dumps, the API, and SEDE

I will avoid further commenting on the issue described by AMtwo and the implications in the first version of the post about the "perceived" lack of understanding from the community. Just ...
SPArcheon's user avatar
  • 28.8k
31 votes

Possible delay in Data Dump release - now targeting September 5th

We completed uploading files for the September data dump over the weekend. All of Archive's background tasks have completed overnight. I now consider the dump complete (including the torrent file) and ...
Aaron Bertrand's user avatar
  • 40.8k
27 votes

June 2023 Data Dump is missing

Our intention was never to stop posting the data dump Okay that sounds real nice of you... But uh- why was there zero transparency in all of this? It was revealed by ex-staff, and then actual staff ...
starball's user avatar
  • 24.3k
27 votes
Accepted

How can SE gate access to the Dump that will allow individuals access to the data while preventing "misuse" by for-profit organizations?

Personally, I don't think they can. At least not legally. To be clear, I imagine they might be able to avoid sharing the data dumps at all - at least in the future, once they've fulfilled their ...
BryKKan's user avatar
  • 1,141
26 votes

All Stack Exchange data dumps

The older dumps from 2009 to 2011 are available here: https://tejp.de/files/so/dbdump (mirror)
sth's user avatar
  • 16.4k
26 votes

June 2023 Data Dump is missing

I want to re-iterate what others have said in the comments. The fact that my contributions to Stack Overflow are licensed under CC BY-SA is a significant motivating factor for why I contribute in the ...
Ajedi32's user avatar
  • 359
26 votes

The company's commitment to the data dumps, the API, and SEDE

I asked in the Meta Discord about what "foreseeable future" means, to which Mithical replied: As I understand it, until the people involved are no longer with the company. , which I don't ...
starball's user avatar
  • 24.3k
25 votes
Accepted

Shifting the data dump schedule: A proposal

Since this was so well received, we have pushed a new data dump in early April and, for the foreseeable future, we plan to adhere to the schedule outlined in the question. I've set a reminder to ...
Aaron Bertrand's user avatar
  • 40.8k
24 votes
Accepted

Does archival interfere with attribution removal?

CC BY-SA has some language that limits the extent of the removal "to the extent practical": Licensors may request removal of attribution In the 4.0 licenses, a user must remove attribution ...
Alexander O'Mara's user avatar
23 votes

The company's commitment to the data dumps, the API, and SEDE

I'm rather concerned by the 'two' narratives - and the disconnect between what was publicly released, and honestly the seemingly more credible version we're gotten from current and former staff. We ...
Journeyman Geek's user avatar
22 votes

Dump of my own Stack Exchange content

There's a way that gets you almost all of the way there with an absolute minimum of hassle, and using supported interfaces only. Use Stack Exchange's GDPR Data Access Request interface. Start at /...
user's user avatar
  • 8,967
21 votes

Shifting the data dump schedule: A proposal

Overall, I think the proposal makes sense. If you start your export on or after the first day of the next quarter, why do you have a minimum date timestamp? I'm not sure how impactful it would be, but ...
Thomas Owens's user avatar
  • 49.1k
19 votes
Accepted

When will the October 2022 data dump be ready?

The process completed as of Oct 5 at 05:28 UTC, however the files were corrupt and unusable. We’ve worked with Archive to determine the problem, resumed the upload, and this finished the last file ...
Aaron Bertrand's user avatar
  • 40.8k
19 votes

The company's commitment to the data dumps, the API, and SEDE

I don't think that anything the community has written was confusing or conflicting. We realized the June data dump was missing, we asked for it, an external, very courageous source confirmed that the ...
NoDataDumpNoContribution's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible