Skip to main content
275 votes
Accepted

June 2023 Data Dump is missing

Update 2023-06-18 The Data Dump has been re-enabled. The latest data dump is available on The Internet Archive. It was uploaded at 2023-06-14, and contains data up to 2023-06-03. Additionally, a ...
AMtwo's user avatar
  • 10.6k
215 votes

Announcing a change to the data-dump process

There is a lot going on here... I'll come out and say it that after first reading, it feels like a great big distraction because Senior Leadership is treating the data dump like a boogeyman, when that'...
AMtwo's user avatar
  • 10.6k
164 votes

Announcing a change to the data-dump process

How do you plan to enforce "I agree that I will use this file for non-commercial use. I will not use it for any other purpose, and I will not transfer it to others without permission from Stack ...
goldPseudo's user avatar
  • 5,696
154 votes

June 2023 Data Dump is missing

Few things have made me more livid than what we've just learned through the answer given by AMtwo. The data dump is one of the main reasons why I'm still participating to this day and has been part of ...
curious's user avatar
  • 3,814
154 votes

The company's commitment to the data dumps, the API, and SEDE

(Note: the quoted sentence was edited after I posted my answer. I am leaving this answer unedited and undeleted, so that it is available for folks reading the revision history.) From the original ...
AMtwo's user avatar
  • 10.6k
148 votes

Announcing a change to the data-dump process

to get the data file for a Stack Exchange site, there will be a location within the settings page on each Stack Exchange site. Users will be provided with the link to the data file, and can also ...
Shog9's user avatar
  • 452k
127 votes

June 2023 Data Dump is missing

Friday evening That's it, and the dump is uploaded. Many thanks to the stackers involved, especially Aaron Bertrand, who babysat the thing for days. Update as of Friday morning (2023-06-16 12:29:39Z)...
Philippe's user avatar
  • 21k
116 votes

Shifting the data dump schedule: A proposal

Disclaimer: I don't actually use the dumps, so my approval doesn't mean that much. But, as the author of the comment that sparked this proposal, let me confirm that this is exactly how I'd expect the ...
Fabio says Reinstate Monica's user avatar
98 votes

Announcing a change to the data-dump process

we want to help make the process of accessing data dumps quicker and more efficient Umm. OK, I won't laugh out loud, but instead give some simple facts. This is the process today: Anyone can ...
Shadow Wizard's user avatar
89 votes

June 2023 Data Dump is missing

We are looking for ways to gate access to the Dump, APIs, and SEDE, that will allow individuals access to the data while preventing misuse by organizations looking to profit from the work of our ...
wizzwizz4's user avatar
  • 21.8k
85 votes

Announcing a change to the data-dump process

Posted Tuesday 2023-06-13 22:32:13Z: Much has been written lately of the company’s decision to pause the distribution of the anonymized data dump that has historically been posted. Our intention was ...
Restore The Data Dumps Again's user avatar
79 votes

Announcing a change to the data-dump process

this is primarily only a change in location for where the data dump is accessed. No, this is false and misleading. You are instead trying to quietly change the license of the data dump, and you ...
Franck Dernoncourt's user avatar
77 votes

Announcing a change to the data-dump process

The company cannot be trusted to own the server hosting the data dumps. You (read here and later: the company, just so I can skip a spammy round of "I didn't do anything") want to make ...
Andras Deak -- Слава Україні's user avatar
63 votes

June 2023 Data Dump is missing

To highlight the significance that the data dump may have held for me and others: I signed up to Stack Overflow in order to contribute to a free library of knowledge for everyone, knowing that the ...
NoDataDumpNoContribution's user avatar
57 votes

Announcing a change to the data-dump process

A few things to point out: The text in the screenshot around requesting access is not consistent with saying that the CC BY-SA license is unchanged. The Creative Commons has a FAQ entry about ...
Thomas Owens's user avatar
  • 52.1k
56 votes

Database schema documentation for the public data dump and SEDE

The Schema Visualized The Entity Relationship Diagram (ERD) above was constructed using the data found in the information_schema.columns table. (Thank you to ashleedawg for paring the table down to ...
54 votes

The company's commitment to the data dumps, the API, and SEDE

I echo starball's statement, but I want to elaborate a bit more than a comment would allow. The statements of "long-term" and "foreseeable future" are incredibly vague and often ...
Thomas Owens's user avatar
  • 52.1k
54 votes

Why are people so unhappy about the OpenAI partnership? Am I missing something?

In a sense—it's because both AI companies and to an extent the company haven't acted in a manner that engenders trust. I'd note our first brush with AI was people posting AI output on our sites with ...
Journeyman Geek's user avatar
53 votes

Announcing a change to the data-dump process

Having assumed you were acting in good faith, I spent a full working day going through the third draft, pointing out wording that was likely to result in… well, *gestures at this webpage*. And I don't ...
wizzwizz4's user avatar
  • 21.8k
48 votes
Accepted

Is SE in violation of the CC BY-SA 4.0 license by not providing data dumps?

I am not a lawyer, but I'm pretty much 100% sure Stack Exchange is not required to provide data dumps except that they promised the community they would do so way back when. CC BY-SA just describes ...
goldPseudo's user avatar
  • 5,696
48 votes

The company's commitment to the data dumps, the API, and SEDE

Many words have been written around the company's commitment (or perceived lack thereof) to the ongoing existence of the data dumps, the API, and the Stack Exchange Data Explorer (SEDE). Much of that ...
Makoto's user avatar
  • 58.3k
47 votes

Announcing a change to the data-dump process

In my other answer, I mostly focus on licensing and why there are materially problematic issues with the current plan. In this answer, my focus is on why the announcement is problematic from a moral ...
AMtwo's user avatar
  • 10.6k
45 votes

June 2023 Data Dump is missing

Stack Overflow senior leadership is working on a strategy to protect be able to solely monetize Stack Overflow data from being misused by charging companies building LLMs extortionate amounts of money....
Script47's user avatar
  • 17.2k
45 votes

June 2023 Data Dump is missing

The resumption of these dumps is very welcome, and I'm glad the company has decided to listen to the community on this issue. That said, there's something in Phillipe's answer which doesn't sound ...
kaya3's user avatar
  • 6,226
41 votes

The company's commitment to the data dumps, the API, and SEDE

If you are really committed to maintaining the data dumps, free API and SEDE, you don't need to use phrase "foreseeable future". Probably not even the phrase "long-term". It just ...
Resistance Is Futile's user avatar
39 votes

Announcing a change to the data-dump process

We would really rather users do not upload the file to archive.org or similar data pile sites. Assuring the viability of the Network takes resources, and companies that profit off the back of the work ...
curiousdannii's user avatar
34 votes

Announcing a change to the data-dump process

I have many, many thoughts on this, so this answer might end up being a bit fragmented. I know this isn't novel among the other voices here, but I think this is a very, very bad idea. Self-Interest &...
zcoop98's user avatar
  • 9,953
33 votes

Announcing a change to the data-dump process

We, the community, want to contribute content under a Creative Commons Attribution ShareAlike license, to share with the whole world. We're inspired by Wikipedia and other free culture initiatives. ...
Flimm's user avatar
  • 1,712
32 votes
Accepted

Waiting for March 2022 dump

This is solved (more or less). Our account has been restored. Most data dumps are available (thanks Andy Mallon, aka AMtwo!), with the following exceptions: Monero, which we skipped intentionally ...
Aaron Bertrand's user avatar
  • 42.8k
31 votes

Possible delay in Data Dump release - now targeting September 5th

We completed uploading files for the September data dump over the weekend. All of Archive's background tasks have completed overnight. I now consider the dump complete (including the torrent file) and ...
Aaron Bertrand's user avatar
  • 42.8k

Only top scored, non community-wiki answers of a minimum length are eligible