Questions tagged [data-dump]

This tag is about the quarterly creative commons data dumps of all public data in the Stack Exchange network Q&A sites.

Filter by
Sorted by
Tagged with
8 votes
0 answers
85 views

Stack Overflow data dump: Discrepancy of PostIDs in Posts.xml and Comments.xml

I am aggregating the URLs that have been shared on SO, and linking them back to the corresponding tags in the Question post. Along the way, I noticed a subset of ~100 PostIds that have URLs in the ...
user avatar
6 votes
1 answer
137 views

Is the post body of the Stack Exchange data dump sanitized?

I am building a project based on the Stack Overflow data dump. As per Database schema documentation for the public data dump and SEDE the Body of Posts / PostsWithDeleted is given as rendered HTML and ...
user avatar
0 votes
1 answer
136 views

Should I download stackoverflow.com-PostHistory.7z to be able to use the StackedOff app?

I'm currently trying to use that app. StackedOff - an offline StackExchange indexer and search engine During an internet GB restriction on my side, the stackoverflow.com-PostHistory.7z file is 30 GB; ...
user avatar
  • 129
3 votes
0 answers
62 views

Were Stack Exchange Data dumps removed from Archive.org? [duplicate]

It seems that Stack Exchange data dumps are no longer available at Archive.org: This item is no longer available. Items may be taken down for various reasons, including by decision of the uploader or ...
user avatar
11 votes
0 answers
217 views

Where has the Stack Exchange official dump gone? archive.org/details/stackexchange [duplicate]

Why do I see this message after I only download StackOverflow-Posts.7z? I have tried to use a VPN, but I receive the same error message: This item is no longer available. Items may be taken down for ...
user avatar
  • 129
13 votes
1 answer
710 views

Waiting for March 2022 dump

I'm used to finding the new dumps during the first week of a quarter, but now it's the 15th and I'm constantly refreshing https://archive.org/download/stackexchange. (hopefully everyone is doing well) ...
user avatar
4 votes
0 answers
95 views

Error while downloading all Stack Exchange data dumps

I’m working on the analysis and prediction of deletion questions in the Stack Overflow project. By comparing different data sets, I can retrieve all the deleted questions by using data dumps obtained ...
user avatar
4 votes
1 answer
120 views

How can a User's CreationDate be after they have posted?

I am currently analysing an Archive-Datadump of the apple.stackexchange.org. When looking on the posts.xml together with the users.xml, there is a strange anomaly. The earliest CreationDate among ...
user avatar
  • 51
2 votes
0 answers
86 views

What is posthistory? [duplicate]

I am trying to use Stack Overflow offline and I see that there are 2 files names Posts and PostHistory in archive.org available for downloads. Can someone tell me what PostHistory is? Is it all the ...
user avatar
5 votes
2 answers
95 views

Use cron to get SE Data Explorer data when it's updated

According to this answer from 2012, the SE Data Explorer data is updated every Sunday at 3am. If true, is it possible to schedule a cron job to run every Monday and execute this query? When the query ...
user avatar
3 votes
1 answer
48 views

Extract data for several user ids in SEDE

How do I extract data from data.stackexchange.com for several user ids? I'm trying to do select * from posts where (owneruserid = 123 or owneruserid = 456); but it only outputs the results for the ...
user avatar
1 vote
1 answer
68 views

How to get edits of a particular question from the Stack Exchange data dump

I want to see all the edits that were made to a Stack Exchange question. In other words, how a question has changed over time, maybe by editing tags, removing grammatical errors, or something else. ...
user avatar
9 votes
2 answers
135 views

Is null assignment of `ClosedDate` column of Posts table from Stack Overflow Data dump correct?

In the Stack Overflow data dump, I can see some posts whose ClosedDate column from the Posts table is null, but their PostHistoryTypeId = 10 (which represents post was closed) from PostHistory tables. ...
user avatar
22 votes
1 answer
781 views

Data Dump in the Internet Archive is no longer available. What has happened?

The context I'm getting the following (see screenshot below) when visiting the Stack Exchange Data Dump in the Internet Archive. Here's the URL. This item is no longer available. Items may be taken ...
user avatar
  • 511
15 votes
0 answers
147 views

Inclusion of the tables available in SEDE in the data dump at the Internet Archive

Table of contents Prologue The feature request TL; DR Current content of the data dump Missing tables in the data dump Motivation for doing this Epilogue Prologue First of all, I would like to ...
user avatar
  • 511
4 votes
1 answer
147 views

How to get the data dump of all the tables (29 tables) for each site?

Prologue We all know that we can use the Stack Exchange Data Explorer to perform queries in (most if not all) of the Stack Exchange tables. The tables listed, as for [2021-08-05 Thu 18:21], are 29. ...
user avatar
  • 511
5 votes
0 answers
112 views

Is there a data dump for SE chat logs?

I am working on a research project looking at Stackexchange posts. I am aware of the data explorer as well as the data dump stored on the internet archive. I was wondering if there was any information ...
user avatar
-14 votes
1 answer
190 views

Download Stack Overflow dataset for college project [duplicate]

I would like to download the Stack Overflow dataset that contains the question title and top-rated answer (not answer id).
user avatar
10 votes
1 answer
68 views

How to get "duplicates list edited" history from the public data dump or SEDE?

I want to search questions whose duplicates list has been edited. Take this question as an example: The timeline shows that the type of "duplicates list edited" is history, but the list ...
user avatar
1 vote
1 answer
92 views

ID of user in the Posts.7z public Stack Overflow dataset

I have downloaded the Posts.7z dataset from here. I have not been able to find a README file, so I go by intuition regarding the content of the file. To my understanding, a single line of the file is ...
user avatar
  • 129
7 votes
1 answer
72 views

Which data dump has the information related to mentioned users in a comment

From the Stack Exchange API, I can retrieve the comments in which a specific user is mentioned using @ method. Here is the /users/{ids}/mentioned API. Which data dump on archive.org hosts this ...
user avatar
  • 231
3 votes
0 answers
88 views

Where can I find examples of Stack Exchange search queries?

Is there a dataset available to the research community that contains example queries for Stack Exchange results related to sotware? By search queries I mean "pandas to_csv tab delimiter" and ...
user avatar
2 votes
2 answers
152 views

Can't extract PostHistory from stack overflow data dumps

I downloaded the stackoverflow.com-PostHistory.7z file from here and I can't extract the 7z file. I tried 7-zip software and WinRAR. I also tried extracting from 2 different hard drives. Both failed. ...
user avatar
  • 157
3 votes
0 answers
51 views

Stack Exchange Data Dumps still indicating old attribution requirements

The Stack Exchange Data Dumps still contain wording mandating that attribution be given in specific ways, going beyond the Creative Commons licensing requirements: Specifically the attribution ...
user avatar
  • 208
-5 votes
1 answer
248 views

Are the newest Stack Overflow data dumps still usable today?

The network connection hasn't worked for some weeks in my place, so I'd want something like hosting a Stack Overflow Dump offline before the Internet connection stops working. I don't think I'll ...
user avatar
5 votes
1 answer
249 views

Dump my Stack Exchange Favorites

I'm trying to morph this wonderful query to get all of one's posts so that it retrieves all the posts I have favorited. Full code here but here is the key piece I have modified, but does not work. ...
user avatar
6 votes
0 answers
155 views

Where can I download previous SE database snapshots?

I'm aware I can download the entire anonymized Stack Exchange databases from https://archive.org/details/stackexchange But from what I can see, I can only download the latest snapshot, updated ...
user avatar
2 votes
1 answer
538 views

How do you join between Posts and Users in the Stack Overflow database?

I'm trying to join between stackoverflow.com's dataset Posts and Users files and I'm having trouble. I want to add the user profile of the question poster to a Post. Do I use User.AccountId or User....
user avatar
1 vote
0 answers
48 views

Time of Accepted Answer in Stack Exchange Dump [duplicate]

I was looking into the Stack Exchange dump and wanted to try to get more information on when an accepted answer is declared. The Votes table had been suggested in a previous post since it has a type ...
user avatar
17 votes
2 answers
607 views

Stack Overflow Outdated Dump

I downloaded Stack Overflow posts dump ('stackoverflow.com-Posts.7z') on 13 Sept 2019 which was lastly modified on 4 Sept 2019 according to https://archive.org. However, after I extracted the data I ...
user avatar
  • 173
5 votes
0 answers
165 views

Seeking Stack Overflow data dump from 2012 to 2016

From this answer to All Stack Exchange data dumps, the historical versions of Stack Overflow data dump are provided. However, from 2012 to 2016, it seems that the data dumps are not available. Has ...
user avatar
  • 81
4 votes
0 answers
142 views

Can we get Stack Exchange voting data updates?

During some discussion, a very kind user linked me to this since I was combing trough SO(comp)/SE trying to familiarise myself with this website and data it provides. What I am interested in are ...
user avatar
  • 321
1 vote
0 answers
20 views

What are the reasons that the `FavoriteCount` column in the `Posts` table has elements that are not available? [duplicate]

I was taking a look at this post which details the database schema for the Stack Exchange Data Explorer. I had one question about the Posts data set: what are the reasons that the FavoriteCount column ...
user avatar
  • 111
1 vote
0 answers
46 views

Download all my content in a compact form [duplicate]

The imaginary feature being proposed sounds like a lot of work to implement but I think it still can be useful as an inspiration. Assume a user of an SE site has made some thoughtful contributions ...
user avatar
-5 votes
1 answer
128 views

SEDE query to find users' reputation when posting their questions

Each question has an Id, OwnerUserId, and CreationDate. I need to calculate the reputation of that user (questioner) was during the question creation time. I find the question (Determining user's ...
user avatar
4 votes
1 answer
93 views

SEDE query to find how many questions remain unanswered related to a particular tag

For example, there are N questions which have a tag named X (there might be other tags also) and M of the questions remain unanswered. I require the number M associated with all tags in Stack Overflow....
user avatar
2 votes
1 answer
88 views

How can I get a notification when a new Stack Exchange dump is made available?

How can I get a notification when a new Stack Exchange dump is made available?
user avatar
7 votes
1 answer
168 views

How can I retrieve list of top 100 users on Stack Exchange for a specific tag sorted by posted content?

I am trying to replicate the top user page with users sorted by number of posts for a specific tag. Suppose there are two users for a tag. User 'A' with 5608 posts for a tag. And User 'B' with 2627 ...
user avatar
  • 183
3 votes
0 answers
32 views

Does LastActivityDate for a question from Posts.xml consider answers, comments, votes? [duplicate]

From some answers regarding LastActivityDate, I know that LastActivityDate of a question considers: a) Posting a question, b) Answering a question, c) Edits to either question or answer(s) I want ...
user avatar
2 votes
1 answer
104 views

How can I find all the StackExchange websites that I'm part of? - Queries on Data Explorer

How can I find all the StackExchange websites that I'm part of as well as I'm not part of using the Data Explorer..? In addition, if it's possible, I would like to use this query to do additional data ...
user avatar
  • 297
0 votes
1 answer
79 views

How do I link the Stack Exchange data together? [duplicate]

I was trying to link the Stack Exchange data together from the archive.org data dump as my college database subject project, but I can't understand how to link the Post and its answer. I tried to link ...
user avatar
9 votes
1 answer
113 views

How to find the current top questions by number of views? Or the quarterly number of views per question?

Stack Overflow provides the total number of pageviews per question - but it doesn't tell you if those views are historical or if the question is still current. How can I find the current top questions?...
user avatar
4 votes
1 answer
74 views

How can I get the summary of questions a user ask from the Stack Overflow data dump?

I need information about how many questions a user asks, how many of them are resolved, and how many of them remain unanswered. Is there any way to get this information from the SO data dump?
user avatar
4 votes
0 answers
72 views

Use of downloaded data from data.stackexchange.com

I'm curious about data provided publicly by data.stackexchange.com. It is also available at archive.org. Can I use it for professional purpose? I would like to use only tag names.
user avatar
2 votes
1 answer
76 views

How do I know who made a post Community Wiki from the Stack Overflow data dump?

Is it possible to determine who made a post closed or community wiki and why from the Stack Overflow data dump?
user avatar
7 votes
1 answer
82 views

Is a changed nickname reflected in a user’s previous questions in the data dump?

A user is allowed to change his nickname. If a user submits a question “A” using nickname “userA” and then later on changes his nick to “userB” and submits another question “B”, in the data dump will ...
user avatar
17 votes
1 answer
806 views

Does archival interfere with attribution removal?

There was a question asking about CC BY-SA 3.0's requirement to remove attribute on request. It was brought up that automatic archives may still preserve historical information, including attribution ...
user avatar
5 votes
2 answers
250 views

Total reputation (sum of all reputations) of all Stack Overflow users?

I wanted to know if it is possible to get the total reputation of all Stack Overflow users - i.e. the sum of ALL reputation scores of ALL Stack Overflow users. I am aware that this would be a large ...
user avatar
  • 313
6 votes
0 answers
41 views

Is it possible to estimate the active reviewer population using the SEDE data?

My main site has, I think, a problem with a shrinking reviewer population, and I would like to use the SEDE data to estimate whether this is indeed the case and, if so, how bad it is and how it has ...
user avatar
  • 18.9k
3 votes
1 answer
212 views

What is Views of users in the database schema documentation?

In the Database Schema Documentation, what is the Views field for Users? It does not match the (estimated) "number of people reached" displayed for users on their profile page.
user avatar

1
2 3 4 5
10