This tag is about the quarterly creative commons data dumps of all public data in the Stack Exchange network Q&A sites.

learn more… | top users | synonyms

4
votes
0answers
38 views

Finding historical reputation requirements

Stack Exchange sites have different reputation thresholds that allow users to do various things. For example, on Stack Overflow, creating tags requires 1,500 reputation, while on Database ...
5
votes
1answer
40 views

Stackexchange data dump - Discrepancy of PostIDs in posts.xml and votes.xml

I am inspecting the stackexchange data dump and found a discrepancy of PostIDs included in posts.xml and votes.xml. It is obvious that there are some posts that do not have any voting activity. My ...
14
votes
0answers
134 views

Stack Exchange September 2014 Data Dump is available

The complete Stack Exchange data dump up to September 2014 is ready and can be found hosted on the Internet Archive. The latest can always be found here: https://archive.org/details/stackexchange ...
3
votes
0answers
28 views

Can I re-publish links extracted from Stack Exchange data dumps under the public domain?

After looking around and finding none, I'm trying to link as many Stack Exchange tags as possible to WikiData entities. My ultimate goal is to automatically categorize tags on Stack Overflow based on ...
0
votes
0answers
9 views

How to make a distinction between Closed and Duplicates in the public SE Dataset? [duplicate]

A while ago the official datasets of the Stack Exchange network were released [1][2]. They are represented as huge XML files that follow the database model used by SE [3]. My question is the ...
13
votes
1answer
150 views

Could we have some glazed meat substance early?

We're scheduled to get some genuine spam dumps eventually, which is awesome. But I just figured out how to run Bayesian algorithms in Python, which just happens to be the language our friendly ...
5
votes
1answer
77 views

Update frequency of SE Data Dump on Web Archive

Since there's is no clear indication of the data-dump date, a visit to the Stack Exchange Data Dump on the Web Archive is dated May 2, 2014: How frequently is this archive updated?
26
votes
1answer
211 views

Easy way to make local copy of entire SE database?

Recently, I have been using the Data Explorer to try to find fishy users on SO. However, the Data Explorer is limited when it comes to cross-site and time-consuming queries, so I want to create a ...
3
votes
0answers
41 views

dump time stamps of views and votes

I was told by team@stackoverflow.com to try to post the following as a feature-request. I'm a scientist, and a few colleagues and I are interested in how networks of tagged knowledge units(bits) ...
2
votes
1answer
58 views

Missing migration-information in the StackExchange Data Dumps

I downloaded the Stack Exchange Data Dump for space.stackexchange.com and astronomy.stackexchange.com. As listed here, the PostHistoryTypeId of the PostHistory.xml-Files should be "17" if a post was ...
12
votes
1answer
109 views

My project requires data from Stack Overflow. What can I do?

I want to make research on Stack Overflow (or any other Stack Exchange website). How can I parse the website's data using regular expressions?
3
votes
1answer
62 views

Site Names in stackexchange_files.xml

I am working with the StackExchange data dump, thanks ot StackExchange's splendid work, the data can not only be processed very conveniently, but also downloaded automatically, based on the files list ...
6
votes
0answers
82 views

Does Stack Exchange Track Clicks to “Hot Network Questions”

I'd love to make or see a graph analysis of click-throughs from Stack Overflow to other community's questions. I expect to see attractors that SO types tend to fall into (e.g. RPGs). Does Stack ...
4
votes
1answer
52 views

Stack Overflow files in data dump not having .xml extension

I am working on a project where I am doing some NLP analyses on various Stack Exchange sites, and I downloaded the data dump made public by Stack Exchange at this link. When I downloaded and ...
3
votes
1answer
56 views

Is there any table for users' activity on data dump?

I haven't found any table that has user history information in the Stack Exchange Data Dump. For example, when a specific user has asked, answered, commented, edited and his answer is accepted. ...
3
votes
1answer
38 views

Are Data Explorer Queries included in the Data Dump?

Since the Data Dump includes all the Stack Exchange sites, is Data Explorer included? If not, is there a way to backup queries besides copy/paste?
3
votes
1answer
42 views

What is CompletedByReviewTaskId in the ReviewTasks table?

Could someone clarify what is the field "CompletedByReviewTaskId" in the "ReviewTasks" table in the stackexchange schema? Is this the userId of the user who completed the review?
1
vote
1answer
57 views

What is the meaning of postlinks table?

I have look into Database schema documentation for the public data dump and SEDE. But there is no explanation about postlinks table. Can anyone explain me the meaning of each column of that table?
5
votes
0answers
38 views

Expose SuggestedEditVotes in the data dump

I'd like to use the SuggestedEditVotes table (which is available in SEDE) to find robo-reviewers. I'm often offline without connection to SEDE, and I want to do something remotely productive during ...
10
votes
1answer
269 views

Stack Exchange data dumps for previous years

The ClearBits link to the September 2011 Stack Exchange data dump has broken. Can anyone help me access previous year's data dumps? I would like to download the Stack Exchange data dump for September ...
2
votes
0answers
34 views

Update posts to reflect Stack Exchange data dump hosted by the Internet Archive

I have updated a couple of answers with the new data dump location. I suggest reviewing and updating a few of the dozen or so questions/answers that refer to old locations, that suggested Amazon, ...
0
votes
0answers
25 views

where is the previous data dump of stack overflow [duplicate]

As far as I know, the previous version of data dump of stackoverflow is on clearbits.net. However, recently, I cannot find them. I even cannot access clearbits website. Right now, I can only find the ...
2
votes
1answer
65 views

why in the stackoverflow 2014 data dump, the files of meta.stackoverflow began on 2009-06

I checked the meta.stackoverflow, the earliest post should be on Aug-05 2008. However, in the stackoverflow 2014 data dump, the files of meta.stackoverflow began on 2009-06. So where is the data in ...
0
votes
0answers
62 views

Data Dump- Tags missing from internet archive torrent

I have downloaded the data dump of stack overflow and I am trying to find a link between users and tags. For example : https://stackoverflow.com/users/446515/vache?tab=tags this person has 276 tags ...
5
votes
0answers
52 views

Is there a reason why tag pages aren't part of the data dump? [duplicate]

Tag excerpts and tag wikis are cc-by-sa licensed content, just like the rest of the content, but they don't appear in the dumps. Shouldn't they be included as well?
7
votes
1answer
168 views

Where did EmailHash go?

There are at least four ways to get to StackExchange data: OData (http://data.stackexchange.com/stackoverflow/atom/), Data Explorer (http://data.stackexchange.com/), XML data dumps ...
-17
votes
2answers
115 views

Request for linked voting in data dump

I am interested in analyzing directed voting behavior of users in relation to their reputation on stackoverflow. Since voting is an anonymous activity for obvious reasons, I was hoping that I could ...
3
votes
1answer
46 views

Add date to data dump download

Current StackExchange data dumps are available via torrents: However, there's no reference of the extraction date; you have to find this in the FAQ at the bottom of the page. Would it be possible ...
3
votes
0answers
95 views

Internet Archive Dump of StackExchange Data [duplicate]

The new dump of StackExchange data that has been posted on Internet Archive, does it contain previous snapshots of the data or does it just contain the snapshot at Jan 20th,2014. If it does not ...
4
votes
0answers
44 views

Access to the stack-exchange data dump [duplicate]

I would like to access the Stack Exchange data dump. I am aware the dump is available as torrent download through ClearBits, however clearbits is currently down (since at least December 2013 - when I ...
22
votes
1answer
1k views

Is there a problem with the ClearBits data dump?

I tried to connect to http://www.clearbits.net/creators/146-stack-exchange-data-dump and got an error message: ERR_ADDRESS_UNREACHABLE. Is this a known problem? Do you expect that the problem ...
25
votes
2answers
251 views

Stack Exchange and Stack Overflow in eBook Format

I just finished a project to convert SE data-dumps into draft PDF eBooks, which I'm calling SE2go. SE2go eBooks are interactive, they contain all the original links within the question and answer ...
1
vote
0answers
55 views

CC Data-dump: Are images included?

I am wondering whether images that are embedded into posts are included in the cc data dumps? If so, how?
6
votes
1answer
89 views

A better way to find questions that interest me, with machine learning

Stackoverflow uses a fairly good heuristic to choose a selection of interesting questions on the homepage for each user. But lately I get the feeling that it is failing for me. Or the actual ratio ...
2
votes
1answer
93 views

Do you have to change Data Dump XML's to a SQL database before using Data Explorer?

I'm going to use the latest Data Dump (September) and do some SQL queries along with it. The code for the Data Explorer (located here) explains how to use the Data Dumps with it. However, it doesn't ...
0
votes
1answer
114 views

Any help hosting a closed site?

With the site "On Startups" recently closed, I understand that its content now is only available via Data Dump. It is however much less user-friendly. I wonder if SE can provide any help hosting it in ...
0
votes
0answers
76 views

Is a smart query service for stackexchange sites welcome here?

StackExchange sites has been a great source for me to find answers to many technical questions, but sometimes I needs a little more than what a generic search engine can provided. Having the ...
5
votes
0answers
131 views

Correlation between Good Questions and Good Answers (research post)

Thanks to large amount of meta-data available on the SE network, data mining seems to be a popular activity, so much so that it was a sponsored activity on Kaggle awhile back. No surprise then that ...
15
votes
1answer
232 views

Why are there so few posts with zero comments?

While researching my theory that showing comments costs votes, I noticed that there are surprisingly few posts with zero comments. Here's what the distribution looks like: That graph was generated ...
50
votes
6answers
455 views

Please add close flags, duplicate links and review data to the public data dump

Over the past year, a lot of meta data has been changed or added to the system: Review tasks and results Duplicate links (separate from close votes and ad-hoc editing conventions) Close votes as a ...
6
votes
3answers
169 views

When is the ideal time to hold a chat room event to accommodate the most users, in particular users with close vote privileges?

I wanted to run a weekly, 1-hour event, and initially set the time, somewhat haphazardly, to my lunch hour, 9:00pm UTC (as I expected to be alone in participation at first anyway). However, several ...
2
votes
0answers
73 views

How does SO maintains tagging table [duplicate]

While checking SO data dump I have noticed that SO stores tags as an array inside Post table. And at the same time there is a mapping table with TagId and PostId. I assume this is used for tag ...
4
votes
1answer
142 views

Data Dump Vs. API [duplicate]

I was looking around the API and felt guilty in setting up a nasty code in order to build a datadump. Just to check before doing it, there is no Stack archives available ? something like ...
3
votes
0answers
70 views

Posts.xml doesn't contain tags information

For a personal project I'm using stack overflow data dump in order to make suggestion to the user using StackOverflow's posts. In this work I need also to retrieve information about tags which were ...
20
votes
1answer
3k views

Is there a direct download link with a raw data dump of Stack Overflow? (not a torrent)

I would like to create a local MySQL copy of Stack Overflow for academic purposes (school project). As far as I know, the database dump of the stackoverflow.com database is available only in an XML ...
2
votes
1answer
297 views

Selecting interesting questions by means of more sophisticated analysis

I’m thinking about possibility to make more sophisticated SE data dumps analysis in order to select most interesting questions. Maybe not a problem for SO because huge number of questions have ...
0
votes
0answers
76 views

Can't download the data dump

I want to download the data dump - but I am getting a 404 error. This may because there are 0 seeds in the swarm. Can I get the data dump?
4
votes
1answer
88 views

Is it allowed to use the content of a (not-closed) SE site to A new Q & A site based on an SE clone?

Related: Is it allowed to read the data dump of a closed SE site into a clone SE site model to start a new Q&A site? Similar to the related question, but what if the site is not closed? ...
14
votes
1answer
226 views

Is it allowed to read the data dump of a closed SE site into a clone SE site model to start a new Q&A site?

Is it allowed to read the data dump of a closed SE site into one of the Stack Exchange site models listed for example here and use it as a base of questions to start a new Q&A site (or continue ...
9
votes
0answers
234 views

Why Data Explorer and StackOverflow data dump have different schemas?

I have downloaded the StackOverflow data dump and imported it into a Mysql DataBase. There were six XML files in the dump, so I created six tables, one for each XML file present in the dump. The ...