This tag is about the quarterly creative commons data dumps of all public data in the Stack Exchange network Q&A sites.

learn more… | top users | synonyms

0
votes
0answers
17 views

Is the new statistics, number of people reached available in the data dump [duplicate]

I am interested to see how this new statistics motivate users to contribute. But in the data dump, this variable seems not to be in the data dump.
2
votes
1answer
88 views

Can Q&A be imported into new beta from the previous closed beta dump?

Is it possible or common that questions and answers from the dump of previous closed beta can be imported again into the new fresh/restarted private beta (like after the next year)? Is it something ...
3
votes
0answers
31 views

Is it possible to download the data dump only for some tags?

I've seen that it's possible to download the SO public data dump Where is Stack Overflow's public data dump? , is it possible to filter it before downloading?
2
votes
0answers
27 views

Answers voted on before answer is created in Data Explorer [duplicate]

When using the Data Explorer for Stack Overflow, I've found some cases of answers having votes before their creation date. For example, this query shows the first vote being made 2011-07-09, while the ...
4
votes
1answer
34 views

How to identify the same user in different sites in stack data dump? [duplicate]

I'm wondering if there exists a way to identify the same user across different stack exchange sites. Like Id are unique for user across this sites? If not, is there some data like information that ...
4
votes
1answer
38 views

How to access deleted question via data explorer? [duplicate]

Deleted questions only get soft-deleted. They are not shown anymore, (but accessible to >10k-rep-users). Thus, they should be available via the data dump. How would you access, say, ...
4
votes
1answer
37 views

Discrepancy between Stack Overflow data dump and live data query

When querying the live data using Data Explorer for a weekly count of unanswered, unclosed questions tagged with android, there seems to be a large discrepancy between these results and those using ...
3
votes
1answer
56 views

Sotware access to up-to-the minute SE data. Is it (a) possible (b) desirable (c) currently available?

I'm an experienced computer programmer but new to data-mining. I'd like to set up a bit of software to do a quick search on current SE information. Judging by other people's questions, I get the ...
8
votes
1answer
59 views

What is UpVotes of users in database schema documentation?

A typical child of the users.xml looks as follows: <row Id="2" Reputation="101" CreationDate="2010-07-19T14:01:36.697" DisplayName="Geoff Dalgas" ...
3
votes
1answer
52 views

Is the dump of the database behind stack exchange data explorer available?

The database on which the SEDE runs seems to be much more complete with several additional tables than the dataset available as part of the public data dump through archive.org. Some of the additional ...
6
votes
0answers
86 views

Use LZMA2 or PPMd instead of bzip2 for the data dump

Related: Can we change the compression algorithm for the data dumps (although that was claimed to be done, and the compression algorithm at the time was LZMA(2?)) I noticed when looking at the data ...
2
votes
0answers
76 views

Best way to use Stack Exchange sites offline or on dialup

I am going offline. Or rather, I will have intermittent or bad Internet access for a year, hopping on random Wi-Fi access points, crappy 3G or dialup connections. How can I keep participating here? ...
9
votes
1answer
52 views

What is the correct attribution for remixing content of answers.onstartups.com?

According to http://blog.stackoverflow.com/2012/04/when-a-site-grows-quiet/, data dumps of closed-down sites are available under the same CC BY-SA license as other data dumps. However, since the ...
1
vote
0answers
58 views

Latest stack Exchange data dump on internet archive not latest

At first, there was a problem downloding with the torrent, as you can see in the comments area here. More specifically, the downloading of stackoverflow dump data got stuck. A few days later the ...
2
votes
1answer
34 views

Strange dates in the data dump

I'm toying around with the data dump and I have a question regarding dates. Take this question for example: General suggestions for debugging R? It says the question was posted 14th December 2010, ...
3
votes
0answers
47 views

Is SODDI still working with Data Dump?

I'm following this guide: How to Query the StackExchange Databases, but when trying to connect with SQL Server 2014 it doesn't let me connect to the db. Does SODDI work for the data of January 2015? ...
3
votes
0answers
18 views

Include Impact as record in Users table [duplicate]

The new profile pages has aired with a new statistic, "People reached". This stat may have research value, but it's not provided in the data dumps. This would be useful, for example, where: ...
1
vote
1answer
64 views

Is there a site dedicated to Stack Exchange Data Explorer questions?

Where should I ask questions about the StackExchange Data Explorer? I found this page which explains that stack exchange data is dumped somewhere, and in the help section I am told to ask questions ...
3
votes
0answers
46 views

Data dump: Are vote ids in chronological order?

The timestamps of the votes in the data dump are all at time 00.00.00. Are the ids of the vote rows in chronological order? I mean, did the vote with id 1 arrive before the vote with id 2?
9
votes
1answer
231 views

Database Diagram of Stack Exchange model?

I went over the Archive site where I could retrieve data from Astronomy.SE. After I downloaded the content, I found 8 XML files that came maybe from a dump process. Now I am not able to assemble all ...
16
votes
2answers
112 views

Should we include information on whether post activity was from one of the mobile apps in the public data?

Internally, we are discussing making it easier for us to tell if post activities came via the mobile version of the site. We already have a column in the PostHistory table called ApplicationId that ...
4
votes
0answers
41 views

Missing ProfileImageUrl for many profiles in StackOverflow data dump

I noticed that in the StackOverflow data dump many profiles miss the ProfileImageUrl column. What is the reason for this, because I could still get this data by scraping all profiles that I am ...
0
votes
1answer
48 views

Access to earlier data dumps (Looking for May 2014 data dump) [duplicate]

The latest September 2014 Stack Exchange data dump is available at https://archive.org/details/stackexchange. I am interested in previous data dumps, and in May 2014 data dump (the one that was ...
0
votes
1answer
41 views

What is the purpose of PostLinks.xml in data dumps?

On the Internet Archive data dumps for Stack Exchange, there is a file called PostLinks.xml. I know from viewing the files it contains the following fields: Id, CreationDate, PostId, RelatedPostId, ...
3
votes
0answers
25 views

Data dump for closed public beta - Guitars - is not available?

I am calculating the differences between graduated betas v.s. discontinued betas for an academic paper. In order to do so, I have located closed public betas and downloaded the data dumps from each ...
0
votes
0answers
37 views

Downloading visitor statistics in bulk for beta sites

I am calculating the differences between graduated betas v.s. discontinued betas for an academic paper. One of my intended data points is visitor statistics: number of visitors, visitor demographics, ...
3
votes
1answer
43 views

Data dump that exclusively covers the beta phase of a graduated site

I am calculating the differences between graduated betas v.s. discontinued betas for an academic paper. In order to make a fair comparison - I need to compare the beta phase performance of the ...
2
votes
0answers
24 views

Why aren't files for review tasks and suggested edits or the votes on them in the data-dump?

In the data base schema (Database schema documentation for the public data dump and SEDE), there are tables called ReviewTasks, ReviewTaskResults, SuggestedEdits, and SuggestedEditVotes but there are ...
4
votes
1answer
68 views

Votes in the data-dump

I am doing a project on user behavior on StackOverflow and found a discrepancy of 538,756 when I summed post scores minus the number of up votes plus the number of down votes. Are votes that are ...
-2
votes
1answer
84 views

What is the tangible benefit to SE from legitimate “scraper” sites?

We know that some sites are "illegal" scrapers that SE does not tolerate for obvious reasons. But why does SE tolerate sites that re-post its content (scraped or from Data Dump) with correct ...
4
votes
0answers
44 views

Finding historical reputation requirements

Stack Exchange sites have different reputation thresholds that allow users to do various things. For example, on Stack Overflow, creating tags requires 1,500 reputation, while on Database ...
5
votes
1answer
73 views

Stackexchange data dump - Discrepancy of PostIDs in posts.xml and votes.xml

I am inspecting the stackexchange data dump and found a discrepancy of PostIDs included in posts.xml and votes.xml. It is obvious that there are some posts that do not have any voting activity. My ...
14
votes
0answers
227 views

Stack Exchange September 2014 Data Dump is available

The complete Stack Exchange data dump up to September 2014 is ready and can be found hosted on the Internet Archive. The latest can always be found here: https://archive.org/details/stackexchange ...
5
votes
0answers
37 views

Can I re-publish links extracted from Stack Exchange data dumps under the public domain?

After looking around and finding none, I'm trying to link as many Stack Exchange tags as possible to WikiData entities. My ultimate goal is to automatically categorize tags on Stack Overflow based on ...
0
votes
0answers
9 views

How to make a distinction between Closed and Duplicates in the public SE Dataset? [duplicate]

A while ago the official datasets of the Stack Exchange network were released [1][2]. They are represented as huge XML files that follow the database model used by SE [3]. My question is the ...
13
votes
1answer
163 views

Could we have some glazed meat substance early?

We're scheduled to get some genuine spam dumps eventually, which is awesome. But I just figured out how to run Bayesian algorithms in Python, which just happens to be the language our friendly ...
5
votes
1answer
105 views

Update frequency of SE Data Dump on Web Archive

Since there's is no clear indication of the data-dump date, a visit to the Stack Exchange Data Dump on the Web Archive is dated May 2, 2014: How frequently is this archive updated?
30
votes
1answer
331 views

Easy way to make local copy of entire SE database?

Recently, I have been using the Data Explorer to try to find fishy users on SO. However, the Data Explorer is limited when it comes to cross-site and time-consuming queries, so I want to create a ...
3
votes
0answers
48 views

dump time stamps of views and votes

I was told by team@stackoverflow.com to try to post the following as a feature-request. I'm a scientist, and a few colleagues and I are interested in how networks of tagged knowledge units(bits) ...
2
votes
1answer
62 views

Missing migration-information in the StackExchange Data Dumps

I downloaded the Stack Exchange Data Dump for space.stackexchange.com and astronomy.stackexchange.com. As listed here, the PostHistoryTypeId of the PostHistory.xml-Files should be "17" if a post was ...
12
votes
1answer
150 views

My project requires data from Stack Overflow. What can I do?

I want to make research on Stack Overflow (or any other Stack Exchange website). How can I parse the website's data using regular expressions?
3
votes
1answer
73 views

Site Names in stackexchange_files.xml

I am working with the StackExchange data dump, thanks ot StackExchange's splendid work, the data can not only be processed very conveniently, but also downloaded automatically, based on the files list ...
12
votes
0answers
154 views

Does Stack Exchange Track Clicks to “Hot Network Questions”

I'd love to make or see a graph analysis of click-throughs from Stack Overflow to other community's questions. I expect to see attractors that SO types tend to fall into (e.g. RPGs). Does Stack ...
4
votes
1answer
118 views

Stack Overflow files in data dump not having .xml extension

I am working on a project where I am doing some NLP analyses on various Stack Exchange sites, and I downloaded the data dump made public by Stack Exchange at this link. When I downloaded and ...
3
votes
1answer
65 views

Is there any table for users' activity on data dump?

I haven't found any table that has user history information in the Stack Exchange Data Dump. For example, when a specific user has asked, answered, commented, edited and his answer is accepted. ...
3
votes
1answer
40 views

Are Data Explorer Queries included in the Data Dump?

Since the Data Dump includes all the Stack Exchange sites, is Data Explorer included? If not, is there a way to backup queries besides copy/paste?
3
votes
1answer
45 views

What is CompletedByReviewTaskId in the ReviewTasks table?

Could someone clarify what is the field "CompletedByReviewTaskId" in the "ReviewTasks" table in the stackexchange schema? Is this the userId of the user who completed the review?
1
vote
1answer
128 views

What is the meaning of postlinks table?

I have look into Database schema documentation for the public data dump and SEDE. But there is no explanation about postlinks table. Can anyone explain me the meaning of each column of that table?
5
votes
0answers
39 views

Expose SuggestedEditVotes in the data dump

I'd like to use the SuggestedEditVotes table (which is available in SEDE) to find robo-reviewers. I'm often offline without connection to SEDE, and I want to do something remotely productive during ...
21
votes
1answer
3k views

All Stack Exchange data dumps

The original ClearBits link to the September 2011 data dump has broken. How can I access it and other previous data dumps? The Internet Archive only has the latest one.