This tag is about the quarterly creative commons data dumps of all public data in the Stack Exchange network Q&A sites.

learn more… | top users | synonyms

1
vote
1answer
38 views

Tag Info data from the Stack Overflow data dump

Where can I get the tag info data? Is it available in the Stack Overflow data dump? (I've only been able to find the tags and their counts so far.)
4
votes
1answer
27 views

The SitesList.xml on archive.org for the Jan 2016 data dump is blank

See https://archive.org/download/stackexchange, specifically: It looks like what used to be called Sites.xml is now called SitesList.xml. Presumably it's supposed to have the same information ...
-10
votes
1answer
65 views

How to access user last connection IP address on profile

I'm doing some work on the network analysis of a Stack Exchange community. I need the location of its users, but as you know, not everyone fills in the Location field. I find the ...
0
votes
0answers
33 views

Add the DeletionDate column to the archiv.org data dump or create a PostsWithDeleted table

The latest data dump has: no DeletionDate column no PostsWithDeleted table but it does contain deleted posts. This makes it hard to decide if posts are deleted or not. I think I could extract ...
10
votes
3answers
183 views

Dump of my own Stack Exchange content

Is there a way to quickly save all my Stack Exchange content across all Stack Exchange sites, as hundreds of HTML pages? (for me probably 15 or 20 sites: SO, dsp.SE, unix.SE, etc.)? The ideal way ...
1
vote
1answer
37 views

Stack Exchange SQL dumps don't contain answers? [duplicate]

Stack Exchange provides database dumps on this link. However, the structure of files don't contain answers. It has only: Badges, Comments, PostLinks, PostHistory, Posts, Tags, Users, and Votes. In ...
8
votes
0answers
38 views

Stack Exchange Data Explorer and Stack Exchange Data Dumps should include public chat room messages

All data from public chat rooms should be available in the data dumps and queryable in the Stack Exchange Data Explorer. Of course, deleted messages should not be available (since the general public ...
7
votes
1answer
83 views

“Data Error Sub items Errors: 1” when decompressing stackoverflow.com-Posts.7z from the Stack Exchange Data Dump

I've downloaded the Torrent version of https://archive.org/details/stackexchange and selected only the files that I need with Transmission. I then tried to extract with: sudo apt-get install ...
1
vote
1answer
35 views

Download Posttags table from Stack Exchange

I am working on some analysis on Stack Exchange data, and I want to download the Posttags table in CSV or XML format. But the problem is, this table is not available in the archive, and it has a large ...
5
votes
0answers
36 views

When do we merge the content of a closed beta site with an existing site?

I was searching for closed beta sites and I found them. These are the beta sites that were closed and their data dump of questions is downloadable on Area 51 Open Science Machine Learning Game Theory ...
9
votes
1answer
182 views

What are the indices used in SEDE?

I'm writing an application that uses the Stack Exchange Data Dump. I've imported the most recent dump into SQL Server 2014 on my local development machine. I wrote a query that runs very slowly on my ...
4
votes
1answer
53 views

Where can I find an app to serve the Stackexchange Data Dump content in a friendly UI?

I am working with an organization that is teaching coding to inmates in a prison. Our students do not have a lot; passion, dedication, commitment, intelligence, but they do not have internet access. ...
9
votes
1answer
58 views

Unsolicited email used email hash from data dump

Today, I received an unsolicited email (albeit one that isn't selling a commercial product) from a researcher, who is a user on Stack Overflow. From the unsolicited email itself: Using data from ...
3
votes
0answers
41 views

Can we get the StackExchange Data Dump as an SQL file?

Currently, the data dumps that are released periodically are MDF files. Would it possible to release them in the SQL format as well, to make it easier for MySQL users to use the data?
-14
votes
1answer
143 views

Where is the Markdown used in the About Me section of profiles stored?

After examining the SEDE documentation, poking around with a few queries, and reading How do you cross the 3k character limit for About Me?, I learned that the Markdown for questions and answers are ...
4
votes
0answers
47 views

Precision about the Stack Exchange Data Dump attribution requirements

I have an issue with the attribution requirements for the Stack Exchange Data Dump. For references, data are under CC BY-SA license and the requirements are : Visually indicate that the content is ...
9
votes
0answers
59 views

Why has the closed beta site “Big Data” no dump available?

I wonder why the closed beta site Big Data has no dump available.
2
votes
1answer
54 views

How can SEDE be utilized to find potential plagiarism on Stack Exchange sites?

This is a cross-post from How can SEDE be utilized to find potential plagiarism on Stack Overflow? Although it was written with Stack Overflow in mind, the tools and techniques involved should be able ...
-13
votes
1answer
133 views

Is StackExchange legally obliged to periodically release data dumps of all sites?

The question is sparked from this answer and the discussion below it. Is there anything that obliges StackExchange to periodically release data dumps (and keep the already released data dumps ...
4
votes
1answer
115 views

Why is the Stack Exchange Data Dump only available in xml file format?

The Stack Exchange Data Dump is very large at about 22 GB. The xml file for Stack Overflow's users is around 900 MB (about 100 MB when compressed). The format of this file is something like, ...
10
votes
0answers
78 views

Why no russia-stackoverflow data in Stack Exchange Data Dump (August 18, 2015)

I found that recently Stack Exchange updated their data dump in Internet Archive but I do not find data about Russia-Stackoverflow. I can find similar ones such as data dump of Japanese-Stackoverflow ...
10
votes
2answers
248 views

When was the last data dump uploaded to archive.org?

The publishing date on archive.org/details/stackexchange is 16th March 2015 Stack Exchange Data Dump by Stack Exchange, Inc. Published March 16, 2015 Usage Attribution-Share Alike 3.0 ...
0
votes
0answers
18 views

Is the new statistics, number of people reached available in the data dump [duplicate]

I am interested to see how this new statistics motivate users to contribute. But in the data dump, this variable seems not to be in the data dump.
3
votes
1answer
127 views

Can Q&A be imported into new beta from the previous closed beta dump?

Is it possible or common that questions and answers from the dump of previous closed beta can be imported again into the new fresh/restarted private beta (like after the next year)? Is it something ...
3
votes
0answers
37 views

Is it possible to download the data dump only for some tags?

I've seen that it's possible to download the SO public data dump Where is Stack Overflow's public data dump? , is it possible to filter it before downloading?
2
votes
0answers
31 views

Answers voted on before answer is created in Data Explorer [duplicate]

When using the Data Explorer for Stack Overflow, I've found some cases of answers having votes before their creation date. For example, this query shows the first vote being made 2011-07-09, while the ...
4
votes
1answer
42 views

How to identify the same user in different sites in stack data dump? [duplicate]

I'm wondering if there exists a way to identify the same user across different stack exchange sites. Like Id are unique for user across this sites? If not, is there some data like information that ...
4
votes
1answer
53 views

How to access deleted question via data explorer? [duplicate]

Deleted questions only get soft-deleted. They are not shown anymore, (but accessible to >10k-rep-users). Thus, they should be available via the data dump. How would you access, say, ...
4
votes
1answer
48 views

Discrepancy between Stack Overflow data dump and live data query

When querying the live data using Data Explorer for a weekly count of unanswered, unclosed questions tagged with android, there seems to be a large discrepancy between these results and those using ...
3
votes
1answer
59 views

Sotware access to up-to-the minute SE data. Is it (a) possible (b) desirable (c) currently available?

I'm an experienced computer programmer but new to data-mining. I'd like to set up a bit of software to do a quick search on current SE information. Judging by other people's questions, I get the ...
9
votes
1answer
106 views

What is UpVotes of users in database schema documentation?

A typical child of the users.xml looks as follows: <row Id="2" Reputation="101" CreationDate="2010-07-19T14:01:36.697" DisplayName="Geoff Dalgas" ...
3
votes
1answer
59 views

Is the dump of the database behind stack exchange data explorer available?

The database on which the SEDE runs seems to be much more complete with several additional tables than the dataset available as part of the public data dump through archive.org. Some of the additional ...
9
votes
0answers
440 views

Use LZMA2 or PPMd instead of bzip2 for the data dump

Related: Can we change the compression algorithm for the data dumps (although that was claimed to be done, and the compression algorithm at the time was LZMA(2?)) I noticed when looking at the data ...
3
votes
1answer
117 views

Best way to use Stack Exchange sites offline or on dialup

I am going offline. Or rather, I will have intermittent or bad Internet access for a year, hopping on random Wi-Fi access points, crappy 3G or dialup connections. How can I keep participating here? ...
9
votes
1answer
69 views

What is the correct attribution for remixing content of answers.onstartups.com?

According to http://blog.stackoverflow.com/2012/04/when-a-site-grows-quiet/, data dumps of closed-down sites are available under the same CC BY-SA license as other data dumps. However, since the ...
2
votes
0answers
99 views

Latest stack Exchange data dump on internet archive not latest

At first, there was a problem downloding with the torrent, as you can see in the comments area here. More specifically, the downloading of stackoverflow dump data got stuck. A few days later the ...
2
votes
1answer
35 views

Strange dates in the data dump

I'm toying around with the data dump and I have a question regarding dates. Take this question for example: General suggestions for debugging R? It says the question was posted 14th December 2010, ...
3
votes
0answers
48 views

Is SODDI still working with Data Dump?

I'm following this guide: How to Query the StackExchange Databases, but when trying to connect with SQL Server 2014 it doesn't let me connect to the db. Does SODDI work for the data of January 2015? ...
3
votes
0answers
19 views

Include Impact as record in Users table [duplicate]

The new profile pages has aired with a new statistic, "People reached". This stat may have research value, but it's not provided in the data dumps. This would be useful, for example, where: ...
1
vote
1answer
72 views

Is there a site dedicated to Stack Exchange Data Explorer questions?

Where should I ask questions about the StackExchange Data Explorer? I found this page which explains that stack exchange data is dumped somewhere, and in the help section I am told to ask questions ...
3
votes
0answers
46 views

Data dump: Are vote ids in chronological order?

The timestamps of the votes in the data dump are all at time 00.00.00. Are the ids of the vote rows in chronological order? I mean, did the vote with id 1 arrive before the vote with id 2?
12
votes
1answer
424 views

Database Diagram of Stack Exchange model?

I went over the Archive site where I could retrieve data from Astronomy.SE. After I downloaded the content, I found 8 XML files that came maybe from a dump process. Now I am not able to assemble all ...
16
votes
2answers
116 views

Should we include information on whether post activity was from one of the mobile apps in the public data?

Internally, we are discussing making it easier for us to tell if post activities came via the mobile version of the site. We already have a column in the PostHistory table called ApplicationId that ...
4
votes
0answers
47 views

Missing ProfileImageUrl for many profiles in StackOverflow data dump

I noticed that in the StackOverflow data dump many profiles miss the ProfileImageUrl column. What is the reason for this, because I could still get this data by scraping all profiles that I am ...
0
votes
1answer
53 views

Access to earlier data dumps (Looking for May 2014 data dump) [duplicate]

The latest September 2014 Stack Exchange data dump is available at https://archive.org/details/stackexchange. I am interested in previous data dumps, and in May 2014 data dump (the one that was ...
0
votes
1answer
52 views

What is the purpose of PostLinks.xml in data dumps?

On the Internet Archive data dumps for Stack Exchange, there is a file called PostLinks.xml. I know from viewing the files it contains the following fields: Id, CreationDate, PostId, RelatedPostId, ...
3
votes
0answers
26 views

Data dump for closed public beta - Guitars - is not available?

I am calculating the differences between graduated betas v.s. discontinued betas for an academic paper. In order to do so, I have located closed public betas and downloaded the data dumps from each ...
0
votes
0answers
44 views

Downloading visitor statistics in bulk for beta sites

I am calculating the differences between graduated betas v.s. discontinued betas for an academic paper. One of my intended data points is visitor statistics: number of visitors, visitor demographics, ...
3
votes
1answer
46 views

Data dump that exclusively covers the beta phase of a graduated site

I am calculating the differences between graduated betas v.s. discontinued betas for an academic paper. In order to make a fair comparison - I need to compare the beta phase performance of the ...
2
votes
0answers
27 views

Why aren't files for review tasks and suggested edits or the votes on them in the data-dump?

In the data base schema (Database schema documentation for the public data dump and SEDE), there are tables called ReviewTasks, ReviewTaskResults, SuggestedEdits, and SuggestedEditVotes but there are ...