Questions tagged [data-explorer]

For questions about the functionalities, queries, databases and datamodel of The Stack Exchange Data Explorer (SEDE). SEDE allows you to create and run queries against copies of the databases of popular Stack Exchange sites.

Filter by
Sorted by
Tagged with
379 votes
2 answers
119k views

Database schema documentation for the public data dump and SEDE

Stack Exchange releases "data dumps" of all its publicly available content roughly every three months via archive.org, and also makes that information queryable over the Internet at the ...
166 votes
31 answers
11k views

Interesting queries on Data Explorer [closed]

Let's collect some interesting queries for the Stack Exchange Data Explorer here. How many upvotes do I have for each tag? (how long before tag badges?) SELECT TOP 20 TagName, COUNT(*) AS ...
116 votes
4 answers
775 views

Beta sites should be in the Data Explorer

The Stack Exchange Data Explorer is a very nice and useful tool, but it has one very large drawback: Beta sites are not included at all. Excluding beta sites probably made a lot of sense when the ...
Mad Scientist's user avatar
105 votes
2 answers
3k views

How can I search my comments using some keyword(s)?

Here's my problem: I know I've posted something on Stack Overflow about a particular topic. I know how to search all my answers with a given keyword, and that feature works well. But, if I don't ...
Nate's user avatar
  • 1,173
102 votes
1 answer
2k views

Can some metadata about deleted posts be included in Data.SE?

I like to use Data.SE to view usage stats for some of the sites, however deleted posts are not included on Data.SE and I think this skews the numbers quite a bit, particularly on sites with a lot of ...
Rachel's user avatar
  • 19.3k
100 votes
3 answers
3k views

Why is my profile image different?

When I first signed up on a Stack Exchange site and got a profile image, it was this one (see my current user card I'm actually not sure what I look like any more): Later, I got Area 51 and SEDE ...
Laurel's user avatar
  • 52.9k
86 votes
4 answers
8k views

Planned Maintenance scheduled for Wednesday, February 5, 2020 for Data Explorer

Update: The maintenance went as planned. tl;dr; Planned service interruption that will impact Stack Exchange Data Explorer (SEDE). The site will be inaccessible for up to 12 hours on February 5, 2020 ...
Taryn's user avatar
  • 51.5k
85 votes
1 answer
7k views

"OpenID 2.0 for Google Accounts is going away"; will this affect Stack Exchange? [closed]

Apparently, for some reason, Google is retiring its OpenID 2.0 platform. I got this notice while logging in with Disqus, but not with Stack Exchange. So... is Stack Exchange going to be affected by ...
badp's user avatar
  • 33.6k
82 votes
4 answers
851 views

Let SEDE users get hold of data on unsuccessful close votes for stats

I have the feeling that with the growing influx of questions, an increasing number of questions that are clear closing candidates (i.e. it is totally obvious and undisputed that they belong closed ...
Pekka's user avatar
  • 114k
70 votes
2 answers
555 views

Delete own query on data explorer

Is it possible to delete or at least hide your own data explorer query when you know you've only been testing something and don't want it to show?
Robert Koritnik's user avatar
68 votes
3 answers
1k views

Where can I see how many posts have I edited?

I've found here many queries to check edit counts, and I get different results for each one. Which one is the most accurate and up-to-date query? Or is there any way to see the edit count in stats?
cpx's user avatar
  • 1,247
67 votes
8 answers
11k views

Implement OData API for Stack Overflow

The request is simple Implement the OData API for Stack Overflow sites Benefits: It's a standard API. OData allows the Stack Overflow database to be queried and navigated for questions, users, ...
Pop Catalin's user avatar
  • 1,081
66 votes
11 answers
4k views

The company's commitment to the data dumps, the API, and SEDE

Many words have been written around the company's commitment to the ongoing existence of the data dumps, the API, and the Stack Exchange Data Explorer (SEDE). Much of that text can be confusing or ...
Philippe's user avatar
  • 20.5k
64 votes
8 answers
3k views

Introducing the Stack Exchange Data Explorer aka SEDE

This is the announcement post of the Stack Exchange Data Explorer. Its answers were meant to iron out the initial glitches 6 to 8 years ago. If you have found a bug or need support today with any of ...
waffles's user avatar
  • 108k
55 votes
15 answers
3k views

Can we become our own "Northwind" for teaching SQL / databases?

In the Microsoft ecosystem there are some standard databases like Northwind ... The Northwind Traders sample database contains the sales data for a fictitious company called Northwind Traders, which ...
Jeff Atwood's user avatar
51 votes
5 answers
1k views

When am I going to get the generalist badge?

Can anybody muster up a query on Data Explorer that will show me my progress towards the Generalist badge?
waffles's user avatar
  • 108k
50 votes
3 answers
614 views

Please open the Hot Network Questions to auditing via the Data Explorer

One of the contentious issues on today's Stack Exchange is the Hot Network Questions sidebar, which can drive a lot of traffic to junk-food questions that can be very poor fits to the sites that host ...
E.P.'s user avatar
  • 19.5k
48 votes
3 answers
662 views

Allow cross-site queries in data explorer

I think it would be useful if we could join across databases in the data-explorer. For example, I'd like to query up a list of questions that I had a hand in migrating away from SO, and see what ...
Blorgbeard's user avatar
  • 6,173
47 votes
1 answer
650 views

Include the "People Reached" and "Helpful Flags (count)" data in SEDE

I know the new profile design hasn't been updated for every site on the network yet, so maybe this is a bit too early. Nonetheless, please include the "People Reached" data in SEDE at your ...
CRABOLO's user avatar
  • 13.5k
44 votes
1 answer
9k views

reCaptcha v1 is shutting down on March 31, but SEDE still uses it

According to this post, I thought the new recaptcha API was used network-wide. Though today, when going to SEDE (which for whatever reasons never recognized me automatically), I got this message ...
Kaiido's user avatar
  • 559
43 votes
1 answer
1k views

When will data.SE get updated data?

Zypher promised that data.SE would "soon" get live data: How to count the number of times I earned 200 daily reputation? https://chat.stackexchange.com/transcript/message/5865764#5865764 I ...
Ward - Trying Codidact's user avatar
39 votes
2 answers
822 views

Include a line number when there's a syntax error

When there's an error in a SEDE query, you just get the error message. Incorrect syntax near '*'. This can leave me guessing as to which one of the * in my query is causing the error. SSMS seems ...
Stijn's user avatar
  • 7,989
39 votes
0 answers
2k views

Planned SEDE maintenance scheduled for Sept 22, 2021 at 01:00-04:00 UTC (Sept 21 9:00 pm-midnight EDT)

Note: The originally planned second window on Sept 24 is cancelled as the upgrade was a success within the first window. Note: 2021-09-21 0225Z - Maintenance has ended. Please leave a comment if there ...
Jade Sprague's user avatar
  • 1,524
39 votes
0 answers
307 views

Why does the SEDE ReviewTaskResults table not include user data, which is all public anyway?

I wanted to do some data mining on the SEDE, and I ran across a limitation which I cannot understand. The Data Explorer table ReviewTaskResults currently contains the following information: Id ...
E.P.'s user avatar
  • 19.5k
39 votes
0 answers
465 views

Show suspended users with their normal reputation in the Data Explorer

I was playing with the Data Explorer... And I was trying to write a query to show users who got the most % of their reputation from accepts. So for each user: [% from Accepts] = [Rep from Accepts] / [...
Mysticial's user avatar
  • 19.2k
38 votes
0 answers
197 views

Let moderators mark tags as deprecated

On Super User, we have quite a few tags that shouldn't exist. Unfortunately, some of those have a lot of questions, and despite our clear directives in the tag wiki excerpt, the tags continue to be ...
Ben N's user avatar
  • 7,380
37 votes
2 answers
8k views

Which tools and technologies are used to build Data Explorer?

Which technologies you are using for building Data Explorer? This is interesting if it gets open sourced at some point in future. Do you use same stuff as with SO? C#, ASP.NET, MVC?
Juha Syrjälä's user avatar
37 votes
1 answer
277 views

Please add UserType to Stack Exchange Data Explorer

So that we can construct queries which take into account whether a user is registered or unregistered, please add the UserType field to Data Explorer. Currently there is no way to do this, since the ...
Michael Hampton's user avatar
36 votes
2 answers
6k views

Is there any place to see a leaderboard of top "Helpful Flaggers"?

There are a few members of Stack Overflow especially who have a ridiculous number of helpful flags. At the moment, there does not appear to be any way to display the top users with the most helpful ...
JonathanDavidArndt's user avatar
36 votes
3 answers
566 views

Please provide a Moderators table in the Data Explorer

Moderators are special, privileged users who should serve as an example to the rest of us. Therefore, it is natural to want to query behaviors and statistics about these model users, Like I did, for ...
Awesome Poodles's user avatar
36 votes
0 answers
325 views

Can't login to SEDE - "StackApps authentication failed"

When I try to login to the Stack Exchange Data Explorer using Stack Overflow, it fails with the following error message: StackApps authentication failed I've tried several browsers, and even in ...
Glorfindel's user avatar
  • 251k
35 votes
2 answers
9k views

Database Diagram of Stack Exchange model?

I went over the Archive site where I could retrieve data from Astronomy.SE. After I downloaded the content, I found 8 XML files that came maybe from a dump process. Now I am not able to assemble all ...
IgorAlves's user avatar
  • 485
34 votes
1 answer
264 views

The current SEDE refresh was delayed overnight

On Saturday, January 22nd, we had a failure on a backup share that won't be fully resolved until Monday. We've immediately re-routed backups to multiple secondary locations, so that concern has been ...
Aaron Bertrand's user avatar
  • 37.7k
33 votes
1 answer
559 views

SEDE is offline

Cannot access SEDE at all. Have checked with https://downforeveryoneorjustme.com/data.stackexchange.com which also says it's down.
Robert Longson's user avatar
33 votes
2 answers
602 views

Why is the ##UserID## parameter not populated in Data Explorer anymore?

Environment I'm logging in using the OpenID from http://openid.stackexchange.com and using Chrome 31.0.1650.57 m if that matters. Steps to reproduce: Log in to Data Explorer and compose a query, for ...
TLama's user avatar
  • 1,863
33 votes
2 answers
311 views

Maybe it's time to update the code base of Data Explorer?

Not talking about the data, this one appears to be updating regularly which is awesome. Talking about this: There is outdated footer (e.g. "contact us" is still a mailto: link!) and more than a ...
Shadow Wizard Love Zelda's user avatar
33 votes
1 answer
12k views

Change "Login" to "Log in" and "Logout" to "Log out"

OK, so not a bug per se, but it does 'bug' me... On the Data Explorer page, the link to log in is labelled login rather than log in. The latter is on all the other SE sites I clicked through to, so ...
Widor's user avatar
  • 2,989
32 votes
18 answers
1k views

Don't forget to mention.... SQL injection!

I've thought for a long time that answers that mention SQL injection get upvoted a lot, even if SQL injection is entirely unrelated to the question. It looks like the new data browser supports that ...
Andomar's user avatar
  • 6,201
32 votes
2 answers
3k views

Meaning of Values for PostTypeId in data explorer or in data-dump [duplicate]

I am looking for some explanation of the schema for the data dump of se sites. Specifically I'd like to know the values for PostTypeId field (1=Questions?, 2=Answers?, 3=?, etc). I have tried to ...
Unreason's user avatar
  • 707
32 votes
2 answers
371 views

Extend or remove Data Explorer timeout [duplicate]

I know that we don't have automatic login for the Data Explorer, but what's with the automatic timeout/logout? There have been times that I am logged into the site, maybe I walk away for a little bit,...
Taryn's user avatar
  • 51.5k
32 votes
0 answers
111 views

Add Post Id to Badges table when applicable

Many badges are awarded for specific posts (Great Answer, Notable Question, Publicist, Investor, etc). In such cases, the list of badges includes the post for which it was awarded. This is public ...
user avatar
32 votes
0 answers
327 views

Show successful close/reopen votes in SEDE regardless of if they've expired or not?

Currently Data.SE only show currently active close and reopen votes. Once these votes expire, they're removed from the Votes table. This makes them rather useless when trying to query anything related ...
Rachel's user avatar
  • 19.3k
31 votes
1 answer
697 views

Easy way to make local copy of entire SE database?

Recently, I have been using the Data Explorer to try to find fishy users on SO. However, the Data Explorer is limited when it comes to cross-site and time-consuming queries, so I want to create a ...
dwitvliet's user avatar
  • 1,169
30 votes
0 answers
197 views

Please add the individual close-as-off-topic reason in the Data Explorer

A couple of previous questions (How to find the actual close reason for a question? and How to determine why a question was closed from the data dump/data explorer) document the fact that it is ...
E.P.'s user avatar
  • 19.5k
29 votes
1 answer
561 views

How many posts are downvoted without a comment?

A returning theme on our beautiful and productive Meta sites is the topic on downvoting without leaving a comment. Yes, that is a bit cheeky and admit it: you've done that as well. In a recent post ...
rene's user avatar
  • 87.8k
29 votes
1 answer
313 views

How is the data explorer secured?

I understand that the SQL user probably doesn't have any sort of permission to modify the database, and that very heavy caching is probably used in addition to the fact that this is on a data dump ...
Cyclone's user avatar
  • 1,681
29 votes
3 answers
845 views

The true unsung heros

The unsung hero badge has gained a ton of popularity. So I decided to run some stats and try to find the real unsung heros on Stack Overflow. I basically created a query that counts how many zero ...
waffles's user avatar
  • 108k
29 votes
1 answer
395 views

List my downvoted posts that were edited

Consider the following situation: I downvote a question / answer with a comment The answerer / asker edits the question and improves it In that case, I think the downvote should be removed. I know ...
Amal Murali's user avatar
  • 5,239
29 votes
1 answer
428 views

Why do some comments on Russian-language sites have negative scores?

At least on two sites: SO on Russian and Русский язык SE Data Explorer returns a lot of comments with negative score [-6...-1]: Actual comments look like normal comment without upvotes. What is ...
αλεχολυτ's user avatar
29 votes
2 answers
517 views

StackExchange Data Explorer is going open source

We are almost ready to announce on the blog that we are open sourcing SEDE. Before we do that I wanted to get a bit of feedback to make sure that what we are doing makes sense and is easy to follow. ...
waffles's user avatar
  • 108k

1
2 3 4 5
32