Questions tagged [data-explorer]
For questions about the functionalities, queries, databases and datamodel of The Stack Exchange Data Explorer (SEDE). SEDE allows you to create and run queries against copies of the databases of popular Stack Exchange sites.
1,518
questions
371
votes
2
answers
106k
views
Database schema documentation for the public data dump and SEDE
Stack Exchange releases "data dumps" of all its publicly available content roughly every three months via archive.org, and also makes that information queryable over the Internet at the ...
164
votes
31
answers
11k
views
Interesting queries on Data Explorer [closed]
Let's collect some interesting queries for the Stack Exchange Data Explorer here.
How many upvotes do I have for each tag? (how long before tag badges?)
SELECT TOP 20
TagName,
COUNT(*) AS ...
115
votes
4
answers
768
views
Beta sites should be in the Data Explorer
The Stack Exchange Data Explorer is a very nice and useful tool, but it has one very large drawback: Beta sites are not included at all.
Excluding beta sites probably made a lot of sense when the ...
- 175k
103
votes
2
answers
3k
views
How can I search my comments using some keyword(s)?
Here's my problem: I know I've posted something on Stack Overflow about a particular topic. I know how to search all my answers with a given keyword, and that feature works well. But, if I don't ...
- 1,153
100
votes
1
answer
2k
views
Can some metadata about deleted posts be included in Data.SE?
I like to use Data.SE to view usage stats for some of the sites, however deleted posts are not included on Data.SE and I think this skews the numbers quite a bit, particularly on sites with a lot of ...
- 19.3k
98
votes
3
answers
2k
views
Why is my profile image different?
When I first signed up on a Stack Exchange site and got a profile image, it was this one (see my current user card I'm actually not sure what I look like any more):
Later, I got Area 51 and SEDE ...
- 40.8k
87
votes
4
answers
8k
views
Planned Maintenance scheduled for Wednesday, February 5, 2020 for Data Explorer
Update: The maintenance went as planned.
tl;dr; Planned service interruption that will impact Stack Exchange Data Explorer (SEDE). The site will be inaccessible for up to 12 hours on February 5, 2020 ...
- 51.3k
85
votes
1
answer
7k
views
"OpenID 2.0 for Google Accounts is going away"; will this affect Stack Exchange? [closed]
Apparently, for some reason, Google is retiring its OpenID 2.0 platform. I got this notice while logging in with Disqus, but not with Stack Exchange.
So... is Stack Exchange going to be affected by ...
- 33.4k
82
votes
4
answers
835
views
Let SEDE users get hold of data on unsuccessful close votes for stats
I have the feeling that with the growing influx of questions, an increasing number of questions that are clear closing candidates (i.e. it is totally obvious and undisputed that they belong closed ...
- 113k
70
votes
2
answers
541
views
Delete own query on data explorer
Is it possible to delete or at least hide your own data explorer query when you know you've only been testing something and don't want it to show?
- 2,087
68
votes
3
answers
987
views
Where can I see how many posts have I edited?
I've found here many queries to check edit counts, and I get different results for each one. Which one is the most accurate and up-to-date query? Or is there any way to see the edit count in stats?
- 1,237
67
votes
8
answers
11k
views
Implement OData API for Stack Overflow
The request is simple
Implement the OData API for Stack Overflow sites
Benefits:
It's a standard API.
OData allows the Stack Overflow database to be queried and navigated for questions, users, ...
- 1,081
63
votes
8
answers
3k
views
Introducing the Stack Exchange Data Explorer aka SEDE
This is the announcement post of the Stack Exchange Data Explorer. Its answers were meant to iron out the initial glitches 6 to 8 years ago.
If you have found a bug or need support today with any of ...
- 108k
53
votes
15
answers
2k
views
Can we become our own "Northwind" for teaching SQL / databases?
In the Microsoft ecosystem there are some standard databases like Northwind ...
The Northwind Traders sample database contains the sales data for a fictitious company called Northwind Traders, which ...
- 308k
50
votes
5
answers
1k
views
When am I going to get the generalist badge?
Can anybody muster up a query on Data Explorer that will show me my progress towards the Generalist badge?
- 108k
50
votes
3
answers
603
views
Please open the Hot Network Questions to auditing via the Data Explorer
One of the contentious issues on today's Stack Exchange is the Hot Network Questions sidebar, which can drive a lot of traffic to junk-food questions that can be very poor fits to the sites that host ...
- 19.3k
48
votes
3
answers
595
views
Allow cross-site queries in data explorer
I think it would be useful if we could join across databases in the data-explorer.
For example, I'd like to query up a list of questions that I had a hand in migrating away from SO, and see what ...
- 6,135
46
votes
1
answer
624
views
Include the "People Reached" and "Helpful Flags (count)" data in SEDE
I know the new profile design hasn't been updated for every site on the network yet, so maybe this is a bit too early. Nonetheless, please include the "People Reached" data in SEDE at your ...
- 13.5k
43
votes
1
answer
1k
views
When will data.SE get updated data?
Zypher promised that data.SE would "soon" get live data:
How to count the number of times I earned 200 daily reputation?
https://chat.stackexchange.com/transcript/message/5865764#5865764
I ...
- 11.9k
43
votes
1
answer
9k
views
reCaptcha v1 is shutting down on March 31, but SEDE still uses it
According to this post, I thought the new recaptcha API was used network-wide.
Though today, when going to SEDE (which for whatever reasons never recognized me automatically), I got this message ...
- 549
39
votes
2
answers
792
views
Include a line number when there's a syntax error
When there's an error in a SEDE query, you just get the error message.
Incorrect syntax near '*'.
This can leave me guessing as to which one of the * in my query is causing the error.
SSMS seems ...
- 7,989
39
votes
0
answers
2k
views
Planned SEDE maintenance scheduled for Sept 22, 2021 at 01:00-04:00 UTC (Sept 21 9:00 pm-midnight EDT)
Note: The originally planned second window on Sept 24 is cancelled as the upgrade was a success within the first window.
Note: 2021-09-21 0225Z - Maintenance has ended. Please leave a comment if there ...
Jade SpragueStaff
- 1,514
39
votes
0
answers
300
views
Why does the SEDE ReviewTaskResults table not include user data, which is all public anyway?
I wanted to do some data mining on the SEDE, and I ran across a limitation which I cannot understand.
The Data Explorer table ReviewTaskResults currently contains the following information:
Id
...
- 19.3k
39
votes
0
answers
454
views
Show suspended users with their normal reputation in the Data Explorer
I was playing with the Data Explorer... And I was trying to write a query to show users who got the most % of their reputation from accepts.
So for each user: [% from Accepts] = [Rep from Accepts] / [...
- 19.2k
38
votes
0
answers
196
views
Let moderators mark tags as deprecated
On Super User, we have quite a few tags that shouldn't exist. Unfortunately, some of those have a lot of questions, and despite our clear directives in the tag wiki excerpt, the tags continue to be ...
- 7,330
37
votes
2
answers
7k
views
Which tools and technologies are used to build Data Explorer?
Which technologies you are using for building Data Explorer? This is interesting if it gets open sourced at some point in future. Do you use same stuff as with SO? C#, ASP.NET, MVC?
- 4,338
37
votes
1
answer
276
views
Please add UserType to Stack Exchange Data Explorer
So that we can construct queries which take into account whether a user is registered or unregistered, please add the UserType field to Data Explorer.
Currently there is no way to do this, since the ...
- 9,091
36
votes
0
answers
317
views
Can't login to SEDE - "StackApps authentication failed"
When I try to login to the Stack Exchange Data Explorer using Stack Overflow, it fails with the following error message:
StackApps authentication failed
I've tried several browsers, and even in ...
GlorfindelMod
- 239k
34
votes
3
answers
549
views
Please provide a Moderators table in the Data Explorer
Moderators are special, privileged users who should serve as an example to the rest of us. Therefore, it is natural to want to query behaviors and statistics about these model users, Like I did, for ...
- 20.5k
34
votes
1
answer
239
views
The current SEDE refresh was delayed overnight
On Saturday, January 22nd, we had a failure on a backup share that won't be fully resolved until Monday.
We've immediately re-routed backups to multiple secondary locations, so that concern has been ...
Aaron BertrandStaff
- 34.8k
33
votes
2
answers
8k
views
Database Diagram of Stack Exchange model?
I went over the Archive site where I could retrieve data from Astronomy.SE. After I downloaded the content, I found 8 XML files that came maybe from a dump process.
Now I am not able to assemble all ...
- 465
33
votes
1
answer
554
views
SEDE is offline
Cannot access SEDE at all.
Have checked with https://downforeveryoneorjustme.com/data.stackexchange.com which also says it's down.
- 30.8k
33
votes
2
answers
6k
views
Is there any place to see a leaderboard of top "Helpful Flaggers"?
There are a few members of Stack Overflow especially who have a ridiculous number of helpful flags.
At the moment, there does not appear to be any way to display the top users with the most helpful ...
- 1,175
33
votes
2
answers
597
views
Why is the ##UserID## parameter not populated in Data Explorer anymore?
Environment
I'm logging in using the OpenID from http://openid.stackexchange.com and using Chrome 31.0.1650.57 m if that matters.
Steps to reproduce:
Log in to Data Explorer and compose a query, for ...
- 1,873
33
votes
2
answers
311
views
Maybe it's time to update the code base of Data Explorer?
Not talking about the data, this one appears to be updating regularly which is awesome.
Talking about this:
There is outdated footer (e.g. "contact us" is still a mailto: link!) and more than a ...
33
votes
1
answer
12k
views
Change "Login" to "Log in" and "Logout" to "Log out"
OK, so not a bug per se, but it does 'bug' me...
On the Data Explorer page, the link to log in is labelled login rather than log in. The latter is on all the other SE sites I clicked through to, so ...
- 2,959
32
votes
18
answers
1k
views
Don't forget to mention.... SQL injection!
I've thought for a long time that answers that mention SQL injection get upvoted a lot, even if SQL injection is entirely unrelated to the question. It looks like the new data browser supports that ...
- 6,181
32
votes
2
answers
3k
views
Meaning of Values for PostTypeId in data explorer or in data-dump [duplicate]
I am looking for some explanation of the schema for the data dump of se sites.
Specifically I'd like to know the values for PostTypeId field (1=Questions?, 2=Answers?, 3=?, etc).
I have tried to ...
- 717
32
votes
2
answers
365
views
Extend or remove Data Explorer timeout [duplicate]
I know that we don't have automatic login for the Data Explorer, but what's with the automatic timeout/logout? There have been times that I am logged into the site, maybe I walk away for a little bit,...
- 51.3k
32
votes
0
answers
322
views
Show successful close/reopen votes in SEDE regardless of if they've expired or not?
Currently Data.SE only show currently active close and reopen votes. Once these votes expire, they're removed from the Votes table. This makes them rather useless when trying to query anything related ...
- 19.3k
31
votes
1
answer
689
views
Easy way to make local copy of entire SE database?
Recently, I have been using the Data Explorer to try to find fishy users on SO. However, the Data Explorer is limited when it comes to cross-site and time-consuming queries, so I want to create a ...
- 1,169
31
votes
0
answers
109
views
Add Post Id to Badges table when applicable
Many badges are awarded for specific posts (Great Answer, Notable Question, Publicist, Investor, etc). In such cases, the list of badges includes the post for which it was awarded. This is public ...
user259867
30
votes
3
answers
844
views
The true unsung heros
The unsung hero badge has gained a ton of popularity.
So I decided to run some stats and try to find the real unsung heros on Stack Overflow.
I basically created a query that counts how many zero ...
- 108k
29
votes
1
answer
550
views
How many posts are downvoted without a comment?
A returning theme on our beautiful and productive Meta sites is the topic on downvoting without leaving a comment. Yes, that is a bit cheeky and admit it: you've done that as well.
In a recent post ...
- 84.2k
29
votes
1
answer
309
views
How is the data explorer secured?
I understand that the SQL user probably doesn't have any sort of permission to modify the database, and that very heavy caching is probably used in addition to the fact that this is on a data dump ...
- 1,681
29
votes
1
answer
387
views
List my downvoted posts that were edited
Consider the following situation:
I downvote a question / answer with a comment
The answerer / asker edits the question and improves it
In that case, I think the downvote should be removed.
I know ...
- 5,219
29
votes
2
answers
516
views
StackExchange Data Explorer is going open source
We are almost ready to announce on the blog that we are open sourcing SEDE.
Before we do that I wanted to get a bit of feedback to make sure that what we are doing makes sense and is easy to follow.
...
- 108k
28
votes
1
answer
410
views
Can you please close the "Stackexchange.Arduino" database? It has been open long enough for now
I was running a query this morning similar to:
create table #validaccounts(accountid int primary key)
declare @sql nvarchar(max)
select @sql = concat(N'insert into #validaccounts
select distinct ...
- 84.2k
28
votes
2
answers
412
views
Why am I jon.doe when logging into Data Explorer?
I just tried to login to the Data Explorer and it gave me a jon.doe user.
I used the same openid...
How can I link this to my other accounts?
- 3,314
28
votes
1
answer
418
views
Why do some comments on Russian-language sites have negative scores?
At least on two sites: SO on Russian and Русский язык SE Data Explorer returns a lot of comments with negative score [-6...-1]:
Actual comments look like normal comment without upvotes.
What is ...
- 55.2k