Questions tagged [data-explorer]

For questions about the functionalities, queries, databases and datamodel of The Stack Exchange Data Explorer (SEDE). SEDE allows you to create and run queries against copies of the databases of popular Stack Exchange sites.

Filter by
Sorted by
Tagged with
297
votes
2answers
59k views

Database schema documentation for the public data dump and SEDE

Stack Exchange releases "data dumps" of all its publicly available content roughly every three months via archive.org, and also makes that information queryable over the Internet at the Stack Exchange ...
157
votes
31answers
8k views

Interesting queries on Data Explorer [closed]

Let's collect some interesting queries for the Stack Exchange Data Explorer here. How many upvotes do I have for each tag? (how long before tag badges?) SELECT TOP 20 TagName, COUNT(*) AS ...
113
votes
4answers
708 views

Beta sites should be in the Data Explorer

The Stack Exchange Data Explorer is a very nice and useful tool, but it has one very large drawback: Beta sites are not included at all. Excluding beta sites probably made a lot of sense when the ...
97
votes
1answer
1k views

Can some metadata about deleted posts be included in Data.SE?

I like to use Data.SE to view usage stats for some of the sites, however deleted posts are not included on Data.SE and I think this skews the numbers quite a bit, particularly on sites with a lot of ...
87
votes
3answers
2k views

Why is my profile image different?

When I first signed up on a Stack Exchange site and got a profile image, it was this one (see my current user card I'm actually not sure what I look like any more): Later, I got Area 51 and SEDE ...
85
votes
1answer
7k views

“OpenID 2.0 for Google Accounts is going away”; will this affect Stack Exchange?

Apparently, for some reason, Google is retiring its OpenID 2.0 platform. I got this notice while logging in with Disqus, but not with Stack Exchange. So... is Stack Exchange going to be affected by ...
78
votes
4answers
808 views

Let SEDE users get hold of data on unsuccessful close votes for stats

I have the feeling that with the growing influx of questions, an increasing number of questions that are clear closing candidates (i.e. it is totally obvious and undisputed that they belong closed ...
67
votes
3answers
850 views

Where can I see how many posts have I edited?

I've found here many queries to check edit counts, and I get different results for each one. Which one is the most accurate and up-to-date query? Or is there any way to see the edit count in stats?
66
votes
8answers
10k views

Implement OData API for Stack Overflow

The request is simple Implement the OData API for Stack Overflow sites Benefits: It's a standard API. OData allows the Stack Overflow database to be queried and navigated for questions, users, ...
56
votes
2answers
2k views

Can I search my comments using some keyword(s)?

Here's my problem: I know I've posted something on Stack Overflow about a particular topic. I know how to search all my answers with a given keyword, and that feature works well. But, if I don't ...
56
votes
2answers
421 views

Delete own query on data explorer

Is it possible to delete or at least hide your own data explorer query when you know you've only been testing something and don't want it to show?
54
votes
8answers
2k views

Introducing the Stack Exchange Data Explorer aka SEDE

I would like to gather some feedback on the new Sandbox I have been constructing. What does it do? Allows you to run arbitrary SQL queries on the data dumps, and share those queries with your ...
53
votes
15answers
2k views

Can we become our own “Northwind” for teaching SQL / databases?

In the Microsoft ecosystem there are some standard databases like Northwind ... The Northwind Traders sample database contains the sales data for a fictitious company called Northwind Traders, ...
49
votes
5answers
1k views

When am I going to get the generalist badge?

Can anybody muster up a query on Data Explorer that will show me my progress towards the Generalist badge?
46
votes
3answers
500 views

Please open the Hot Network Questions to auditing via the Data Explorer

One of the contentious issues on today's Stack Exchange is the Hot Network Questions sidebar, which can drive a lot of traffic to junk-food questions that can be very poor fits to the sites that host ...
42
votes
1answer
993 views

When will data.SE get updated data?

Zypher promised that data.SE would "soon" get live data: http://meta.serverfault.com/questions/3551/how-to-count-the-number-of-times-i-earned-200-daily-reputation/3552#comment6746_3552 http://chat....
42
votes
1answer
8k views

reCaptcha v1 is shutting down on March 31, but SEDE still uses it

According to this post, I thought the new recaptcha API was used network-wide. Though today, when going to SEDE (which for whatever reasons never recognized me automatically), I got this message ...
41
votes
3answers
457 views

Allow cross-site queries in data explorer

I think it would be useful if we could join across databases in the data-explorer. For example, I'd like to query up a list of questions that I had a hand in migrating away from SO, and see what ...
38
votes
1answer
501 views

Include the “People Reached” and “Helpful Flags (count)” data in SEDE

I know the new profile design hasn't been updated for every site on the network yet, so maybe this is a bit too early. Nonetheless, please include the "People Reached" data in SEDE at your earliest ...
38
votes
0answers
370 views

Show suspended users with their normal reputation in the Data Explorer

I was playing with the Data Explorer... And I was trying to write a query to show users who got the most % of their reputation from accepts. So for each user: [% from Accepts] = [Rep from Accepts] / [...
37
votes
1answer
257 views

Please add UserType to Stack Exchange Data Explorer

So that we can construct queries which take into account whether a user is registered or unregistered, please add the UserType field to Data Explorer. Currently there is no way to do this, since the ...
35
votes
0answers
179 views

Let moderators mark tags as deprecated

On Super User, we have quite a few tags that shouldn't exist. Unfortunately, some of those have a lot of questions, and despite our clear directives in the tag wiki excerpt, the tags continue to be ...
33
votes
2answers
6k views

Which tools and technologies are used to build Data Explorer?

Which technologies you are using for building Data Explorer? This is interesting if it gets open sourced at some point in future. Do you use same stuff as with SO? C#, ASP.NET, MVC?
33
votes
2answers
523 views

Why is the ##UserID## parameter not populated in Data Explorer anymore?

Environment I'm logging in using the OpenID from http://openid.stackexchange.com and using Chrome 31.0.1650.57 m if that matters. Steps to reproduce: Log in to Data Explorer and compose a query, ...
33
votes
2answers
306 views

Maybe it's time to update the code base of Data Explorer?

Not talking about the data, this one appears to be updating regularly which is awesome. Talking about this: There is outdated footer (e.g. "contact us" is still a mailto: link!) and more than a ...
32
votes
18answers
920 views

Don't forget to mention… SQL injection!

I've thought for a long time that answers that mention SQL injection get upvoted a lot, even if SQL injection is entirely unrelated to the question. It looks like the new data browser supports that ...
32
votes
1answer
10k views

Change “Login” to “Log in” and “Logout” to “Log out”

OK, so not a bug per se, but it does 'bug' me... On the Data Explorer page, the link to log in is labelled login rather than log in. The latter is on all the other SE sites I clicked through to, so ...
31
votes
2answers
308 views

Extend or remove Data Explorer timeout [duplicate]

I know that we don't have automatic login for the Data Explorer, but what's with the automatic timeout/logout? There have been times that I am logged into the site, maybe I walk away for a little bit,...
31
votes
1answer
627 views

Easy way to make local copy of entire SE database?

Recently, I have been using the Data Explorer to try to find fishy users on SO. However, the Data Explorer is limited when it comes to cross-site and time-consuming queries, so I want to create a ...
29
votes
2answers
2k views

Meaning of Values for PostTypeId in data explorer or in data-dump [duplicate]

I am looking for some explanation of the schema for the data dump of se sites. Specifically I'd like to know the values for PostTypeId field (1=Questions?, 2=Answers?, 3=?, etc). I have tried to ...
29
votes
1answer
293 views

How is the data explorer secured?

I understand that the SQL user probably doesn't have any sort of permission to modify the database, and that very heavy caching is probably used in addition to the fact that this is on a data dump ...
29
votes
3answers
825 views

The true unsung heros

The unsung hero badge has gained a ton of popularity. So I decided to run some stats and try to find the real unsung heros on Stack Overflow. I basically created a query that counts how many zero ...
29
votes
0answers
283 views

Show successful close/reopen votes in SEDE regardless of if they've expired or not?

Currently Data.SE only show currently active close and reopen votes. Once these votes expire, they're removed from the Votes table. This makes them rather useless when trying to query anything related ...
28
votes
2answers
493 views

StackExchange Data Explorer is going open source

We are almost ready to announce on the blog that we are open sourcing SEDE. Before we do that I wanted to get a bit of feedback to make sure that what we are doing makes sense and is easy to follow. ...
28
votes
0answers
96 views

Add Post Id to Badges table when applicable

Many badges are awarded for specific posts (Great Answer, Notable Question, Publicist, Investor, etc). In such cases, the list of badges includes the post for which it was awarded. This is public ...
27
votes
1answer
782 views

Use of ELMAH code without Apache license 2.0 on stack-exchange-data-explorer

I am a developer on the ELMAH project and recently I was browsing the stack-exchange-data-explorer project on Google Code. And I noticed too many similarities between SimpleErrorHandler and ELMAH to ...
27
votes
3answers
374 views

Please provide a Moderators table in the Data Explorer

Moderators are special, privileged users who should serve as an example to the rest of us. Therefore, it is natural to want to query behaviors and statistics about these model users, Like I did, for ...
27
votes
2answers
398 views

Why am I jon.doe when logging into Data Explorer?

I just tried to login to the Data Explorer and it gave me a jon.doe user. I used the same openid... How can I link this to my other accounts?
27
votes
1answer
357 views

List my downvoted posts that were edited

Consider the following situation: I downvote a question / answer with a comment The answerer / asker edits the question and improves it In that case, I think the downvote should be removed. I know ...
27
votes
1answer
247 views

Why do some comments on Russian-language sites have negative scores?

At least on two sites: SO on Russian and Русский язык SE Data Explorer returns a lot of comments with negative score [-6...-1]: Actual comments look like normal comment without upvotes. What is ...
27
votes
0answers
312 views

Can we have a feature to allow commenting on Data Explorer queries? [duplicate]

I love http://data.stackexchange.com but sometimes, I want to collaborate with the query creator - perhaps suggesting why their query isn't working as expected or asking something about the query. I ...
26
votes
2answers
4k views

Database Diagram of Stack Exchange model?

I went over the Archive site where I could retrieve data from Astronomy.SE. After I downloaded the content, I found 8 XML files that came maybe from a dump process. Now I am not able to assemble all ...
26
votes
2answers
254 views

Can we expose class for badges in Data Explorer?

According to this answer the following metadata is exposed for badges: Id UserId Name Date Why isn't class exposed in some way? It's obviously in the schema, since we can sort / filter in the UI. ...
25
votes
1answer
234 views

User views on Data Explorer is wrong or extremely out-of-date

I noticed that the Users.Views field for every single active user is extremely out of date. It is even zero/missing for some (not too new) users. Example: https://data.stackexchange.com/...
25
votes
1answer
189 views

Add UserId information for bounty starters and closers

Currently the "UserId" info is stripped from the Votes table for "BountyStart" and "BountyClose" vote types (i.e. for VoteTypeId=8 and VoteTypeId=9 respectively, check an example). Since this ...
24
votes
1answer
336 views

It's all Google in SEDE now

When logging in with Firefox (no repro on Chrome or IE11) on SEDE the login page shows only Google icons. I know something had to be fixed due to end of the support of Googles OpenId but this is a ...
23
votes
1answer
239 views

What SEDE examples would be most useful to new users?

This question asks about an SEDE tutorial, which doesn't really exist. The answer there suggests that you can look at existing queries, which I think is how most SEDE users have learned, but that has ...
23
votes
1answer
612 views

Record for most consecutive days visited?

Is there a way to find out the actual number for the highest ever consecutive days visited? I don't want to know who the user is that holds the record (I would hope that information would be kept ...
22
votes
1answer
587 views

Include a line number when there's a syntax error

When there's an error in a SEDE query, you just get the error message. Incorrect syntax near '*'. This can leave me guessing as to which one of the * in my query is causing the error. SSMS seems ...
21
votes
1answer
821 views

Data explorer merge request - Execution plans

This is a request to merge some changes I've made to the Stack Exchange Data Explorer. I've add the ability to view / download query execution plans - a tick of the "Include execution plan" check box ...