Skip to main content

Questions tagged [data-explorer]

For questions about the functionalities, queries, databases and datamodel of The Stack Exchange Data Explorer (SEDE). SEDE allows you to create and run queries against copies of the databases of popular Stack Exchange sites.

Filter by
Sorted by
Tagged with
2 votes
1 answer
48 views

How can I search for tags with that include a specified string in their Usage Guidance?

I would like to search for all tags (on Stack Overflow) that include some specific string in the Usage Guidance portion of their Tag Wiki. How can I do that? Specifically I would like to search for ...
9 votes
1 answer
193 views

What is going on with SEDE (and SO)? Can it be used only after the weekly update ends?

It seems that at the moment: After clicking on compose query you get: "Server Error in '/' Application. - Runtime Error". But it works if you use a different site instead of SO. Running any ...
9 votes
1 answer
149 views

Is there a way (e.g. with SEDE) to find questions with an existing tag that's been synonymized (but not merged) into another tag?

Say Tag 1 has been added as a synonym of Tag 2, so that new questions attempting to use Tag 1 will be automatically pointed to Tag 2. However, the two tags haven't been merged (yet). Then, if you ...
20 votes
0 answers
322 views

Users who can't write good posts ≠ users who want to write good posts

I recently came across this post, which states (emphasis mine): ... The problem that became evident was that people who want to learn how to write a good question and people who can't write a good ...
4 votes
2 answers
161 views

Any plans for a Data Explorer for Area 51?

As the title says...
29 votes
2 answers
839 views

Please provide a way to download SEDE data via an API

I recently suggested on the Stack Apps site that a formal API be added to SEDE, and it was suggested I reference the feature request here, for visibility. My use case is a query that the API does not ...
2 votes
2 answers
197 views

How to run a Stack Exchange data query with the Stack Exchange API

I'm trying to find out if there is a way to run a query/complex search on the Stack Exchange API. I need to find all users that have a reputation greater than 250 and are from a certain location. I ...
16 votes
1 answer
720 views

Running queries to StackExchange Data Explorer from anywhere

Now that we have an awesome tool StackExchange Data Explorer, won't its usefulness be multiplied manifolds if we could have a way of embedding queries onto a site that can fetch the results without ...
-1 votes
1 answer
173 views

Increase max SEDE query running time

I see an increasing amount of: Line 0: Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding. errors (screenshot) on SEDE due to ...
-5 votes
0 answers
136 views

How can I run SEDE queries on my computer? [duplicate]

Some SEDE queries time out on SEDE. How can I run SEDE queries on my computer?
7 votes
2 answers
249 views

Data Explorer Query crashes with collation conflict error

I have a website built off my Q & A posted in Stack Exchange sites such as; Ask Ubuntu, Stack Overflow, SE Security, etc. Data Explorer is used to scrape ALL Stack Exchange Q & A I've posted ...
12 votes
1 answer
332 views

What are the indices used in SEDE?

I'm writing an application that uses the Stack Exchange Data Dump. I've imported the most recent dump into SQL Server 2014 on my local development machine. I wrote a query that runs very slowly on my ...
17 votes
1 answer
268 views

Can we exchange one index for another one?

In the Stack Exchange Data Explorer only the most logical/beneficial yet minimal set of indexes is created for the tables found in the schema. One of those indexes is on the Users table: CREATE ...
6 votes
2 answers
245 views

How long does the Data Explorer Refresh take for each database?

Each Sunday at 03:00 UTC the Stack Exchange Data Explorer gets refreshed. It takes 6 to 8 hours to refresh all 350+ databases that hold the Posts, Votes, History etc for the Main and Meta sites. I was ...
382 votes
2 answers
124k views

Database schema documentation for the public data dump and SEDE

Stack Exchange releases "data dumps" of all its publicly available content roughly every three months via archive.org, and also makes that information queryable over the Internet at the ...
7 votes
2 answers
125 views

How should I go about retrieving the date of when a question became/was no longer hot with SEDE?

I am currently making a SEDE query to determine which questions from a specific user have made it onto the Hot Network Questions list and when. While I can get the specific questions, I am unable to ...
14 votes
1 answer
555 views

What caused the drop in questions in April 2023?

Rerunning this query by starball for new questions and answers posted across the network generated the following graph: It plots posts by their creation date, and includes deleted posts. The decline ...
-1 votes
1 answer
120 views

Data explorer query takes a lot of time and needs to be optimized

This is a Stack Exchange Data Explorer query which gets the top users on specific skill scores (example: JavaScript) based on a specific country (example: Egypt), and it took a lot of time until it ...
4 votes
1 answer
153 views

How do I get the highest posters for a certain tag in a specific country?

I would like to get the user IDs, user names, the number of posts, and the total score for a certain tag for each user in a specific country (sorted in descending order by score). For example, in the ...
11 votes
1 answer
115 views

Let the default collation of the SEDE databases match the dominant collation used for the nvarchar columns

Today I was working on a SEDE query when I was met with a somewhat unexpected error message: Cannot resolve the collation conflict between "SQL_Latin1_General_CP1_CS_AS" and "...
14 votes
1 answer
271 views

Tags column of Posts table changed delimiter format. Many historical queries broken. Special tag rendering also broken

To the best of my memory, and in reading my past queries- some of which I re-run on a regular basis- the format of the Tags column of the Posts table in SEDE used to be like <starball><is>&...
19 votes
0 answers
222 views

Directly support cross-site queries in the Data Explorer [duplicate]

Often you want to query some statistic for a user across all sites. For example, you might write a query to find your rejected suggested edits across all Stack Exchange sites. To implement this, you ...
13 votes
2 answers
409 views

How can I write a cross-site Data Explorer query that joins databases on linked accounts? [duplicate]

The answer to this question implies that you can write cross-site Data Explorer queries, but the sample query doesn't appear to do what I think it should. SELECT TOP 1 * FROM [StackOverflow....
49 votes
3 answers
711 views

Allow cross-site queries in data explorer [duplicate]

I think it would be useful if we could join across databases in the data-explorer. For example, I'd like to query up a list of questions that I had a hand in migrating away from SO, and see what ...
25 votes
2 answers
702 views

Create a view that provides a list of databases

In an answer to Strange new database 'Data.StackExchangePOC' is messing up cross-site SEDE queries our DBA extraordinair Aaron Bertrand suggested to have a feature request for a view to list ...
5 votes
1 answer
163 views

How can one see when a query was cached in SEDE?

Query results in SEDE are cached: How can one see when a query result was last cached in SEDE?
7 votes
1 answer
97 views

The magic column [tagname] should handle number columns results gracefully

The magic column [tagname] will decorate and auto link tag names when used in a query. This feature relies on the JavaScript processing in the browser. The client-side script assumes it will always ...
5 votes
1 answer
101 views

Are SEDE results ever cached on client side, or solely on server side?

I know that SEDE query results are cached on the server side. I wonder if in some cases they are also cached on the client side.
4 votes
3 answers
268 views

How can I avoid the Data Explorer cache?

In Stack Exchange Data Explorer, I noticed that after a query is executed, it is stored in the cache (I think). How do I disable this feature? For example, when I run this query, it should generate a ...
26 votes
3 answers
555 views

Strange new database 'Data.StackExchangePOC' is messing up cross-site SEDE queries

I just read a comment by user @questionto42 that one of my cross-site queries isn't working. My educated guess is this is because a special database Data.StackExchangePOC was created two days ago: (...
3 votes
1 answer
199 views

Is it possible to refresh SEDE daily?

I'm currently working on changing http to https in questions and answers of mine. To not flood the homepage (SF&F doesn't have the volume SO has), I do about 5 a day. When I run the query the next ...
10 votes
0 answers
250 views

Have there been analyses to see if views of well-received answers are reduced by closure as duplicate which try to control for other factors?

This is a narrowly-scoped question; I'm just curious if this has been investigated quantitatively. Background only: I spent some substantial time and effort and love and coffee writing this answer to ...
2 votes
0 answers
95 views

Logging out doesn't log out from data.stackexchange.com

Logging out says it logs out from stackexchange.com but that's incorrect as it doesn't log out from data.stackexchange.com. Tested on Chrome with Android on a Galaxy S23.
7 votes
1 answer
117 views

What exactly is the "sql" parameter in SEDE and what purpose does it serve?

SEDE supports query parameters. I found that if I try to define a query parameter of string type named "sql", whatever I pass as the argument for that parameter will be prepended by a string ...
10 votes
2 answers
171 views

How can I write and run a SEDE query without the query itself being visible to other regular SEDE users?

How can I write and run a query in SEDE without the query itself being visible to other regular SEDE users, such as in the "everything" tab of the "queries" page?
37 votes
2 answers
6k views

Is there any place to see a leaderboard of top "Helpful Flaggers"?

There are a few members of Stack Overflow especially who have a ridiculous number of helpful flags. At the moment, there does not appear to be any way to display the top users with the most helpful ...
12 votes
0 answers
138 views

The SE Data Explorer captcha is unnecessarily annoying

Whenever I try to run a query with the Data Explorer, my process is: Type the parameters for the query. Click "Run query". Click the "I'm not a robot" checkbox that suddenly ...
20 votes
2 answers
416 views

The Data Explorer (SEDE) Refresh choked on a Raspberry

As we all know the community eagerly awaits the weekly SEDE refresh with all our posted content so we can analyze, share-alike or train our large language models (LLMs). The script that runs the ...
8 votes
1 answer
280 views

Out-of-resources when trying to run a popular DataExplorer query

So, I tried to run this query Users with highest Socratic progress (socratic hopefuls) which has many views (so I assume it's popular), but I get a message saying: The query processor ran out of ...
41 votes
1 answer
344 views

Why does the SEDE ReviewTaskResults table not include user data, which is all public anyway?

I wanted to do some data mining on the SEDE, and I ran across a limitation which I cannot understand. The Data Explorer table ReviewTaskResults currently contains the following information: Id ...
4 votes
1 answer
99 views

How can I see the number of questions that a given user voted to close but got later reopened by someone else?

I wonder the following: for a given user, how can I see the number of questions that they voted to close, but the question was later reopened by someone else (possibly a group of users)?
2 votes
1 answer
112 views

Where can I ask questions about Stack Exchange's data explorer? [duplicate]

I have been unable to find an ask question button on https://data.stackexchange.com/stackoverflow/query/new So where can I ask a question about data.stackexchange? (Actually, I have a question about ...
7 votes
1 answer
144 views

What site should I post a question about an error given from a SEDE (Stack Exchange Data Explorer) query?

I am working on composing a SEDE (Stack Exchange Data Explorer) query to find questions from 3-4 months ago that do not have any accepted answers that I feel like I could answer (as in limiting it to ...
5 votes
1 answer
96 views

What DB permissions are available for queries through data.SE?

Is there any documentation on what is/isn't permitted on data.SE? Specifically can I create: views temp-tables procedures functions Do I have my own schema to play with?
12 votes
2 answers
135 views

How can I find posts that need editing using Data Explorer?

Is there a way, using Data Explorer queries, to find posts with chatty noise such as 'Hello guys' (or 'people', 'hi there', 'help me our', etc.)? It occurred to me that I could try something like ...
9 votes
1 answer
100 views

Default to lang-sql syntax highlighting for Meta.SE posts tagged with [data-explorer]

It would be nice if posts here on Meta.SE that are tagged with data-explorer would automatically have SQL syntax highlighting (a la <!-- language: lang-sql -->) applied, in the same way that ...
16 votes
0 answers
289 views

What's going on with SEDE right now? It's being fickle

When I open a new tab, I get "we are currently offline", and then I refresh a couple of times and it's fine. Then when I try to run a query, it will give unknown job being polled! or ...
6 votes
1 answer
145 views

Periodically publish a data dump of all IDs in the image ID space (and make it available in SEDE)

I see that Imgur has an API to query for image IDs in its ID space, but api.stack.imgur.com is not an API endpoint (and SE is moving off Imgur anyway). Say I want to get all the IDs of images in Stack ...
16 votes
1 answer
270 views

Magic columns and site:// do not work for alcohol.meta.stackexchange

The site Beer, Wine & Spirits has the URL https://alcohol.stackexchange.com but in SEDE it uses beer for the main site and beerme for meta. As far as I can tell, the shortcut site:// and the magic ...
2 votes
1 answer
145 views

How to get tags of questions answered by a user in Stack Exchange Data Explorer

I can't solve this problem: using a remote DBMS from the Stack Overflow site (URL: http://data.stackexchange.com/stackoverflow/query/new). Write a SQL query that displays the names of users with a ...

1
2 3 4 5
32