Questions tagged [data-analysis]

Use on questions that ask for analysis of one or more of the available data-collections both public and private. If your question is about a single observation use the tag [statistics] instead.

Filter by
Sorted by
Tagged with
5 votes
0 answers
153 views

Can I obtain data about my Q&A on all Stack Exchange sites?

Is it possible to download the following data on my questions and answers on all Stack Exchange sites? The Stack Exchange site it appeared on (can be omitted as redundant if the full URL is provided)....
NewSites's user avatar
  • 431
18 votes
0 answers
180 views

Community Health Dashboards

This is based on a recent Meta Software Engineering question. It would be interesting to expose, to the community, information about community health. The Meta Software Engineering question asked ...
Thomas Owens's user avatar
-6 votes
1 answer
152 views

Can the compendium of SE Q&A’s be translated into an encyclopedia?

Stack Exchange has become quite the concentration of years of Socratic knowledge - that is to say, having many questions asked, answered, and peer reviewed to some degree - of the main site pages. I ...
Eliot G York's user avatar
15 votes
2 answers
621 views

How many answers did I facilitate and (roughly) how much answer rep was generated?

Answers to Who asked the most number of questions on Stack Exchange? include SEDE scripts for site-specific and network-wide methods to rank users who've asked the most questions. Someone pointed me ...
uhoh's user avatar
  • 6,502
-15 votes
3 answers
239 views

Can we make a network wide survey at Stack Exchange?

At any intellectual community, it is evident that any participants should have the option of seeing the demographics of the community that they are participating in. This is so that people know the ...
Proud Tamil Indian's user avatar
3 votes
1 answer
81 views

Leaderboard on Hat Dash showing triplicates?

When I was looking at the 'Overall Statistics' section of the hat dash leaderboard, for the entire winter bash, I came across the following: I am pretty sure this is an error, as they all have the ...
Joe Kerr's user avatar
  • 1,939
3 votes
0 answers
132 views

Where can I find examples of Stack Exchange search queries?

Is there a dataset available to the research community that contains example queries for Stack Exchange results related to sotware? By search queries I mean "pandas to_csv tab delimiter" and ...
user147894's user avatar
4 votes
0 answers
112 views

Is there a way of seeing the evolution of the statistics of a site as a function of time?

Is there a way of seeing the evolution of the statistics of a site as a function of time? For example, I would like to see these statistics (e.g. number of visits, regular users, number of questions,...
user avatar
41 votes
2 answers
416 views

Can we have the dataset for the loop #2?

Independent verification is a pillar of the scientific method, partly for sanity-checking and also because (and I've mentioned this multiple times before) both the cohorts used for the loop and the ...
Sébastien Renauld's user avatar
6 votes
0 answers
155 views

Where can I download previous SE database snapshots?

I'm aware I can download the entire anonymized Stack Exchange databases from https://archive.org/details/stackexchange But from what I can see, I can only download the latest snapshot, updated ...
Sylvain Leroux's user avatar
17 votes
1 answer
435 views

Is there a way to systematically find duplicate or similar posts on Stack Overflow?

I am planning to do some analysis on duplicated or similar question posts from Stack Overflow. Therefore, I need to collect the posts (regardless of question or answer) as the ground truth data, which ...
Hui Kang's user avatar
  • 317
11 votes
1 answer
127 views

How to find the current top questions by number of views? Or the quarterly number of views per question?

Stack Overflow provides the total number of pageviews per question - but it doesn't tell you if those views are historical or if the question is still current. How can I find the current top questions?...
Felipe Hoffa's user avatar
7 votes
1 answer
128 views

Comparing the data in "a year in moderation" posts across sites

I was recently participating on one of the meta sites and several of us wanted to see how that site compared to other sites, specifically with regards to moderator-deleted and moderator-closed posts ...
user avatar
58 votes
1 answer
491 views

2018: a year in spam

End-of-year posts seem to have become the tradition these days, so I'm back again with a third Year in Spam. Welcome back, folks, to another round of statistics you never needed to know. All times/...
ArtOfCode's user avatar
  • 36.3k
4 votes
1 answer
75 views

How can I see if my question is still active?

Years and years ago, I posted a very awkward question on Stack Overflow. Now I checked it again and I discovered it got around 7k views and the answers to that question have got a discrete number of ...
Christian Vincenzo Traina's user avatar
73 votes
0 answers
585 views

2017: a year in spam

Last year, I posted 2016: a year in spam. Since that was pretty well-received, here’s the 2017 version. Ladies, gentlemen, aliens, and everyone in between: more statistics about spam that you never ...
ArtOfCode's user avatar
  • 36.3k
0 votes
0 answers
42 views

Information about moderators in the data dump [duplicate]

I was trying to look for information about the moderators of Stack Exchange Community, but I didn't find any. So can anyone please tell if there is any information available about the moderators in ...
arman's user avatar
  • 359
-4 votes
1 answer
47 views

Finding correct site - "Dimensioning personnel resources - examples and resources?" [duplicate]

I am looking for the right site to post this in, and this is what I have written. I have considered Data science, Project management, and even The Workforce, but none seem fitting, though I am ...
chemicalpython's user avatar
3 votes
0 answers
463 views

How to obtain the users reputation dataset from Stack Overflow

Is it possible to obtain the individual user reputations dataset (users and reputation at a given time) from Stack Overflow for example? Aim: modeling purposes.
Edgar Santos's user avatar
48 votes
1 answer
357 views

2016: a year in spam

In the spirit of Shog9's recent post, "2016: A year in closing", I thought I'd do something similar for spam. Ladies and gentlemen, I present you with all the statistics about spam you never needed to ...
ArtOfCode's user avatar
  • 36.3k
13 votes
1 answer
96 views

How much do hats increase positive behaviors compared to the rest of the year?

Most of the hats are designed to reward positive behaviors, behaviors that benefit the sites -- reviewing, editing, answering questions (well), participating on meta, and so on. (The others aren't ...
Monica Cellio's user avatar
7 votes
2 answers
265 views

Who asked the most number of questions on Stack Exchange?

I searched before, but I didn't find any solution. I am just curious to know who asked the most questions on Stack Overflow or another Stack Exchange site. How can I find this information?
meta beginner's user avatar
27 votes
1 answer
646 views

Can I have some closed question data? What should I point Parsey McParseface at?

I'm doing some experimentation with SyntaxNet (aka Parsey McParseface). You can follow my musings and results in Charcoal HQ if you so desire. Based on some early results using very rudimentary ways ...
Undo's user avatar
  • 50.8k
6 votes
2 answers
82 views

Most active users on tag Data Explorer

I was wondering, and I searched a bit but found nothing, is there a query on Data Explorer that will show the most active users on a certain tag on a overflow site? Like someone who frequently answers ...
dingo_d's user avatar
  • 163
-12 votes
1 answer
112 views

How to access user last connection IP address on profile

I'm doing some work on the network analysis of a Stack Exchange community. I need the location of its users, but as you know, not everyone fills in the Location field. I find the [Data.StackExchange]....
santteegt's user avatar
12 votes
1 answer
162 views

How often do moderators purge entire comment threads?

I'm kicking around some ideas for ways to improve comment moderation. As part of one of these ideas, I'd like to get some statistics - specifically, how often do moderators delete entire comment ...
Undo's user avatar
  • 50.8k
30 votes
1 answer
572 views

Additional RSS feeds

This is based on a few other posts here, such as 1, 2, 3, and 4. User Answers: A particular user's newly posted answers to questions. Every answer posted by the user gets published. Edits to answers ...
Thomas Owens's user avatar
4 votes
0 answers
25 views

Add more meta data to the sites' HTML

I'm playing with live filtering the Stack pages and am extracting information about views, reputation and votes from title or content of the page elements. As HTML title attributes and text content ...
brasofilo's user avatar
  • 3,543
11 votes
1 answer
129 views

How successful has the review indicator been?

Is there data about the amount of reviews that the new not-so-shiny review notification icon has caused? Has it increased the amount of reviewers? Decreased? No significant change?
Braiam's user avatar
  • 15.3k
39 votes
1 answer
741 views

Which sites appear most often in the Hot Network Questions list?

Is there any data about which Stack Exchange sites have their questions end up in the Hot Network Questions list the most? In particular: What percentage of hot network questions comes from each site?...
Ypnypn's user avatar
  • 608
13 votes
1 answer
188 views

Does Stack Exchange Track Clicks to "Hot Network Questions"

I'd love to make or see a graph analysis of click-throughs from Stack Overflow to other community's questions. I expect to see attractors that SO types tend to fall into (e.g. RPGs). Does Stack ...
Eric's user avatar
  • 233
3 votes
1 answer
62 views

Are Data Explorer Queries included in the Data Dump?

Since the Data Dump includes all the Stack Exchange sites, is Data Explorer included? If not, is there a way to backup queries besides copy/paste?
Paul Sweatte's user avatar
  • 1,815
5 votes
1 answer
2k views

Using stackoverflow data to look at trends in technology usage [duplicate]

Is it possible to query how many questions per day have been asked on a particular subject on Stackoverflow over a period of time? For instance, I can use Google Web Trends to compare number of ...
rcgeorge23's user avatar
11 votes
0 answers
170 views

Can you help with getting some statistics on Stack Overflow voting patterns?

About 2 weeks ago we've said good-bye to some old close reasons (minimal understanding, describe specific problem, etc). Since then, I think I might have noticed a drop in the amount of votes to close ...
user avatar
7 votes
1 answer
157 views

A better way to find questions that interest me, with machine learning

Stackoverflow uses a fairly good heuristic to choose a selection of interesting questions on the homepage for each user. But lately I get the feeling that it is failing for me. Or the actual ratio of ...
HugoRune's user avatar
  • 919
11 votes
0 answers
81 views

Please make close vote review data public [duplicate]

I'd like to play around with the close vote review data to do some basic analysis. Can the review data from the close vote queue please be made public? User IDs should be included in the data dump, ...
user avatar
6 votes
3 answers
207 views

When is the ideal time to hold a chat room event to accommodate the most users, in particular users with close vote privileges?

I wanted to run a weekly, 1-hour event, and initially set the time, somewhat haphazardly, to my lunch hour, 9:00pm UTC (as I expected to be alone in participation at first anyway). However, several ...
Andrew Cheong's user avatar
8 votes
3 answers
255 views

Influence of the weather in the upvote/downvote ratio?

I'm under the impression that the weather can influence the mood and have some impact in voting statistics. Is there any way of verifying this hypothesis? I mean, is the daily total of upvotes and ...
Paulo Scardine's user avatar
2 votes
1 answer
442 views

Selecting interesting questions by means of more sophisticated analysis

I’m thinking about possibility to make more sophisticated SE data dumps analysis in order to select most interesting questions. Maybe not a problem for SO because huge number of questions have 3-...
Mikhail  M's user avatar
  • 167
21 votes
1 answer
1k views

Prediction about tags on which you are most and least likely to answer

Some time ago there was a blog post about someone analysing what tags SO users answered on and coming up with the five most and least likely tags that this user would answer on in the future. The post ...
Marjan Venema's user avatar
2 votes
2 answers
98 views

What events or new design choices have exogenously changed user behavior on SO?

I've been doing some research on design choices in online communities, and I'm looking for some examples of design changes, events, feature additions (or subtractions), or policy changes that might ...
mdgreenb's user avatar
4 votes
1 answer
148 views

Trouble with fetching data

I'm trying to query the following data from stackexchange: Fetch all the questions asked about Android, in past five years, and display post's id (a.iD), associated tags (a.Tags), for the person ...
r2j2's user avatar
  • 73
8 votes
1 answer
96 views

Classifier based answer ranking Chrome extension

I'm in my final year of a computer science degree. For my thesis I have implemented a classifier that predicts the usefulness of answers to questions with no accepted answer, based on a training set ...
tecknut's user avatar
  • 183
3 votes
1 answer
667 views

Getting data from Stack Overflow?

I intend to analyze data derived from the user behavior on Stack Overflow (i.e. the number of questions asked in the last five years, upvotes, number of users common to "Android" and "iOS" dev ...
r2j2's user avatar
  • 73
7 votes
4 answers
1k views

Average length of comments on Stack Overflow

What is the average comment length on Stack Overflow? I'm working on my thesis about short message topic detection (on Twitter, to be more specific), and I would like to know that for research ...
Oscar Mederos's user avatar
4 votes
1 answer
226 views

Data Analysis and sites

Which site is suitable to include questions on data analysis? I'd like to post a question about theorical techniques that are applied to analyze the data and feedback that can be given after this ...
Luigi's user avatar
  • 225
0 votes
1 answer
74 views

Any infovis ever been tried on stackoverflow data?

Today, opening stackoverflow i have read 3 or 4 times the tag QT. For sure is something totally random but this made me think about a friend that this morning talked about how .net is gettin in shadow ...
nkint's user avatar
  • 103
15 votes
5 answers
316 views

Why are questions edited more thoroughly than answers?

I used the PostHistory table and ran a Python diff ratio using the first and last edits for both questions and answers. This is supposed to give 1 if the posts are identical and 0 if there are no ...
paulusm's user avatar
  • 441
5 votes
1 answer
87 views

Frequency of a term or keyword, over time

This might sound like a strange request, but here's what I'd like to do: Know how often a certain keyword or tag is used, over time, on StackOverflow. For example, for this keyword: "github" How ...
yarone's user avatar
  • 51
2 votes
2 answers
174 views

How do some new answers "break through"?

I'm working with the SE data dump and am interested in voting patterns and answer contributions over time. I know it is established that the majority of questions are answered well (or at least to the ...
paulusm's user avatar
  • 441