When querying the live data using Data Explorer for a weekly count of unanswered, unclosed questions tagged with android, there seems to be a large discrepancy between these results and those using the March 16th data dump from the archive.
Using Data Explorer with the above query, we see the following graph:
Using the archive data (as imported to a local PostgreSQL database) with the query:
select extract(week from creationdate), count(*) from posts q where not exists (select * from posts a where a.parentid = q.id) and q.creationdate >= '2014-01-01' and q.creationdate < '2015-01-01' and q.closeddate is null and q.parentid is null and q.tags like '%<android>%' group by extract(week from creationdate)
Slight deviations between the two data sources are absolutely expected due to the dynamic nature of Stack Overflow (questions deleted, answered later on, closed, etc). However, it seems unlikely that such a large discrepancy between the two data sources would exist especially since the large spike in unanswered questions appears in both data sets, but at different times.
My questions are:
- Can another user with a locally imported Stack Overflow March 16th data dump confirm this phenomenon to rule out the possibility of an error on my side (which is absolutely possible)?
- Was there some type of systematic change in Stack Overflow that could have caused this discrepancy between data sets?