What is meta? ×
Meta Stack Exchange is where users like you discuss bugs, features, and support issues that affect the software powering all 133 Stack Exchange communities.

I found that in the file in the data dump, the information are duplicated. In fact, the post with the id 5022383 and the title "Monkey patching CKEditor to embed YouTube videos" is in the file posts.xml of the months april 2011, june 2011, september 2011 and december 2011 of the stackoverflow's data.

Why is that the case? How is the data dump built?

share|improve this question

1 Answer 1

up vote 5 down vote accepted

Why wouldn't that be the case? Unless the content is deleted, it will appear in the data dump, as the data dump is, as the name implies, a full dump of the data. Put another way, the data dump is distributed as a snapshot, not a delta.

You should expect it to reflect the state of the site at the point in time when the data dump was released.

share|improve this answer
1  
Imagine if it were the delta. You'd have to get each month from the beginning and process them to get them up to date. Wait... is that what the OP was trying? –  Some Helpful Commenter Apr 19 '12 at 15:54
    
Thank's. It's what I thought. –  AnthonyMaia Apr 19 '12 at 15:55
    
Yes, it is. I thought at the beginning that it was the delta. My bad. –  AnthonyMaia Apr 19 '12 at 15:58
    
So, on which criterion are the posts deleted? –  AnthonyMaia Apr 19 '12 at 16:01
    
@user183870 They won't appear in the data dump if they've been deleted on the site, and they can be deleted on the site for various moderation-related reasons. –  Tim Stone Apr 19 '12 at 16:04

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .