Skip to main content
replaced http://meta.stackexchange.com/ with https://meta.stackexchange.com/
Source Link

So it's been pointed out that a lot of this data would be effectively worthless in a public data dump, due to the fact that they're generally months out of date. In addition, XML is huge, and the Stack Overflow data dump is already very large.

Therefore, I recommend including all of the information outlined above (with Anna's clarifications and caveatsAnna's clarifications and caveats) in the Stack Exchange Data Explorer, but adding only the following to the public data dump:

  • Links but excluding Related links
    • Also a LinkTypes table documenting the two types of links that are included
  • Account ID on Users rows

That is all. Note that I'm explicitly excluding Close and Reopen flag-votes: as Anna noted, including deleted votes gives a skewed picture of what actually happens unless flags related to deleted posts are included as well... Since most close and re-open flags are deleted, this leaves very little relevant information to include in a public, months-out-of-date dump.

It would be nice to figure out a way of including some meta-data on deleted posts, as that would enable including a much larger set of information regarding flags and reviews... However, this would be a fairly major change, and as such is out of scope for this feature request.

So it's been pointed out that a lot of this data would be effectively worthless in a public data dump, due to the fact that they're generally months out of date. In addition, XML is huge, and the Stack Overflow data dump is already very large.

Therefore, I recommend including all of the information outlined above (with Anna's clarifications and caveats) in the Stack Exchange Data Explorer, but adding only the following to the public data dump:

  • Links but excluding Related links
    • Also a LinkTypes table documenting the two types of links that are included
  • Account ID on Users rows

That is all. Note that I'm explicitly excluding Close and Reopen flag-votes: as Anna noted, including deleted votes gives a skewed picture of what actually happens unless flags related to deleted posts are included as well... Since most close and re-open flags are deleted, this leaves very little relevant information to include in a public, months-out-of-date dump.

It would be nice to figure out a way of including some meta-data on deleted posts, as that would enable including a much larger set of information regarding flags and reviews... However, this would be a fairly major change, and as such is out of scope for this feature request.

So it's been pointed out that a lot of this data would be effectively worthless in a public data dump, due to the fact that they're generally months out of date. In addition, XML is huge, and the Stack Overflow data dump is already very large.

Therefore, I recommend including all of the information outlined above (with Anna's clarifications and caveats) in the Stack Exchange Data Explorer, but adding only the following to the public data dump:

  • Links but excluding Related links
    • Also a LinkTypes table documenting the two types of links that are included
  • Account ID on Users rows

That is all. Note that I'm explicitly excluding Close and Reopen flag-votes: as Anna noted, including deleted votes gives a skewed picture of what actually happens unless flags related to deleted posts are included as well... Since most close and re-open flags are deleted, this leaves very little relevant information to include in a public, months-out-of-date dump.

It would be nice to figure out a way of including some meta-data on deleted posts, as that would enable including a much larger set of information regarding flags and reviews... However, this would be a fairly major change, and as such is out of scope for this feature request.

Migration of MSO links to MSE links
Source Link

So it's been pointed out that a lot of this data would be effectively worthless in a public data dump, due to the fact that they're generally months out of date. In addition, XML is huge, and the Stack Overflow data dump is already very large.

Therefore, I recommend including all of the information outlined above (with Anna's clarifications and caveatsAnna's clarifications and caveats) in the Stack Exchange Data Explorer, but adding only the following to the public data dump:

  • Links but excluding Related links
    • Also a LinkTypes table documenting the two types of links that are included
  • Account ID on Users rows

That is all. Note that I'm explicitly excluding Close and Reopen flag-votes: as Anna noted, including deleted votes gives a skewed picture of what actually happens unless flags related to deleted posts are included as well... Since most close and re-open flags are deleted, this leaves very little relevant information to include in a public, months-out-of-date dump.

It would be nice to figure out a way of including some meta-data on deleted posts, as that would enable including a much larger set of information regarding flags and reviews... However, this would be a fairly major change, and as such is out of scope for this feature request.

So it's been pointed out that a lot of this data would be effectively worthless in a public data dump, due to the fact that they're generally months out of date. In addition, XML is huge, and the Stack Overflow data dump is already very large.

Therefore, I recommend including all of the information outlined above (with Anna's clarifications and caveats) in the Stack Exchange Data Explorer, but adding only the following to the public data dump:

  • Links but excluding Related links
    • Also a LinkTypes table documenting the two types of links that are included
  • Account ID on Users rows

That is all. Note that I'm explicitly excluding Close and Reopen flag-votes: as Anna noted, including deleted votes gives a skewed picture of what actually happens unless flags related to deleted posts are included as well... Since most close and re-open flags are deleted, this leaves very little relevant information to include in a public, months-out-of-date dump.

It would be nice to figure out a way of including some meta-data on deleted posts, as that would enable including a much larger set of information regarding flags and reviews... However, this would be a fairly major change, and as such is out of scope for this feature request.

So it's been pointed out that a lot of this data would be effectively worthless in a public data dump, due to the fact that they're generally months out of date. In addition, XML is huge, and the Stack Overflow data dump is already very large.

Therefore, I recommend including all of the information outlined above (with Anna's clarifications and caveats) in the Stack Exchange Data Explorer, but adding only the following to the public data dump:

  • Links but excluding Related links
    • Also a LinkTypes table documenting the two types of links that are included
  • Account ID on Users rows

That is all. Note that I'm explicitly excluding Close and Reopen flag-votes: as Anna noted, including deleted votes gives a skewed picture of what actually happens unless flags related to deleted posts are included as well... Since most close and re-open flags are deleted, this leaves very little relevant information to include in a public, months-out-of-date dump.

It would be nice to figure out a way of including some meta-data on deleted posts, as that would enable including a much larger set of information regarding flags and reviews... However, this would be a fairly major change, and as such is out of scope for this feature request.

Source Link
Shog9
  • 454.3k
  • 203
  • 1.3k
  • 1.9k

So it's been pointed out that a lot of this data would be effectively worthless in a public data dump, due to the fact that they're generally months out of date. In addition, XML is huge, and the Stack Overflow data dump is already very large.

Therefore, I recommend including all of the information outlined above (with Anna's clarifications and caveats) in the Stack Exchange Data Explorer, but adding only the following to the public data dump:

  • Links but excluding Related links
    • Also a LinkTypes table documenting the two types of links that are included
  • Account ID on Users rows

That is all. Note that I'm explicitly excluding Close and Reopen flag-votes: as Anna noted, including deleted votes gives a skewed picture of what actually happens unless flags related to deleted posts are included as well... Since most close and re-open flags are deleted, this leaves very little relevant information to include in a public, months-out-of-date dump.

It would be nice to figure out a way of including some meta-data on deleted posts, as that would enable including a much larger set of information regarding flags and reviews... However, this would be a fairly major change, and as such is out of scope for this feature request.