What is meta? ×
Meta Stack Exchange is where users like you discuss bugs, features, and support issues that affect the software powering all 127 Stack Exchange communities.

Possible Duplicate:
How frequently are new questions indexed by search engines?

I was just curious about Google's crawling policy for Stack Overflow. One of my friends posted a question on Stack Overflow and I simply searched Google for any possible answers on the web. The first result was the question he posted. I have seen that it normally takes some time to see results in Google, but this was just within 10 minutes. Was it just coincidental, or does Google follow a different policy for sites like Stack Overflow?

share|improve this question

migrated from stackoverflow.com Aug 9 '10 at 12:36

This question came from our site for professional and enthusiast programmers.

marked as duplicate by random Aug 9 '10 at 13:52

This question has been asked before and already has an answer. If those answers do not fully address your question, please ask a new question.

1  
Duplicate of Does StackOverflow have some sort of deal with Google?, which was closed as a dupe of How frequently are new questions indexed by search engines?. Only 70 rep to go before I can vote to close, woohoo! –  Andy E Aug 9 '10 at 13:45
add comment

2 Answers

Google recently announced they changed the way pages were indexed, some pages will be indexed immediatly after they have changed if the author of the site sets it up correctly. I don't have a link at the moment to support this I am affraid.

I too was suprised at how quick a SO question appeared on google. I would imagine that Google has a priority list of websites that have good quality regular updates and google would prioritise them over other sites with less regular lower quality content who would have a slower indexing rate, perhaps once monthly as supposed to virtual real time.

I think what we are seeing is network speeds and technology improving worldwide. Domain propogation used to take several days, last time I tried it it was fairly instant. I think this is what we are seeing with google.

share|improve this answer
add comment

I have noticed that google seems to crawl popular forums more often, so I don't think it was coincidence

share|improve this answer
add comment

Not the answer you're looking for? Browse other questions tagged .