Questions tagged [screen-scraping]
screen scraping is the act of "scraping" or copying content from a Stack Exchange site and republishing that content on a different site. Stack Exchange content is licensed under Creative Commons BY-SA 4.0 and can be freely distributed with the attribution requirements. This tag should be used with posts concerning sites using Stack Exchange content without proper attribution.
6 questions with no upvoted or accepted answers
38
votes
0
answers
454
views
Copycat site causes disturbing images to turn up in image search
Today I tried out various images search sites and one of my test search terms was my own name.
What struck me was that the false positives were mostly the same regardless of the search site used. Also ...
- 2,871
14
votes
0
answers
186
views
"so long as they follow the Creative Commons attribution requirements" - but they don't
I reported two scrapers which were violating the license* recently, as I'd done some time last year as well. I got this email in return:
Hello,
All content on Stack Exchange is licensed under either ...
- 8,314
8
votes
1
answer
1k
views
How often can I poll the Stack Overflow RSS before I get IP address banned?
If you poll the main page RSS less frequently than every 2 minutes, you'll miss activity during the busy parts of the day:
https://stackoverflow.com/feeds
I haven't found the "newest questions&...
- 76.3k
6
votes
0
answers
97
views
StackExchange content scraping with obfuscation
The topic of content scraping from StackExchange and StackOverflow is very well known. I thought the admins would like to know that the scrapers have boosted their efforts and are now obfuscating ...
- 1,489
5
votes
0
answers
713
views
Scraping the chatroom
I've been webscraping the chat room with as goal to retrieve some statistics. (have a look at this meta on security.SE (What do you guys want to know about what is said in the DMZ?)
After indexing ...
- 591
2
votes
0
answers
220
views
Is there an open-source web scraper for Stack Exchange sites?
I wish to gather some data from a licensed corporate intranet Stack Exchange, however it doesn't seem to expose the API as with public Stack Exchange sites. Are there any existing open-source ...
- 129