Content scapers, are an abusive method of acquiring / stealing data and resources. This will not be tolerated. We do however allow genuine Search Engines to index content that we have demarked, that we want indexed.
The Prime Culprits are :
Extractor programs stealing content for their websites.
Seo eggspurts, looking to impact rankings of web pages - biggest abusers.
Image thieves, who try to hotlink images and ineffect steal bandwidth
We will protect our resources by any means that we deem fit.
We apply RULE 1. Servers dont browse servers.
Genuine Spiders obey robots.txt
Its our choice to offer access for indexing by and to Geniune / Qualified sources of our choosing.
Its not your right to index / scrape resources that dont belong to you. We give permission to view our resources ( web pages ) through browsers, however we dont allow scrapers to extract and save our pages.
eMail scrapers will be blocked instantly.
Seo Scrapers will be blocked by User Agent, failing to respect our wishes, they will be blocked by IP class. We will escalate the blocking of abusers.
Ask for permission, dont steal as it will bite you, sooner or later, when you least expect it.