[Home] [By Thread] [By Date] [Recent Entries]


> Paul T wrote:
> 
> 
> So, what HGRAB actually does? It polls
> the HTML pages ( once in a while,
> no harm done to the load of original
> website ). Then it places some part of the
> content into HGRAB database (for future
> searching). Then it provides the end-user
> with some 'part' of the original news item
> and with the URL to the original news source.
> 
> Google does *exactly* this (and also Google
> provides a cached copy of the original content)
> 
> That means:
> 
> Either both HGRAB and Google should be sued,
> because they both sell the content
> *which does not belong to them*, or both
> HGRAB and Google should be considered
> 'just a service'.


Have a look at http://www.google.com/robots.txt

Ari.

Site Map | Privacy Policy | Terms of Use | Trademarks
Free Stylus Studio XML Training:
W3C Member