[Home] [By Thread] [By Date] [Recent Entries]
> Paul T wrote: > > > So, what HGRAB actually does? It polls > the HTML pages ( once in a while, > no harm done to the load of original > website ). Then it places some part of the > content into HGRAB database (for future > searching). Then it provides the end-user > with some 'part' of the original news item > and with the URL to the original news source. > > Google does *exactly* this (and also Google > provides a cached copy of the original content) > > That means: > > Either both HGRAB and Google should be sued, > because they both sell the content > *which does not belong to them*, or both > HGRAB and Google should be considered > 'just a service'. Have a look at http://www.google.com/robots.txt Ari.
|

Cart



