[XML-DEV Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

HGRAB. Syndication. Google. Grey area.

  • To: xml-dev@l...
  • Subject: HGRAB. Syndication. Google. Grey area.
  • From: Paul T <pault12@p...>
  • Date: Tue, 08 Jan 2002 13:15:29 -0800

syndication google
 
 
Some time ago I proposed that some knowledge
base about XML-related words could be created
so that people can submit/organize XML-related
words into some 'clusters'.
 
I decided that before writing such a system,
I should write some other system, that would
allow me to "automatically get all the XML-related
news".
 
So I've written a simple 'news feed', which
polls some news sources and syndicates
the 'news feed' for me.
 
The alpha  version of  this syndicator is
located at http://www.pault.com/hgrab
 
It is yet incomplete and not all XML-related
sources are syndicated ( I greatly appreciate
any URLs to XML-news websites ), but it should
give the idea.
 
I believe that for some cases it is 
*very* convenient to get such a news feed,
rather than browse each website
or use Google. The problem with RSS / RDF
is that none of the RSS / RDF sources
that I've seen provides the information
other than the title and url. That's is just
'not enough'.
 
However, there is one fundamental
legal problem with current HGRAB 
design.
 
The first impression is : "it is suspicious,
because it is not you who is creating the
content". ( that's why HGRAB strips
the original markup, so that the user is
enforced to go to the original news source ).
 
However, the more I think about this, the
more interesting it gets.
 
So, what HGRAB actually does? It polls
the HTML pages ( once in a while,
no harm done to the load of original
website ). Then it places some part of the
content into HGRAB database (for future
searching). Then it provides the end-user
with some 'part' of the original news item
and with the URL to the original news source.
 
Google does *exactly* this (and also Google
provides a cached copy of the original content)
 
That means:
 
Either both HGRAB and Google should be sued,
because they both sell the content
*which does not belong to them*, or both
HGRAB and Google should be considered
'just a service'.
 
Add the (similar) legal problems that Napster
( and many other P2P networks ) ...
 
"What can you do to the content created not by you"
is *really* a tricky question.
 
Is Google illegal ? I'm not a lawyer - I don't know.
 
My conclusion is that the Internet is a legal mess
and next years there would be more work for
lawyers,  than for developers.
 
Whatever. I'm not a lawyer, so I would continue to
improve the syndicator (anyway, my goal still is
'XML-words' knowledge base, the HGRAB
was a side-effect ) so :
 
1. Do you know about some nice XML-news
( or 'general IT' ) websites other than:
http://www.pault.com:88/hgrab/sources
 
Could you please drop me the URL?
 
2. If HGRAB looks interesting to you (in any way) -
you're welcome to write me. I'm thinking to make
it into standalone product, but ... Thinking ...
Even in alpha, it already appears to work  and
adding a new 'news Source' is usually a matter
of 15 minutes (that was the goal)
 
Rgds.Paul.
 
PS.
 
HGRAB is written in XSLT, XML Chunks,
SQL, Perl. When writing it, I found that
XSLT is *not* actually a good tool for
*processing* of mixed content ( XSLT is
good for *rendering* mixed content - which
is different task. XPath axes are kinda
'orthogonal' to 'good-old regular expressions'
machinery and good-old regular expressions
work  'better'. I can elaborate, if somebody
is interested )
 
Smart SPAM Filter
http://www.spafi.com
 
 

PURCHASE STYLUS STUDIO ONLINE TODAY!

Purchasing Stylus Studio from our online shop is Easy, Secure and Value Priced!

Buy Stylus Studio Now

Download The World's Best XML IDE!

Accelerate XML development with our award-winning XML IDE - Download a free trial today!

Don't miss another message! Subscribe to this list today.
Email
First Name
Last Name
Company
Subscribe in XML format
RSS 2.0
Atom 0.3
 

Stylus Studio has published XML-DEV in RSS and ATOM formats, enabling users to easily subcribe to the list from their preferred news reader application.


Stylus Studio Sponsored Links are added links designed to provide related and additional information to the visitors of this website. they were not included by the author in the initial post. To view the content without the Sponsor Links please click here.

Site Map | Privacy Policy | Terms of Use | Trademarks
Free Stylus Studio XML Training:
W3C Member
Stylus Studio® and DataDirect XQuery ™are products from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2013 All Rights Reserved.