[ciapug] Logging outgoing traffic while being crawler friendly

David Champion ciapug@cialug.org
Fri, 30 May 2003 10:11:50 -0500


Claus wrote:
> LOL That's exactly what I did (see quoted original below).  It looks 
> like a link, but only like a link to the redirection script and not to 
> www.ames.ia.us .  The goal here is to log the usage of outgoing links 
> while having these links count on search engines.  Some search engines 
> rate pages higher if they are linked to from more sites.
> 
> I think my goal needs to be to make the link appear <a 
> href="http://www.ames.ia.us"> to at least the search engines.  Maybe 
> include some detection script that creates different links for 
> crawlers/and other browsers.  Darned, that means I have to phrase the 
> whole html document before serving it.
> 
> Till now I just extracted the header and body of the html and surrounded 
> it with my template layout ( background, table, site index, and stuff 
> like that).  Did anybody do something similar to modify the hrefs of an 
> existing html file on the fly?

I think the problem is that once you put a "normal" href in your html 
output, if the client clicks on the link, NOTHING happens on your server 
- the "redirect" so to speak, happens at the client side.

-dc