[Zope] Non compliant robots

Graham Chiu anon_emouse@hotmail.com
Fri, 30 Jun 2000 08:18:05 +1300


In article <B580AF7D.8DB8%jatwood@bwanazulia.com>, J. Atwood
<jatwood@bwanazulia.com> writes
>
>I have exactly the same problem (robot hits my site, I get 400 emails of
>errors even with a robots.txt file). I am not sure what the answer is except
>to add something to your error page that would filter out robot errors.

Since mine happens only on certain pages (forms), perhaps I should just
build up a list of bad remote IP addresses ( criteria - generates more
than 5 errors on the same page ), and then redirect those clients to
another non form page with indexing information for my site... sounds
like the basis of a product <g>

-- 
Regards,  Graham Chiu
gchiu<at>compkarori.co.nz
http://www.compkarori.co.nz/index.php
Powered by Interbase and Zope