[ZWeb] google results duplication

Karl Anderson karl@digicool.com
11 May 2001 15:54:44 -0700


Searching zope.org with google gets lots of duplicate results due to
multiple views of many objects that contain the normal view content as
well.  This makes google less useful for searching.

Wiki pages are especially bad for this - the edit, history, backlinks,
and advanced action views for each page end up in the google listing.
Most of the other types have a prettyprinting page that shows up.

Is there an easy way to exclude these?  Will robots.txt work for page
suffixes, or just subdirectories?

-- 
Karl Anderson                          karl@digicool.com