# exclude help system from robots User-agent: * Disallow: /manual/ Disallow: /doc/ Disallow: /icons/ Disallow: /gif/ Disallow: /cgi-bin/ Disallow: /mailman/ Disallow: /pipermail/ Disallow: /server-info Disallow: /server-status # disallow stress test User-agent: stress-agent Disallow: / # Stupid robot doesn't understand HREF protocol specs User-agent: Webgraph Disallow: / # Disallow indexing of CV User-agent: * Disallow: /angus/cv.html # Disallow indexing of Calendar User-agent: * Disallow: /calendar/