# Tutti i crawler User-Agent: * Crawl-delay: 5 Disallow: /cgi-bin User-agent: Roverbot Disallow: / # Solo per esempio # Yahoo! #User-agent: Slurp #Crawl-delay: 10 # Google #User-agent: Googlebot #Crawl-delay: 10