# Valid user agent strings # Slurp Yahoo! # Inktomi Various (HotBot/Alltheweb/Yahoo) # msnbot MSN / Bing # Googlebot Google # Teoma Ask User-agent: Googlebot Disallow: /12all/ Disallow: /area-notes/ Disallow: /eng/ Disallow: /graphics/ Disallow: /htmlarea/ Disallow: /imanager/ Disallow: /manual/ Disallow: /MySQL/ Disallow: /route-notes/ Disallow: /scripts/ Disallow: /secure/ Disallow: /testing/ Disallow: /locators/ Disallow: /wordpress/wp-content/uploads/ User-agent: Slurp Crawl-delay: 30 Visit-time: 0000-0800 Disallow: /12all/ Disallow: /area-notes/ Disallow: /eng/ Disallow: /graphics/ Disallow: /htmlarea/ Disallow: /imanager/ Disallow: /intranet/ Disallow: /manual/ Disallow: /MySQL/ Disallow: /route-notes/ Disallow: /scripts/ Disallow: /secure/ Disallow: /testing/ Disallow: /bookings/ Disallow: /gallery/ Disallow: /virtual/ Disallow: /pdfs/ Disallow: /info/ Disallow: /terminal1/ Disallow: /locators/ Disallow: /wordpress/wp-content/uploads/ User-agent: * Crawl-delay: 120 Visit-time: 0000-0800 Disallow: /12all/ Disallow: /area-notes/ Disallow: /eng/ Disallow: /graphics/ Disallow: /htmlarea/ Disallow: /imanager/ Disallow: /intranet/ Disallow: /manual/ Disallow: /MySQL/ Disallow: /route-notes/ Disallow: /scripts/ Disallow: /secure/ Disallow: /testing/ Disallow: /bookings/ Disallow: /gallery/ Disallow: /virtual/ Disallow: /pdfs/ Disallow: /info/ Disallow: /terminal1/ Disallow: /locators/ Disallow: /blog/ Disallow: /wordpress/wp-content/uploads/