#Filter web-robot crawling # Ignore FrontPage files User-agent: * Disallow: /_classes Disallow: /_common Disallow: /_content Disallow: /_services Disallow: /_themes Disallow: /bin Disallow: /errors Disallow: /images Disallow: /trinet Disallow: /xml Sitemap: http://www.arcomit.co.uk/sitemap.ashx