# Robot and Search Enging Information # Sitemap (page priority info) Sitemap: http://www.symres.com/sitemap.xml # General Robot Exclusion Information User-agent: * Allow: /files/*.pdf Disallow: /files/*.zip Disallow: /files/*.tar Disallow: /files/*.tgz Allow: /legacyfiles/*.pdf Disallow: /legacyfiles/ Disallow: /images/ Disallow: /webpages/photos/ Disallow: /cgi-bin/ Disallow: /cus Disallow: /wct Disallow: /pete # W3C checking info User-agent: W3C-checklink Disallow: