# Tells Scanning Robots Where They Are And Are Not Welcome # # User-agent: can also specify by name; "*" is for everyone # Disallow: disallow if this matches first part of requested path # Allow: allows a page in an otherwise disallowed directory # User-agent: * Disallow: /cache/ Disallow: /errordocs/ Disallow: /sicoadmin/ Disallow: /siteclasses/ Disallow: /css/ Disallow: /siteconfig/ Disallow: /templates/