# Signal to the search engines that they should not scan these directories on this site. User-agent: * Disallow: /images/ Disallow: /includes/ Disallow: /js/ Disallow: /media/ Disallow: /portal/ Disallow: /styles/ Disallow: /WEB-INF/