User-agent: * Disallow: /web/ Disallow: /js/ Disallow: /error/ Disallow: /css/