User-agent: * Disallow: /assets/ Disallow: /images/ Disallow: /index_files/ Disallow: /js/