# robots.txt for Anlook # Allow all bots to crawl all content except specific directories User-agent: * Disallow: /admin/ Disallow: /private/ Disallow: /some-other-directory/ # Disallow crawling of dynamic URL parameters (if applicable) Disallow: /*?* # Allow specific bots to access all content User-agent: Googlebot Disallow: User-agent: Bingbot Disallow: # Sitemap location Sitemap: https://www.anlook.com/sitemap.xml