# robots.txt for https://deepleex.ai/ # Goal: allow search engines and AI answer engines to crawl public content. User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: GPTBot User-agent: Googlebot User-agent: Google-Extended User-agent: GoogleOther User-agent: Bingbot User-agent: DuckDuckBot User-agent: PerplexityBot User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Twitterbot Allow: / Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-login.php Disallow: /xmlrpc.php Disallow: /?s= Disallow: /*?s= Disallow: /*?replytocom= Disallow: /*?preview=true Disallow: /*?elementor-preview= User-agent: * Allow: / Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-login.php Disallow: /xmlrpc.php Disallow: /?s= Disallow: /*?s= Disallow: /*?replytocom= Disallow: /*?preview=true Disallow: /*?elementor-preview= Sitemap: https://deepleex.ai/sitemap_index.xml