Tag của Plugin: robots.txt
-
Sitemapster – Fast XML & Image Sitemaps
Help search engines discover your content with fast XML and image sitemaps, smart caching, and simple controls. WooCommerce support in Pro.
-
Valvai – AI Traffic Control Center
Block, log and monetise AI crawlers directly from your WordPress dashboard.
-
AI Blackout – Block AI Crawlers & Stop AI Training
Stop AI companies scraping your posts to train their chatbots. Block AI crawlers, state your terms, and switch off the AI inside WordPress.
-
Elthian AI Licensing Lite
Manage how AI models interact with your content. Implements llms.txt, robots.txt, AI Sitemaps, and machine-readable JSON policies.
-
Index Harmony
One-click AI readiness plus real AI-crawler analytics: llms.txt, bot rules, schema, and per-page AI crawl insights — free.
-
Turksem GEOSEO – Generative Engine Optimization & SEO Audit
Track the AI bots crawling your site: GPTBot, ClaudeBot, PerplexityBot and more. Audit your SEO, control AI crawler access, and prove what changed.
-
A3 Robots Warning
Warns you of server IP address changes, so you can take care of Search Engine Visibility settings.
-
SEO Auditor Tools
Scan your WordPress site for SEO issues and get actionable fixes. Includes AI Helper, sitemap, robots.txt, LLMS.txt, Open Graph, cookie consent, analy …
-
Kandeshop LLMS.txt Generator
Create and manage an llms.txt file from your WordPress admin to guide LLM/AI crawlers. Set policies and disallow rules.
-
Foundash AI Access Check
Find out whether ChatGPT, Claude, Perplexity and Google's AI can actually read your website. Takes about ten seconds.
-
VDL Search Visibility Scanner – Noindex, Sitemap & SEO Audit
Check whether WordPress pages are technically discoverable with noindex, robots.txt, canonical, sitemap, redirect, and status-code checks.
-
AKSA AI Monitor – AI Crawler Analytics & Bot Control
Measure detected AI crawler activity, see which content is accessed, identify AI referral visits, and manage bot access locally.
-
Mephivio Robots LLMs
Generates llms.txt, llms-full.txt, JSON-LD and robots.txt discovery files for AI agents and search crawlers, without promising ranking gains.
-
AI Visibility Control – Dynamic llms.txt & robots.txt Crawler Control
Manage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.
-
AWP Disallow Root Control
Disallow access to the root directory via robots.txt with an option to enable or disable.
-
Phylax AI Crawler Inspector
Inspect how this site responds to AI-related agents. Audit robots.txt, llms.txt, redirects, headers and HTML without changing the site.
-
M7tawa LLMS.txt Manager
Manage llms.txt and robots.txt with local generation, virtual fallback, conflict detection, and a built-in safety audit.
-
Everlange Connect – llms.txt, AI robots.txt & JSON-LD
Free llms.txt and AI-crawler robots.txt for your site, generated locally — no account needed. Get cited by ChatGPT, Perplexity, Claude and Gemini.
-
AI Rights Protection by SimpleFeed
Protect your rights by reviewing and blocking AI bots from using your content without compensation.
-
CrawlPod AI Visibility
See which AI crawlers visit your site and which pages they've never fetched, control their access, and publish llms.txt. No external requests.