Spraudņa birka: robots.txt
-
Block eCommerce Assets via robots.txt
(0 vērtējumu kopsumma)Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
-
Check Search Engine Visibility on Migration
(1 vērtējumu kopsumma)Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.
-
Unblock CSS & JS for Googlebot
(0 vērtējumu kopsumma)Modifies robots.txt to allow Googlebot access JS and CSS files.
-
CeeWP Robots.txt Manager
(0 vērtējumu kopsumma)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
AI Deny
(1 vērtējumu kopsumma)Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
-
Block Common Crawl via robots.txt
(0 vērtējumu kopsumma)Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
Copyright AI Content Licensing – Block AI Crawlers + Get Paid
(0 vērtējumu kopsumma)AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
-
Block Feed and Comments via robots.txt
(0 vērtējumu kopsumma)Blocks some Feed and Comment resources in order to avoid spam bots
-
IntentDeep Virtual Files – AI-Ready: Robots.txt, Security.txt, Ads.txt, LLMS.txt
(1 vērtējumu kopsumma)Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.
-
ProAI TXT Manager for LLMS and Robots
(1 vērtējumu kopsumma)Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.
-
ChatBot Blocker by CellarWeb
(0 vērtējumu kopsumma)ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
-
LJPL Armored robots.txt
(0 vērtējumu kopsumma)Add some directives to your robots.txt file to keep your site safer
-
HumanGate
(0 vērtējumu kopsumma)Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.
-
Thin Content Manager
(1 vērtējumu kopsumma)See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
-
Robots.txt Extender
(0 vērtējumu kopsumma)Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
AI Visibility Control – Dynamic llms.txt & robots.txt Crawler Control
(0 vērtējumu kopsumma)Manage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.
-
AI Rights Protection by SimpleFeed
(1 vērtējumu kopsumma)Protect your rights by reviewing and blocking AI bots from using your content without compensation.
-
AKSA AI Monitor – AI Crawler Analytics & Bot Control
(0 vērtējumu kopsumma)Measure detected AI crawler activity, see which content is accessed, identify AI referral visits, and manage bot access locally.
-
GoBookMart Robots Editor
(1 vērtējumu kopsumma)A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.
-
Everlange Connect – llms.txt, AI robots.txt & JSON-LD
(0 vērtējumu kopsumma)Free llms.txt and AI-crawler robots.txt for your site, generated locally — no account needed. Get cited by ChatGPT, Perplexity, Claude and Gemini.