Značka tykača: crawlers
-
Block AI Crawlers
( Pohódnoćenja dohromady: 8)Adds robots.txt rules blocking AI crawlers and AI bots.
-
Robots.txt rewrite
( Pohódnoćenja dohromady: 2)Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
-
AI Content Signals
( Pohódnoćenja dohromady: 3)Control how AI uses your content — search, AI answers or training — via robots.txt Content Signals, HTTP headers, meta tags and TDMRep.
-
CodingBunny LLMs.txt Generator
( Pohódnoćenja dohromady: 1)Advanced llms.txt generator with AI metadata, Schema.org types, canonical URLs, and differentiated licenses for optimal LLM indexing.
-
Robots Meta Whiz
( Pohódnoćenja dohromady: 0)Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.
-
-
Serve Markdown
( Pohódnoćenja dohromady: 0)Serve Markdown versions of your posts and pages to AI agents and crawlers. Content negotiation, .md URLs, auto-discovery, and crawler logging.
-
ParseLess
( Pohódnoćenja dohromady: 0)Serve your posts as Markdown to AI crawlers and CLI tools — typically 95%+ less bandwidth, ~60–80% fewer DB queries, no theme bloat.
-
CeeWP Robots.txt Manager
( Pohódnoćenja dohromady: 0)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
Seo Crawlytics Data Export & Delete
( Pohódnoćenja dohromady: 0)Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.
-
Log-Hero.com Plugin
( Pohódnoćenja dohromady: 1)Analyze how search engines and other bots crawl and understand your web page. The official PHP Wordpress plugin for log-hero.com.
-
Temso AI
( Pohódnoćenja dohromady: 0)Stream front-end request logs from your WordPress origin to Temso so AI-crawler and bot traffic shows up in your dashboard.
-
LJPL Armored robots.txt
( Pohódnoćenja dohromady: 0)Add some directives to your robots.txt file to keep your site safer
-
Supertab Connect
( Pohódnoćenja dohromady: 1)Connect your WordPress site to the Supertab Connect platform for RSL license serving and enabling crawler authentication protocol.
-
PufferSights – AI Crawler Insights
( Pohódnoćenja dohromady: 0)Monitor 100+ known AI crawler and AI agent user agents with local analytics, AI referrals, llms.txt, and opt-in robots.txt policy tools.
-
Frenemy
( Pohódnoćenja dohromady: 0)See every bot that reaches WordPress — search crawlers, AI agents, scrapers, impostors — classified and identity-verified, in one dashboard.
-
AI Rights Protection by SimpleFeed
( Pohódnoćenja dohromady: 1)Protect your rights by reviewing and blocking AI bots from using your content without compensation.
-
Botkibble
( Pohódnoćenja dohromady: 0)Serves every published post and page as Markdown for AI agents and crawlers. No configuration, no API keys. Activate and it works.