Back to search
30
MCP

io.github.sharozdawa/robotstxt-ai

io.github.sharozdawa/robotstxt-ai

Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.

Uptime
0.0%
3 probes
Response
0ms
last probe
Tools
0
callable
Primary URL
—

Similar MCP servers embedding-nearest

io.github.rog0x/log
Log parse, filter, analyze for AI agents
0 tools
io.github.rog0x/web
Web scraping, search, monitoring, and HTML-to-markdown for AI agents
0 tools
io.github.rog0x/testing
Test generation, mocks, coverage analysis for AI agents
0 tools
io.github.sharozdawa/ai-visibility
Track brand visibility across ChatGPT, Perplexity, Claude, and Gemini.
0 tools
io.github.rog0x/crypto
Hash, encode, UUID, password analysis for AI agents
0 tools
io.github.rog0x/string
String analyzer, diff, templates for AI agents
0 tools

How to use

Add to your Claude Desktop / Cursor / Cline MCP config:

{
  "mcpServers": {
    "io.github.sharozdawa/robotstxt-ai": {
      "url": "None",
      "transport": "http"
    }
  }
}