MCP server

Robotstxt Ai

io.github.sharozdawa/robotstxt-ai

Checked 26 Oct 2026, 08:31 UTC · Still published on its registry; checked against OSV.dev; never run by us

Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.

Runs on your computer

Source

At a glance

Type: MCP server
Publisher: Not verified
Status: Runs on your computer
Sets up in: Claude Code, Claude Desktop, Codex, Gemini CLI, Cursor, VS Code
Last checked: 26 Oct 2026, 08:31 UTC

Connect it to your agent

Add to Cursor Add to VS Code VS Code Insiders

Opens the app, which shows the server and asks you to confirm. It then runs the package on your computer with your permissions. For other apps, copy the setup below.

Claude Code

claude mcp add robotstxt-ai -- npx -y robotstxt-ai-mcp@1.0.1

Claude Desktop

{"mcpServers":{"robotstxt-ai":{"command":"npx","args":["-y","robotstxt-ai-mcp@1.0.1"]}}}

Codex (config.toml)

[mcp_servers.robotstxt-ai]
command = "npx"
args = ["-y","robotstxt-ai-mcp@1.0.1"]

Gemini CLI

{"mcpServers":{"robotstxt-ai":{"command":"npx","args":["-y","robotstxt-ai-mcp@1.0.1"]}}}

Cursor

{"mcpServers":{"robotstxt-ai":{"command":"npx","args":["-y","robotstxt-ai-mcp@1.0.1"]}}}

VS Code

{"servers":{"robotstxt-ai":{"type":"stdio","command":"npx","args":["-y","robotstxt-ai-mcp@1.0.1"]}}}

Runs on your computer with your permissions: check the package and its source before installing.

Browse

Related MCP servers

Spook SEO
Free SEO tools + the Spook SEO autopilot: analyze domains, generate and publish SEO articles.
Ai Visibility
AI-search-visibility tools: check crawler access, generate llms.txt, lint robots.txt, census data.
RankRoot: AI visibility audit
Audit a site's visibility to ChatGPT, Perplexity, Claude and AI agents. Generates llms.txt.
Seegeo
Audit any website for AI visibility: graded report, findings with fixes, AI crawler access check.
Crawler Log Triage
{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key
ASRM (AI Search Rank Monitor)
Check a website's AI readiness and answer AI visibility and GEO questions from ASRM's guides.
Robots.txt & AI Crawler Checker
robots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check.
CitedBy
Check a page, AI-crawler access, llms.txt and backlinks of a site. Free, read-only.

Badge for your README

[![AptLynx](https://aptlynx.net/badge/io.github.sharozdawa/robotstxt-ai.svg)](https://aptlynx.net/servers/io.github.sharozdawa/robotstxt-ai)

Listing text is written by the maker; AptLynx lists tools and does not vouch for them. Find another tool · Browse by topic · For agents