MCP server

Ai Crawler Policy

io.github.lazymac2x/ai-crawler-policy

Checked 26 Oct 2026, 08:29 UTC · Connected to it and listed its tools

Cloudflare Workers MCP server: ai-crawler-policy

Working at last check

https://api.lazy-mac.com/ai-crawler-policy/mcp

At a glance

Type: MCP server
Publisher: Not verified
Status: Working at last check
Sets up in: Claude Code, Claude Desktop, Codex, Gemini CLI, Cursor, VS Code, Antigravity, ChatGPT, OpenAI API, Grok
Last checked: 26 Oct 2026, 08:29 UTC

Opens the app, which shows the server and asks you to confirm. For other apps, copy the setup below.

Claude Code

claude mcp add --transport http ai-crawler-policy https://api.lazy-mac.com/ai-crawler-policy/mcp

Claude Desktop

Settings → Connectors → Add custom connector, and paste the URL.

Codex (config.toml)

[mcp_servers.ai-crawler-policy]
url = "https://api.lazy-mac.com/ai-crawler-policy/mcp"

Gemini CLI

{"mcpServers":{"ai-crawler-policy":{"httpUrl":"https://api.lazy-mac.com/ai-crawler-policy/mcp"}}}

Cursor

{"mcpServers":{"ai-crawler-policy":{"url":"https://api.lazy-mac.com/ai-crawler-policy/mcp"}}}

VS Code

{"servers":{"ai-crawler-policy":{"type":"http","url":"https://api.lazy-mac.com/ai-crawler-policy/mcp"}}}

Antigravity

agy mcp add ai-crawler-policy https://api.lazy-mac.com/ai-crawler-policy/mcp

ChatGPT

Settings → Apps & Connectors → Advanced settings: turn on Developer mode, then Create a connector and paste the URL. Which plans can do this varies.

OpenAI API (Responses tools)

{"type":"mcp","server_label":"ai-crawler-policy","server_url":"https://api.lazy-mac.com/ai-crawler-policy/mcp","require_approval":"always"}

Grok (xAI API tools)

{"type":"mcp","server_label":"ai-crawler-policy","server_url":"https://api.lazy-mac.com/ai-crawler-policy/mcp"}

OnPage.dev
Free SEO MCP that closes the loop: find, fix, ship as a PR or to a CMS, prove. 37 tools, no key.
Robots.txt Policy Lint
{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key
Engagemii Citation Watch
Brands ChatGPT names for real buyer questions, updated every 30 minutes, with AI visibility scores.
Cloudflare Radar
Cloudflare Radar MCP — internet observatory (traffic, attacks, BGP, quality)
ActableSite AI Crawler Monitor
Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.
Embedding Search
Cloudflare Workers MCP server: embedding-search
AI Crawler Access Check
Can GPTBot, ClaudeBot and PerplexityBot reach a site? Real fetch per crawler, firewall/CDN blocks.
Cloudflare
Cloudflare MCP servers

[![AptLynx](https://aptlynx.net/badge/io.github.lazymac2x/ai-crawler-policy.svg)](https://aptlynx.net/servers/io.github.lazymac2x/ai-crawler-policy)

Listing text is written by the maker; AptLynx lists tools and does not vouch for them. Find another tool · Browse by topic · For agents