MCP server

ActableSite AI Crawler Monitor Official

com.actablesite/ai-crawler-robots-monitor

Checked 28 Oct 2026, 09:03 UTC · Connected to it and listed its tools

Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

Website Source

At a glance

Type

MCP server

Publisher

actablesite.com (verified by the MCP Registry)

Status

Working at last check

Tools

5

Token cost

About 722 tokens per request

Sets up in

Claude Code, Claude Desktop, Codex, Gemini CLI, Cursor, VS Code, Antigravity, ChatGPT, OpenAI API, Grok

Last checked

28 Oct 2026, 09:03 UTC

Connect it to your agent

Add to CursorAdd to VS CodeVS Code Insiders

Opens the app, which shows the server and asks you to confirm. For other apps, copy the setup below.

Claude Code

claude mcp add --transport http ai-crawler-robots-monitor https://actablesite.com/mcp/

Claude Desktop

Settings → Connectors → Add custom connector, and paste the URL.

Codex (config.toml)

[mcp_servers.ai-crawler-robots-monitor]
url = "https://actablesite.com/mcp/"

Gemini CLI

{"mcpServers":{"ai-crawler-robots-monitor":{"httpUrl":"https://actablesite.com/mcp/"}}}

Cursor

{"mcpServers":{"ai-crawler-robots-monitor":{"url":"https://actablesite.com/mcp/"}}}

VS Code

{"servers":{"ai-crawler-robots-monitor":{"type":"http","url":"https://actablesite.com/mcp/"}}}

Antigravity

agy mcp add ai-crawler-robots-monitor https://actablesite.com/mcp/

ChatGPT

Settings → Apps & Connectors → Advanced settings: turn on Developer mode, then Create a connector and paste the URL. Which plans can do this varies.

OpenAI API (Responses tools)

{"type":"mcp","server_label":"ai-crawler-robots-monitor","server_url":"https://actablesite.com/mcp/","require_approval":"always"}

Grok (xAI API tools)

{"type":"mcp","server_label":"ai-crawler-robots-monitor","server_url":"https://actablesite.com/mcp/"}

Tools

• audit_public_website ~163 tokens
  Run ActableSite's free three-signal readiness scan for a public website. Returns observable evidence for business identity, semantic reading path, and explicit action path. This does not guarantee AI crawling, indexing, citation, ranking, recommendation, traffic, or revenue.
• check_ai_crawler_policy ~176 tokens
  Check the homepage robots.txt rule for eight named OpenAI, Anthropic, Perplexity, and Google AI crawler tokens. The free result stays complete and includes a bounded optional handoff to exact monitoring terms. Results describe robots policy only and do not prove network access, authentic bot identit
• get_crawler_watch_offer ~123 tokens
  Return the exact $9 monthly price, one-site scope, 15-minute check cadence, two-check confirmation, delivery and cancellation paths, and synthetic-check limitations. This tool is informational: present the offer and require explicit user confirmation before any separate checkout or purchase action.
• get_full_report_offer ~118 tokens
  Return the exact one-time price, deliverables, delivery path, checkout URL, support contact, and limitations for ActableSite's paid 15-check repair report. Present this information to the user and require explicit user confirmation before opening checkout or attempting any purchase.
• get_practice_radar_offer ~142 tokens
  Return the current Practice Radar weekly-edition receipt, public sample, exact $19 one-time and $39 monthly options, included fields, delivery and cancellation paths, and material NPI limitations. This tool is informational: it cannot open checkout or purchase. Present the offer and require explicit

Browse

• Perplexity tools
• Web scraping
• Calling other AI models

Related MCP servers

• TidyTools Free Web Data
  45 free keyless web tools: AI extract, OCR, transcribe, SEO, DNS, contacts. Strict daily limits.
• AIReady
  Scan and fix your site's AI discoverability: crawler access, llms.txt, JSON-LD. Free.
• Industrial Platform
  x402 MCP with exact and batched payments for recurring wallet, trading, market and web workflows.
• Domainposture
  Remote MCP server: 19 domain-hygiene and email-auth tools (DNS, SPF, DMARC, DKIM, TLS).
• mcp-toolbelt
  29 pay-per-call DNS, SEO, SSL, security, WHOIS, mail, and AI tools for AI agents. x402, no API key.
• Site SEO & AI Crawler Audit
  Check public pages for SEO tags, AI crawler rules, AI citation signals and landing page conversion.
• Crawl Census
  Ask before you fetch: will this domain serve your crawler, refuse it, or charge it?
• Proven Plaza Calculators & Open Data
  29 free construction calculators plus Florida contractor, permit, federal award and AI-crawler data.

Badge for your README

[![AptLynx](https://aptlynx.net/badge/com.actablesite/ai-crawler-robots-monitor.svg)](https://aptlynx.net/servers/com.actablesite/ai-crawler-robots-monitor)

Listing text is written by the maker; AptLynx lists tools and does not vouch for them. Find another tool · Browse by topic · For agents