MCP server

CrawlCheck

io.github.emmanuelorta/crawlcheck

Checked 25 Oct 2026, 20:29 UTC · Connected to it and listed its tools

Verification layer for the agentic web: a signed answer about any site before an agent acts.

Website Source

At a glance

Type

MCP server

Publisher

Not verified

Status

Working at last check

Tools

25

Token cost

About 4,034 tokens per request

Sets up in

Claude Code, Claude Desktop, Codex, Gemini CLI, Cursor, VS Code, Antigravity, ChatGPT, OpenAI API, Grok

Last checked

25 Oct 2026, 20:29 UTC

Connect it to your agent

Add to CursorAdd to VS CodeVS Code Insiders

Opens the app, which shows the server and asks you to confirm. For other apps, copy the setup below.

Claude Code

claude mcp add --transport http crawlcheck https://crawlcheck.io/mcp

Claude Desktop

Settings → Connectors → Add custom connector, and paste the URL.

Codex (config.toml)

[mcp_servers.crawlcheck]
url = "https://crawlcheck.io/mcp"

Gemini CLI

{"mcpServers":{"crawlcheck":{"httpUrl":"https://crawlcheck.io/mcp"}}}

Cursor

{"mcpServers":{"crawlcheck":{"url":"https://crawlcheck.io/mcp"}}}

VS Code

{"servers":{"crawlcheck":{"type":"http","url":"https://crawlcheck.io/mcp"}}}

Antigravity

agy mcp add crawlcheck https://crawlcheck.io/mcp

ChatGPT

Settings → Apps & Connectors → Advanced settings: turn on Developer mode, then Create a connector and paste the URL. Which plans can do this varies.

OpenAI API (Responses tools)

{"type":"mcp","server_label":"crawlcheck","server_url":"https://crawlcheck.io/mcp","require_approval":"always"}

Grok (xAI API tools)

{"type":"mcp","server_label":"crawlcheck","server_url":"https://crawlcheck.io/mcp"}

Tools

• best_source ~246 tokens
  Call when choosing WHICH business or site to cite, recommend or call. Give domains (2-10 candidate sites you found) or trade and city for a measured market. Returns the candidates ranked by what CrawlCheck verified (preflight decision for cite, security and threat listing, domain age, uptime, publis
• corpus_state ~83 tokens
  Coverage of CrawlCheck's public dataset: how many distinct domains have been measured and how they split by platform, rendering, size, language and kind, with the strata that are still under-sampled.
• crawler_path ~234 tokens
  Where each crawler's path into a domain dies, as an observed data flow: edge decision, robots.txt as a file, robots.txt rules, then the page, JSON-LD, sitemap, llms.txt and entitymap.json it reached. Give agent (e.g. ClaudeBot, GPTBot, googlebot) for one identity's path and a one-line answer; omit i
• draft_llms ~87 tokens
  Draft an llms.txt from the domain's own homepage and up to 25 declared pages, using their titles and descriptions. A draft for the owner to cut down, not a publication.
• explain_finding ~222 tokens
  Why CrawlCheck decided a finding: the rule and its revision, the exact fetches it compared (identity, status, bytes, sha256), when the condition held on the site, and a Merkle proof that the decision is inside the signed manifest. Give id (a d1: decision or f1: finding id from a report) or domain fo
• field_check ~388 tokens
  Call before using a phone number, address, opening hours or service area you hold for a business. One signed verdict per business field. field=phone|address|hours|service_area and value= the value you hold. phone: matches, former_value (with dates), not_this_business (the site never published it and
• fix_entitymap ~107 tokens
  A starter entitymap.json built from the domain's latest scan record: name, phone, coordinates and declared service areas as entities with SERVES relations. Fields the page never stated are marked TODO, never guessed. Needs a prior scan.
• fix_machine_chain ~156 tokens
  A fix plan for MACHINE_CHAIN_HEAVY: the files a crawler reads before the page and the 404s absent agent files return, then measured reductions (llms.txt to an index, a sitemap index, robots.txt comments and duplicate groups, minified JSON, short 404s) with the chain size after each and the step at w
• fix_mostly_code ~162 tokens
  A fix plan for PAGE_IS_MOSTLY_CODE: the homepage's measured bytes by category, the largest blocks with what to do with each, ordered steps with the text ratio after each, and the step at which the detector would stop firing - or, when moving code cannot clear it, how much markup to cut or text to ad
• fix_robots ~113 tokens
  The domain's served robots.txt, corrected: * group rules copied into named groups that lacked them (shadowing), a Sitemap line added when missing, a minimal replacement when the served file was HTML. Every change is listed at the top; nothing else is touched.
• fix_stale_cache ~146 tokens
  A fix plan for STALE_CACHE_SERVED: the homepage fetched now, its Age, the cache layers that name themselves in the headers in purge order (innermost first), the HTML lifetime each response declares, a fresh-read comparison, and whether a purge clears the finding and keeps it cleared.
• list_verified_capabilities ~183 tokens
  What a domain declares agents can do (OpenAPI operations, MCP tools, A2A skills, API catalog entries), each classed by safety (read_only_public up to financial), and which ones CrawlCheck actually called and confirmed - plus every mismatch between declaration and behaviour. Only read-only public act
• machine_record ~127 tokens
  The unified machine record for one observation: subject, grade, findings (the top one in full without a licence), capabilities with verification, and the evidence roots, manifest and verifier links that let anyone check it offline. Give id (report, d1:, f1: or manifest sha256) or domain for the late
• mcp_servers ~132 tokens
  Which remote MCP servers the official MCP Registry lists on a domain, and what each endpoint actually answered when CrawlCheck sent the MCP handshake (initialized, auth_required, unreachable, tool count, tool-list drift). Use before selecting an MCP tool from that domain.
• preflight ~321 tokens
  Call BEFORE reading, citing, connecting to or transacting with a domain. Returns a signed decision: allow, warn, require_confirmation, block or unsupported, with every step that led there and the resolve answer it was made from. Pass your crawler token as agent so robots.txt is checked for you. A po
• public_counts ~90 tokens
  The figures CrawlCheck quotes about itself, read from the source: sites_measured, domains_in_corpus, crawler_visits (a rolling window), sections, sections_scored, findings_published, guides_published, with an at timestamp.
• registry_lookup ~205 tokens
  Whether a domain is in CrawlCheck's registry and what it serves: llms.txt, agents.md, a media kit at /.well-known/media-kit.json, a reciprocity-tested entity graph, an AI access policy that names crawlers, and agent-callable surfaces. With no domain, returns the shelf counts across every measured si
• resolve_domain ~237 tokens
  Call before fetching from, citing, connecting to or transacting with a domain. Returns one signed answer: what the domain claims, what it actually serves each crawler identity, who controls it, what CrawlCheck's published rules decide for each action (a decision for read, cite, connect and transact,
• resolve_robots ~132 tokens
  Resolve every named answer engine, search index and training crawler against a domain's robots.txt the way a crawler does: most-specific group only, longest match, allow wins a tie. Shows when a Disallow under * does not apply to an agent with its own group.
• scan_domain ~122 tokens
  Scan a public domain as several crawler identities and return the graded record: grade, AI-visibility score, per-section scores, findings with evidence, and whether the origin refused CrawlCheck. One scan takes 5-15 seconds.
• telemetry ~72 tokens
  Verified-crawler traffic observed at crawlcheck.io itself: which named agents arrived, how many claims were confirmed against operator ranges, how many were forged.
• verify_crawler_log ~138 tokens
  Given raw web-server access-log lines, decide for each line that names a crawler (GPTBot, ClaudeBot, Googlebot, PerplexityBot...) whether the source IP falls inside that operator's published ranges. Returns verified, spoofed, or unverifiable when the operator publishes no ranges.
• video_channel ~107 tokens
  Every upload on a YouTube channel, read 50 at a time, sorted by views. The upload list is free; the per-check tally needs a Watch licence and is not offered here.
• video_check ~108 tokens
  One YouTube video against the video anchor model: metadata, chapters, captions and storyboard where observed, twelve checks each naming what it reads.
• video_site ~116 tokens
  The site half of video: homepage plus up to 60 sitemap pages read for YouTube embeds, facades and page-builder widgets, VideoObject nodes and their required properties, and - with a handle - how many of the channel's videos the site carries.

Browse

• GitHub tools
• OpenAPI tools
• Web scraping
• Web search
• Website monitoring
• Payments

Related MCP servers

• jakehandy.com
  Search, read, cite and react to Jake Handy's writing on AI, music tech and agentic engineering.
• Eyepup
  Agentic visitor analytics — five tools that hand the next CRO fix to your coding agent.
• Grounded Aeo
  Audit and fix a site for AI citation + SEO, verify it, then publish a v=AEO1 record.
• Capabilityhostprotocol Chp
  Learn and adopt the Capability Host Protocol — the agentic web's open evidence layer.
• Knowledge Base
  Search verified local businesses, check what their verification proves, and message them.
• Everloot: WoW Forever data
  WoW: Forever lore and player-observed drops, vendors, quests, professions and talents, with sources.
• Agent^Rider
  Signed agent identity, trust scoring, credit economy, and social layer for AI agents.
• Grideōs Facts
  Read-only facts about Grideōs from its signed, hash-chained ledger. Verify before you cite.

Badge for your README

[![AptLynx](https://aptlynx.net/badge/io.github.emmanuelorta/crawlcheck.svg)](https://aptlynx.net/servers/io.github.emmanuelorta/crawlcheck)

Listing text is written by the maker; AptLynx lists tools and does not vouch for them. Find another tool · Browse by topic · For agents