MCP server

Crawlgraph

io.github.pipeworx-io/crawlgraph

Checked 26 Oct 2026, 08:29 UTC · Connected to it and listed its tools

CrawlGraph MCP — backlink intelligence on the public Common Crawl webgraph

Website Source

At a glance

Type

MCP server

Publisher

pipeworx.io (verified by the MCP Registry)

Status

Working at last check

Tools

48

Token cost

About 27,828 tokens per request

Sets up in

Claude Code, Claude Desktop, Codex, Gemini CLI, Cursor, VS Code, Antigravity, ChatGPT, OpenAI API, Grok

Last checked

26 Oct 2026, 08:29 UTC

Connect it to your agent

Add to CursorAdd to VS CodeVS Code Insiders

Opens the app, which shows the server and asks you to confirm. For other apps, copy the setup below.

Claude Code

claude mcp add --transport http crawlgraph https://gateway.pipeworx.io/crawlgraph/mcp

Claude Desktop

Settings → Connectors → Add custom connector, and paste the URL.

Codex (config.toml)

[mcp_servers.crawlgraph]
url = "https://gateway.pipeworx.io/crawlgraph/mcp"

Gemini CLI

{"mcpServers":{"crawlgraph":{"httpUrl":"https://gateway.pipeworx.io/crawlgraph/mcp"}}}

Cursor

{"mcpServers":{"crawlgraph":{"url":"https://gateway.pipeworx.io/crawlgraph/mcp"}}}

VS Code

{"servers":{"crawlgraph":{"type":"http","url":"https://gateway.pipeworx.io/crawlgraph/mcp"}}}

Antigravity

agy mcp add crawlgraph https://gateway.pipeworx.io/crawlgraph/mcp

ChatGPT

Settings → Apps & Connectors → Advanced settings: turn on Developer mode, then Create a connector and paste the URL. Which plans can do this varies.

OpenAI API (Responses tools)

{"type":"mcp","server_label":"crawlgraph","server_url":"https://gateway.pipeworx.io/crawlgraph/mcp","require_approval":"always"}

Grok (xAI API tools)

{"type":"mcp","server_label":"crawlgraph","server_url":"https://gateway.pipeworx.io/crawlgraph/mcp"}

Tools

• crawlgraph_backlinks ~346 tokens
  Referring domains for a target domain from the Common Crawl webgraph (4.4B edges, 120M domains). Returns linking domains ranked by CrawlGraph authority — useful for SEO audits, competitor backlink profiles, link-building gap research, and verifying who is citing a brand. One call = one quota credit.
• crawlgraph_domain_changes ~265 tokens
  Quarter-over-quarter diff of referring domains for a domain — what was added or lost between two Common Crawl releases. Useful for catching link rot, sudden spikes (PR coverage), and outreach campaign attribution. Counts as one call against the backlinks quota.
• crawlgraph_gap_analysis ~289 tokens
  Backlink gap analysis: find domains linking to your competitors but NOT to you. Submit your domain + 1–5 competitor domains and CrawlGraph runs an async job (typically completes in seconds; longer for large profiles). This tool polls up to ~10s and either returns the full gap list, or — if still run
• crawlgraph_gap_outreach_targets ~344 tokens
  The warm-outreach play: gap_analysis filtered to ONLY the linking domains that link to EVERY competitor you listed but not to you. These are the highest-conviction outreach candidates — every competitor in the set has the link, so the topic/audience is verified. Same async pattern as crawlgraph_gap_
• crawlgraph_gap_status ~179 tokens
  Poll a previously-submitted gap analysis job by ID. Use this when crawlgraph_gap_analysis or crawlgraph_gap_outreach_targets returned status=pending with a job_id — call this with the same job_id to retrieve the result once status=completed. Read-only; no quota cost.
• crawlgraph_releases ~102 tokens
  List the Common Crawl releases CrawlGraph has indexed (used as release_id in backlinks). Free; not counted against quota.

Browse

• GitHub tools
• Web scraping
• SEO
• Email marketing
• GitHub and code hosting

Related MCP servers

• Gapup
  271 agent-payable tools: competitive intel, finance, KYC, compliance, ESG. x402 per-call.
• CitedBy
  Check a page, AI-crawler access, llms.txt and backlinks of a site. Free, read-only.
• Rankparse
  SEO MCP server — backlinks, domain authority, tech stack, and 18+ tools via Common Crawl.
• Domain Search King
  Domain search MCP: .com names verified available live via Verisign RDAP - not AI guess lists
• Medigami
  Medigami: medical bill error scan, denial decoding, appeal deadlines, hospital price lookup
• AIYuCha Domain Intelligence
  Analyze public domain names: naming features, structural value, RDAP/ICP evidence, and comparisons.
• Seo Backlinks
  SEO Backlinks MCP — backlink intelligence via DataForSEO Backlinks API
• Crypto, web, finance and app data tools
  179 tools: crypto, EVM, SEC, FDA, NHTSA VIN, NWS weather, Eurostat, FRED, cloud & LLM prices, DNS.

Badge for your README

[![AptLynx](https://aptlynx.net/badge/io.github.pipeworx-io/crawlgraph.svg)](https://aptlynx.net/servers/io.github.pipeworx-io/crawlgraph)

Listing text is written by the maker; AptLynx lists tools and does not vouch for them. Find another tool · Browse by topic · For agents