MCP server
Octocrawl
io.github.77777R7/octocrawl
Checked 26 Oct 2026, 08:29 UTC · It answered and asked for a sign-in
Web pages as clean Markdown and JSON for AI agents, in fewer tokens, with an Evidence Record.
Signs in with your account2 tools
https://mcp.octocrawl.dev/mcp-oauth
At a glance
- Type
- MCP server
- Publisher
- Not verified
- Status
- Signs in with your account
- Tools
- 2
- Sets up in
- Claude Code, Claude Desktop, Codex, Gemini CLI, Cursor, VS Code, Antigravity, ChatGPT, OpenAI API, Grok
- Last checked
- 26 Oct 2026, 08:29 UTC
Connect it to your agent
Opens the app, which shows the server and asks you to confirm. For other apps, copy the setup below.
Claude Code
claude mcp add --transport http octocrawl https://mcp.octocrawl.dev/mcp-oauth
Claude Desktop
Settings → Connectors → Add custom connector, and paste the URL.
Codex (config.toml)
[mcp_servers.octocrawl] url = "https://mcp.octocrawl.dev/mcp-oauth"
Gemini CLI
{"mcpServers":{"octocrawl":{"httpUrl":"https://mcp.octocrawl.dev/mcp-oauth"}}}
Cursor
{"mcpServers":{"octocrawl":{"url":"https://mcp.octocrawl.dev/mcp-oauth"}}}
VS Code
{"servers":{"octocrawl":{"type":"http","url":"https://mcp.octocrawl.dev/mcp-oauth"}}}
Antigravity
agy mcp add octocrawl https://mcp.octocrawl.dev/mcp-oauth
ChatGPT
Settings → Apps & Connectors → Advanced settings: turn on Developer mode, then Create a connector and paste the URL. Which plans can do this varies.
OpenAI API (Responses tools)
{"type":"mcp","server_label":"octocrawl","server_url":"https://mcp.octocrawl.dev/mcp-oauth","require_approval":"always"}
Grok (xAI API tools)
{"type":"mcp","server_label":"octocrawl","server_url":"https://mcp.octocrawl.dev/mcp-oauth"}
Signs in with your account: your agent app opens a sign-in page the first time you use it.
Tools
map~973 tokens
List a site's URLs without reading each page: the start page's links (read over HTTP alone) and the entries of the sitemaps the site declares, within one deadline. URLs stay in scope (the start host and its www twin, the start path's subtree, assets left out, similar URLs folded) and robots.txt applscrapeBrowses the web · ~1807 tokens
Read one URL as Markdown with its Evidence Record (final URL, fetch time, HTTP status, robots.txt decision, hashes), over HTTP first and in the browser when the page needs it. Not for: many URLs or a whole site section. Compact by default; debug adds the full audit. warnings name what the content ca
Browse
Related MCP servers
- inktomd MCP Server
Convert files, URLs, and documents to clean, AI-ready Markdown via MCP. - Vanshulgoyal101
Read any web page as clean Markdown for AI agents: fetch, search, metadata, links. SSRF-safe. - Slipstream
Shared distillation cache for AI agents — every fetch ~73-89% fewer tokens via a shared cache. - Stringer CleanExtract
Convert public HTML or a public URL into token-dense Markdown through one remote MCP tool. - WearableDocs
Refusal of anatomical gift in 50 states and DC, plus the WearableDocs FAQ, products, prices, search. - Crawlbase
Crawlbase MCP — wraps the Crawlbase Crawling API (crawlbase.com, formerly ProxyCrawl). One… - Contrie
Extract structured data from a web page, read it as markdown, verify values against the source. - FutureSmart AI Demos
Search evidence-backed AI-tool reviews, rankings, use cases, comparisons & toolkits (read-only).
Badge for your README
[](https://aptlynx.net/servers/io.github.77777R7/octocrawl)
Listing text is written by the maker; AptLynx lists tools and does not vouch for them. Find another tool · Browse by topic · For agents