Tools · Web Scraping
Best MCP servers for web scraping
384 MCP servers in the Official MCP Registry do web scraping. 268 can be used as a hosted endpoint, with nothing to install, and 224 publish their source code.
| # | Tool | Relevance | Connect | Code | Seen |
|---|---|---|---|---|---|
| 301 | browser-forest Undetectable cloud browser sessions for AI agents and scrapers. Navigate, extract, click, captcha. | In description scrapers | HOSTEDLOCAL | — | 3d ago |
| 302 | 402registry Does an AI crawler see your site? Free registry lookup, x402 pricing; checks paid in USDC on Base. | In description crawler | HOSTEDLOCAL | — | 3d ago |
| 303 | Scrappa Scraping API for Google Search, Maps, Flights, Jobs, YouTube, LinkedIn, Trustpilot and more. | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 304 | Parser Club Telegram/VK audience scraping, marketplaces, Russian government registers. Free open dataset. | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 305 | Site Check Look at what your website or online store tells crawlers, link previews and AI agents. | In description crawlers | HOSTEDLOCAL | — | 3d ago |
| 306 | Goro 62 real-world tools for agents: search, scraping, social, enrichment, image, video, voice. | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 307 | NativePort 30+ web-access and AI APIs behind one key: search, scraping, browsers, voice, OCR and LLMs. | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 308 | mcp-server Enable your AI agents to scrape and parse web content dynamically, including geo-restricted sites | In description scrape | HOSTEDLOCAL | Open | 26m ago |
| 309 | seo-audit-console Technical SEO in Claude: GSC + crawl + DataForSEO - audit, market sizing, content recon. | In description crawl | HOSTEDLOCAL | Open | 22h ago |
| 310 | acrawl Autonomous web crawler. 17 browser tools + goal-driven run_goal agent. Single binary, stealth. | In description crawler | HOSTEDLOCAL | Open | 2d ago |
| 311 | SeleniumBase MCP Stealthy browser automation, testing, and web-scraping via CDP Mode. | In description scraping | HOSTEDLOCAL | Open | 2d ago |
| 312 | mcp Scrape any website, extract structured data, and collect web content at scale with AI agents | In description scrape | HOSTEDLOCAL | Open | 3d ago |
| 313 | pagerender What search and AI crawlers extract from any public URL. Five of nine tools need no token. | In description crawlers | HOSTEDLOCAL | Open | 3d ago |
| 314 | google-researcher MCP server providing Google Search, web scraping, and multi-source research tools for AI assistants | In description scraping | HOSTEDLOCAL | Open | 3d ago |
| 315 | one-search-mcp Web search, URL discovery, scraping & extraction with agent-browser and search providers | In description scraping | HOSTEDLOCAL | Open | 3d ago |
| 316 | scrapio-mcp Fetch, crawl, and search the web: Google, Amazon, Walmart, Booking.com, Agoda, and YouTube data. | In description crawl | HOSTEDLOCAL | Open | 3d ago |
| 317 | webbersites-x402-mcp 45 pay-per-call AI agent tools + wallet-owned agent memory. Scraping, SEO, lint, crypto. x402 USDC | In description scraping | HOSTEDLOCAL | Open | 3d ago |
| 318 | Web Resurrect Resurrect expired domains: scrape Wayback, AI-rewrite, generate images, publish to WordPress. | In description scrape | HOSTEDLOCAL | Open | 3d ago |
| 319 | CrawlEyes MCP Server Web scraping & search for AI agents: extract, SearXNG search, rerank, robots compliance. No API key. | In description scraping | HOSTEDLOCAL | Open | 3d ago |
| 320 | thunderbit-mcp-server AI-powered web scraping MCP. Distill pages to Markdown or extract structured data via JSON Schema. | In description scraping | HOSTEDLOCAL | Open | 3d ago |
| 321 | terradeed-mcp-server TerraDeed MCP server — x402 web scraping & structured extraction. Pay-per-call with USDC on Base. | In description scraping | HOSTEDLOCAL | Open | 3d ago |
| 322 | kitbag-mcp Zero-config MCP server bundling 50+ utility tools: converters, OCR, scraping, and formatters. | In description scraping | HOSTEDLOCAL | Open | 3d ago |
| 323 | Evocrawl MCP Server MCP server for Evocrawl — search, scrape, and interact with the web. | In description scrape | HOSTEDLOCAL | Open | 3d ago |
| 324 | geo-tool-check Is this page readable for AI search? Crawler access, structure and citability checks, runs locally. | In description crawler | HOSTEDLOCAL | Open | 3d ago |
| 325 | robotstxt-ai Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot. | In description crawler | HOSTEDLOCAL | Open | 3d ago |
| 326 | Black SEO Analyzer Audit a page or crawl a whole site for technical SEO issues, locally. Compares crawls. | In description crawl | HOSTEDLOCAL | Open | 3d ago |
| 327 | OpenGraph.io MCP Server MCP server for OpenGraph.io API - fetch OG data, screenshots, scrape, and generate images | In description scrape | HOSTEDLOCAL | Open | 3d ago |
| 328 | scrapercity-cli B2B lead generation MCP server - 20+ scrapers, email finder, skip trace, and more. | In description scrapers | HOSTEDLOCAL | Open | 3d ago |
| 329 | ScrapeBadger Twitter/X scraping API for AI agents. Get profiles, tweets, trends, and more. | In description scraping | HOSTEDLOCAL | Open | 3d ago |
| 330 | web Web scraping, search, monitoring, and HTML-to-markdown for AI agents | In description scraping | HOSTEDLOCAL | Open | 3d ago |
| 331 | rasterly Web toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site. | In description crawl | HOSTEDLOCAL | Open | 3d ago |
| 332 | MCP SEO Auditor Read-only static SEO audits and bounded crawling for AI agents. | In description crawling | HOSTEDLOCAL | Open | 3d ago |
| 333 | gate402-mcp x402 pay-per-call agent APIs: LLM inference, Base trading data, SEC filings & scraping | In description scraping | HOSTEDLOCAL | Open | 3d ago |
| 334 | superhighway-mcp Web search for AI agents — 5 tools: search, news, images, scrape, research. x402/USDC or API key. | In description scrape | HOSTEDLOCAL | Open | 3d ago |
| 335 | Web Page Fetcher Fetch web pages with SSRF protection. Returns clean, readable markdown from any URL. | In description fetch web pages | HOSTEDLOCAL | Open | 3d ago |
| 336 | YaCy peer-to-peer search Web search, crawling and ranking evaluation on your own YaCy peer: no API key, no central service. | In description crawling | HOSTEDLOCAL | Open | 3d ago |
| 337 | sociavault-mcp Scrape social data from TikTok, Instagram, YouTube, X, LinkedIn, Reddit, and ad libraries. | In description scrape | HOSTEDLOCAL | Open | 3d ago |
| 338 | XActions X/Twitter automation MCP: scrape, post, schedule, analyze, engage. No API key required. | In description scrape | HOSTEDLOCAL | Open | 3d ago |
| 339 | prometheus-mcp Prometheus MCP — query metrics, inspect alerts, and explore scrape targets (read-only). | In description scrape | HOSTEDLOCAL | Open | 3d ago |
| 340 | seo-backlinks Backlinks, Domain Rating & expired-domain drops via seo-backlinks.net (Common Crawl) | In description crawl | HOSTEDLOCAL | Open | 3d ago |
| 341 | web-tools-mcp 10 no-LLM web tools: URL to Markdown, metadata, JSON-LD, MX, scrape, RSS, DNS, RDAP, SSL, HTTP. | In description scrape | HOSTEDLOCAL | Open | 3d ago |
| 342 | PyScrappy Web-scraping toolkit with 22 tools for structured web data as JSON for AI agents. | In description scraping | HOSTEDLOCAL | Open | 3d ago |
| 343 | MaxAEO AI Visibility MCP Local-first MCP server for AI visibility, GEO/AEO, llms.txt, and AI crawler readiness audits. | In description crawler | HOSTEDLOCAL | Open | 3d ago |
| 344 | dotrepo Trust-aware repository facts for agents: build, test, docs, license, and security, no scraping. | In description scraping | HOSTEDLOCAL | Open | 3d ago |
| 345 | TheCrawler Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support. | In description scraper | HOSTEDLOCAL | Open | 3d ago |
| 346 | Passiv Web Tools Free web tools for AI agents: HTML to Markdown, compliance scan, page profile, security headers. | In description html to markdown | HOSTEDLOCAL | Open | 3d ago |
| 347 | AI Visibility Checker AI visibility checker: GPTBot vs OAI-SearchBot, robots.txt audit, raw-HTML schema. 165 crawlers. | In description crawlers | HOSTEDLOCAL | Open | 3d ago |
| 348 | Prerender Buddy Local MCP tools for crawler-readability and discovery-file diagnostics. | In description crawler | HOSTEDLOCAL | Open | 3d ago |
| 349 | Siftdog Self-hosted, Tavily-compatible web search, extract, crawl and map tools for AI agents. | In description crawl | HOSTEDLOCAL | Open | 3d ago |
Ready-made AI agents
Other use cases
FAQ
How many MCP servers are there for web scraping?
Electra Index lists 384 active MCP servers for web scraping from the Official MCP Registry. 268 offer a hosted endpoint and 224 publish their source code.
Is there a hosted MCP server for web scraping, with nothing to install?
Yes. browser-forest, 402registry and Scrappa declare a remote endpoint you add to your assistant's MCP settings.
Is there a ready-made AI agent for web scraping instead?
Yes. If you prefer a finished product to plugging tools into your own assistant, Apify, Browser Use and Firecrawl do this out of the box.
How this list is ordered: a tool comes first when the use case appears in its name rather than only in its description, then when its description covers more aspects of the use case, then when it offers a hosted endpoint, then when its source code is public, then by how recently our robot saw it in the Official MCP Registry. The match to web Scraping comes from the publisher's description (keyword method), not from a test of the tool. Only active tools with a real description are listed. No tool pays to appear here.