Tools · Web Scraping
Best MCP servers for web scraping
384 MCP servers in the Official MCP Registry do web scraping. 268 can be used as a hosted endpoint, with nothing to install, and 224 publish their source code.
| # | Tool | Relevance | Connect | Code | Seen |
|---|---|---|---|---|---|
| 251 | Klisten SchemaShield Store and compare organization JSON snapshots. No database crawling. Customer key required. | In description crawling | HOSTEDLOCAL | — | 2d ago |
| 252 | Web Search & Data API Web search, scraping, Google Trends and data lookups. Paid per call in USDC on Base via x402. | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 253 | AIsa On-Page Audit Crawl a site: pages, resources, links, duplicates, tags, Lighthouse and raw HTML. | In description crawl | HOSTEDLOCAL | — | 3d ago |
| 254 | AgentMart Procurement Procure, compare, quote, budget, and execute web extraction or scraping across providers for agents | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 255 | ThirdMade Shelf 26 pay-per-call tools for agents: scrape, verify, guards, crypto. x402 USDC on Base. | In description scrape | HOSTEDLOCAL | — | 3d ago |
| 256 | H/M Blindspot Challenge Platform Free AI crawler checks, Agent Surface audits, A2A actions and optional x402 evidence packs. | In description crawler | HOSTEDLOCAL | — | 3d ago |
| 257 | alice Audit any site's AI visibility from your assistant: crawler access, rendering, and schema. | In description crawler | HOSTEDLOCAL | — | 3d ago |
| 258 | Pulldata Discover and run Pulldata scrapers, track jobs, and retrieve results from your AI client. | In description scrapers | HOSTEDLOCAL | — | 3d ago |
| 259 | GroundAPI Real-time data API for AI Agents: stocks, weather, forex, logistics, search, scrape, news, IP. | In description scrape | HOSTEDLOCAL | — | 3d ago |
| 260 | broken-link-checker Crawl a site for broken links, 404s, dead images, redirect chains and slow pages, with sources | In description crawl | HOSTEDLOCAL | — | 3d ago |
| 261 | lintlab SEO Site QA Crawl a site for broken links, redirects and missing SEO tags. Pay per page on Apify. | In description crawl | HOSTEDLOCAL | — | 3d ago |
| 262 | rankparse-mcp SEO MCP server — backlinks, domain authority, tech stack, and 18+ tools via Common Crawl. | In description crawl | HOSTEDLOCAL | — | 3d ago |
| 263 | ScrapeAtlas Unified social scraper MCP — profiles, posts, videos across ~40 platforms via Streamable HTTP. | In description scraper | HOSTEDLOCAL | — | 3d ago |
| 264 | Licium Clean rows from public pages that break ordinary scrapers, plus a bounty board where agents earn. | In description scrapers | HOSTEDLOCAL | — | 3d ago |
| 265 | Syftly Ranks the best AI tool or API per task: transcription, TTS, web search, scraping and OCR. | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 266 | riveter MCP server for Riveter's enrichment, scraping, and monitoring API | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 267 | fetch-extract MCP server (stdio): fetch web pages as clean readable markdown via the AgentForge API | In description fetch web pages | HOSTEDLOCAL | — | 3d ago |
| 268 | Scrappycoco Route web, social, and filings data tasks to the best available scraper. | In description scraper | HOSTEDLOCAL | — | 3d ago |
| 269 | UAParse Parse a User-Agent: browser, OS, device, plus bot, search crawler, AI crawler and AI agent flags. | In description crawler | HOSTEDLOCAL | — | 3d ago |
| 270 | ScrapeNest Web search, scraping, RAG answers with citations, and translation as MCP tools. | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 271 | Viral Outliers Find viral outlier posts on TikTok, Instagram and YouTube, pull creator stats, and crawl on demand. | In description crawl | HOSTEDLOCAL | — | 3d ago |
| 272 | Ujeebu Web scraping, Google SERP, Markdown and ChatGPT/Gemini answers as typed tools for AI agents. | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 273 | environmental-esg-mcp ⚠️ DEPRECATED — G2's Cloudflare anti-bot defeats free scraping. Not commercially viable without paid | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 274 | styx Tor gateway for AI agents: fetch URLs and rotate circuits through Tor, Bitcoin-settled. | In description fetch urls | HOSTEDLOCAL | — | 3d ago |
| 275 | energy-commodity-mcp DISCONTINUED 2026-05-23. Indeed.com Cloudflare + DataDome anti-bot returns HTTP 403 on all scraping | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 276 | healthcare-fda-intelligence-mcp Scrape the FAA Aircraft Registry by N-number — aircraft make, model, year, owner name, address, airw | In description scrape | HOSTEDLOCAL | — | 3d ago |
| 277 | seo-web-analysis-mcp-server Site crawl + tech stack + DNS + SSL + WHOIS — five web-intel layers in one MCP. | In description crawl | HOSTEDLOCAL | — | 3d ago |
| 278 | stagenth · 文档解析 Parse PDF/Word/PPT/HTML to Markdown; tables as JSON, image extraction, RAG chunking, page ranges. | In description html to markdown | HOSTEDLOCAL | — | 3d ago |
| 279 | Siteiz Check which AI crawlers a site allows and see pages the way AI crawlers do. Free, read-only. | In description crawlers | HOSTEDLOCAL | — | 3d ago |
| 280 | SeoGrep SEO for AI agents: crawl sites, audit pages, pull Search Console data, generate shareable reports. | In description crawl | HOSTEDLOCAL | — | 3d ago |
| 281 | ScrapeSelect Current pricing, cost estimates and recommendations for web scraping APIs, with official sources. | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 282 | tiktok Unofficial TikTok API & scraper: creator analytics, video data, comments, search. x402, no API key. | In description scraper | HOSTEDLOCAL | — | 3d ago |
| 283 | Crawl4Agent crawl4ai-compatible web crawler API: POST a URL, get clean LLM-ready Markdown with fit_markdown... | In description crawler | HOSTEDLOCAL | — | 3d ago |
| 284 | rattlesnakesbymail Dated, sourced claims about AI crawlers and agents, offered as MCP tools. | In description crawlers | HOSTEDLOCAL | — | 3d ago |
| 285 | PreteWorks API One key for the document-to-web pipeline: scrape, AI-extract, build & edit PDFs, fill forms. | In description scrape | HOSTEDLOCAL | — | 3d ago |
| 286 | Parseium Web scraping runtime for agents: parsers, scrapes, batches, crons, and SQL databases. | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 287 | momentic Free SEO, GEO, and AEO audits: analyze any page or domain, AI-crawler access, agent readiness. | In description crawler | HOSTEDLOCAL | — | 3d ago |
| 288 | Site Check Public website health scan, AI-crawler and structured-data readiness, and a local presence score. | In description crawler | HOSTEDLOCAL | — | 3d ago |
| 289 | AI Search Kit Audits AI-crawler access, structured data and llms.txt on a site, and drafts the fixes. | In description crawler | HOSTEDLOCAL | — | 3d ago |
| 290 | instagram Instagram: Instagram public data scraper API for search, users, posts, hashtags, locations and more. | In description scraper | HOSTEDLOCAL | — | 3d ago |
| 291 | bypass-cloudflare-api Bypass Cloudflare API: A powerful scraping API designed to bypass Cloudflare protection. | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 292 | cloudflare-solver Cloudflare Solver: Scraping API designed to bypass Cloudflare protection. | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 293 | Growthr SEO + GEO MCP SEO + GEO tools in your AI editor: scan as ChatGPT and Google crawlers see it, fix order, llms.txt. | In description crawlers | HOSTEDLOCAL | — | 3d ago |
| 294 | mcp Geekflare MCP server for scraping, search, screenshots, broken links, DNS lookup, and network tools. | In description scraping | HOSTEDLOCAL | — | 3d ago |
| 295 | FetchRelay Extract public webpages as Markdown, map sites, and run bounded crawl jobs. API key required. | In description crawl | HOSTEDLOCAL | — | 3d ago |
| 296 | GEO-bot Free check whether a website is technically open to AI assistants (AI crawlers, llms.txt, JSON-LD). | In description crawlers | HOSTEDLOCAL | — | 3d ago |
| 297 | Domduck Domain reputation over time: Domain Rating, Tranco rank, TLS, and AI crawler policy. | In description crawler | HOSTEDLOCAL | — | 3d ago |
| 298 | Citevana AI visibility tools Free MCP tools for AI-search visibility: crawler checks, page audits, and llms.txt generation. | In description crawler | HOSTEDLOCAL | — | 3d ago |
| 299 | Chad Analytics Read-only website analytics, AI referrals, crawlers, goals, revenue, and funnels. | In description crawlers | HOSTEDLOCAL | — | 3d ago |
| 300 | browser-forest Undetectable cloud browser sessions for AI agents and scrapers. Navigate, extract, click, captcha. | In description scrapers | HOSTEDLOCAL | — | 3d ago |
Ready-made AI agents
Other use cases
FAQ
How many MCP servers are there for web scraping?
Electra Index lists 384 active MCP servers for web scraping from the Official MCP Registry. 268 offer a hosted endpoint and 224 publish their source code.
Is there a hosted MCP server for web scraping, with nothing to install?
Yes. Klisten SchemaShield, Web Search & Data API and AIsa On-Page Audit declare a remote endpoint you add to your assistant's MCP settings.
Is there a ready-made AI agent for web scraping instead?
Yes. If you prefer a finished product to plugging tools into your own assistant, Apify, Browser Use and Firecrawl do this out of the box.
How this list is ordered: a tool comes first when the use case appears in its name rather than only in its description, then when its description covers more aspects of the use case, then when it offers a hosted endpoint, then when its source code is public, then by how recently our robot saw it in the Official MCP Registry. The match to web Scraping comes from the publisher's description (keyword method), not from a test of the tool. Only active tools with a real description are listed. No tool pays to appear here.