Best MCP servers for web scraping
384 MCP servers in the Official MCP Registry do web scraping. 268 can be used as a hosted endpoint, with nothing to install, and 224 publish their source code. First by relevance and readiness: Firecrawl MCP Server, TidyTools: lead enrichment, RAG Markdown, transcripts, AI crawler checks and CRW Web Scraper.
| # | Tool | Relevance | Connect | Code | Seen |
|---|---|---|---|---|---|
| 1 | Firecrawl MCP Server MCP server for Firecrawl — web search, scraping, and biomedical/arXiv paper search. | In name firecrawl | HOSTEDLOCAL | Open | 47m ago |
| 2 | TidyTools: lead enrichment, RAG Markdown, transcripts, AI crawler checks Enrich Google Maps leads, crawl docs to RAG Markdown, transcribe podcasts, check AI crawler access. | In name crawler | HOSTEDLOCAL | Open | 2d ago |
| 3 | CRW Web Scraper Open-source web scraper for AI agents with scrape, crawl, and map tools | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 4 | Crawl Census Ask before you fetch: will this domain serve your crawler, refuse it, or charge it? | In name crawl | HOSTEDLOCAL | Open | 2d ago |
| 5 | Steady API Scrapers YouTube transcripts, Google Hotels prices, Google Ads Transparency, Google Trends and Threads posts. | In name scrapers | HOSTEDLOCAL | Open | 2d ago |
| 6 | smart-crawler E-commerce competitor intelligence, VOC sentiment, Amazon ASIN analysis, Reddit growth playbooks. | In name crawler | HOSTEDLOCAL | Open | 2d ago |
| 7 | Agent Crawl Readiness Bounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage. | In name crawl | HOSTEDLOCAL | Open | 2d ago |
| 8 | Scrapingant ScrapingAnt MCP — wraps the ScrapingAnt web scraping API (scrapingant.com) | In name scraping | HOSTEDLOCAL | Open | 2d ago |
| 9 | Scrapingbee ScrapingBee MCP — wraps the ScrapingBee headless-scraping API (scrapingbee.com) | In name scraping | HOSTEDLOCAL | Open | 2d ago |
| 10 | Firecrawl Firecrawl MCP — wraps the Firecrawl API (firecrawl.dev) for web | In name firecrawl | HOSTEDLOCAL | Open | 2d ago |
| 11 | Crawlgraph CrawlGraph MCP — backlink intelligence on the public Common Crawl webgraph | In name crawl | HOSTEDLOCAL | Open | 2d ago |
| 12 | Commoncrawl Common Crawl's public web archive — find every time a URL was crawled since 2008 and read the… | In name crawl | HOSTEDLOCAL | Open | 2d ago |
| 13 | Google Ads Transparency Center Scraper (orbots) - Apify Actor Every ad an advertiser runs on Google, from the public Ads Transparency Center. Unofficial tool. | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 14 | Google Trends Scraper (orbots) - Apify Actor Google Trends trending searches, volume estimates & trend duration. Not affiliated with Google LLC. | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 15 | mifactory-scraping-api Web scraping for AI agents. Extract text and metadata from any URL worldwide. $0.005/page. | In name scraping | HOSTEDLOCAL | Open | 2d ago |
| 16 | crawlinx-mcp Free technical-SEO audit MCP: crawl a site, run checks, return an LLM-ready shareable report. | In name crawl | HOSTEDLOCAL | Open | 2d ago |
| 17 | x402-scraper-api Programmatic web-scraping MCP server powered by x402 micro-transactions on Base. | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 18 | x402-scraper Autonomous HTTP 402 Web Scraping Mesh on Base for $0.02 USDC. | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 19 | Reddit Scraper (Apify) – posts, comments, search, users, subreddits Reddit posts, comments, search, users & subreddits as JSON via Apify. No Reddit API key. $2/1k | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 20 | tiktok-transcript-scraper AI speech-to-text for public TikTok videos: SRT, VTT, word timings, speaker labels, 90+ languages. | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 21 | Google Hotels Scraper Google Hotels prices for any city and dates: nightly and total price with taxes, ratings, amenities. | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 22 | Google Trends Scraper Google Trends for any number of keywords on one scale: interest over time, regions, rising queries. | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 23 | Google Jobs Scraper Google Jobs listings with parsed salaries and direct apply links, more than 10 per search. | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 24 | foundrynet-scrape x402-gated web extraction gateway. Tools: extract, extract_batch. | In name scrape | HOSTEDLOCAL | Open | 2d ago |
| 25 | web-scraper Fetch, crawl, and browse protected pages with anti-bot handling - renders in a real browser and | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 26 | Twitter Scraper API Scrape Twitter/X profiles, tweets, search. No API key. Structured JSON. x402 pay-per-call. | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 27 | Web Scraper to Markdown API Extract clean markdown from any URL. Removes boilerplate. For RAG pipelines. x402. | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 28 | HTML to Markdown API Convert HTML to clean markdown. Strips scripts and styles. x402 micropayment. | In name html to markdown | HOSTEDLOCAL | Open | 2d ago |
| 29 | Instagram Scraper: Reels to Text, Posts, Comments, No Login Public Instagram reels, posts, profiles and comments, plus reel-to-text transcripts. No login. | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 30 | Zomato Restaurant Scraper - City, Cuisine, Contact Zomato Restaurant Scraper - City, Cuisine, Contact | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 31 | Telegram Channel Scraper - Posts, Media & Buttons | No Login Telegram Channel Scraper - No Login, $0.30 per 1K Posts | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 32 | Google Trends Scraper API - Interest Over Time, Related Queries Google Trends Scraper API: Interest and Trending Now | In name scraper | HOSTEDLOCAL | Open | 2d ago |
| 33 | Firecrawl Alternative Stealth MCP WAF-bypass web scraper and passive URL mapper for AI agents with zero pay-on-fail. | In name firecrawl | HOSTEDLOCAL | Open | 2d ago |
| 34 | HasData Web Scraping Fetch any public web page through managed proxies, with optional JS rendering and extraction rules. | In name scraping | HOSTEDLOCAL | Open | 3d ago |
| 35 | Google Maps Scraper Live Google Maps business search, review, and photo data for AI agents over MCP. | In name scraper | HOSTEDLOCAL | Open | 3d ago |
| 36 | Atlas Web Compiler & Scraper Deterministic Zero-LLM Web Compiler, Scraper, Crawler, and Site Mapper for AI Agents. | In name scraper | HOSTEDLOCAL | Open | 3d ago |
| 37 | Scrapewise Scrape, clean and match product and price data from any website | In name scrape | HOSTEDLOCAL | Open | 3d ago |
| 38 | YouTube Transcript Scraper Transcripts of YouTube videos and Shorts in bulk, with timestamps. Runs on Apify. | In name scraper | HOSTEDLOCAL | — | 13h ago |
| 39 | Google Jobs Scraper: Jobs, Salaries & Apply Links Google Jobs listings for any role and city: company, salary, job type, apply link. Runs on Apify. | In name scraper | HOSTEDLOCAL | — | 13h ago |
| 40 | LexLint: compliance lint for AI, scraping, and privacy law Compliance lint for AI, scraping, and privacy law. Cited findings in 200 or more jurisdictions. | In name scraping | HOSTEDLOCAL | — | 2d ago |
| 41 | Telegram Channel Scraper Public Telegram channel posts without login: text, views, reactions, media, exact subscribers. | In name scraper | HOSTEDLOCAL | — | 2d ago |
| 42 | Zillow Scraper Zillow listings and property details: price, Zestimate, beds, baths, agent, history. | In name scraper | HOSTEDLOCAL | — | 2d ago |
| 43 | Reddit Search Scraper Search Reddit posts by keyword and subreddit; find recommendation requests and brand mentions. | In name scraper | HOSTEDLOCAL | — | 2d ago |
| 44 | Pinterest Scraper Pinterest pins, boards, profiles and keyword search to JSON: saves, images, links, creators. | In name scraper | HOSTEDLOCAL | — | 2d ago |
| 45 | Trustpilot Reviews Scraper Trustpilot reviews for any company domain: ratings, text, replies, and unanswered low-star reviews. | In name scraper | HOSTEDLOCAL | — | 2d ago |
| 46 | TikTok Scraper TikTok videos with exact views, likes, comments, shares from profiles, hashtags, search, links. | In name scraper | HOSTEDLOCAL | — | 2d ago |
| 47 | YouTube Scraper YouTube videos, Shorts, channels, playlists and search to JSON: views, likes, dates, durations. | In name scraper | HOSTEDLOCAL | — | 2d ago |
| 48 | Naukri Jobs Scraper Search Naukri.com jobs in India: titles, companies, salaries, skills, and which companies hire most. | In name scraper | HOSTEDLOCAL | — | 2d ago |
| 49 | Weibo Scraper Weibo posts, hot search, comments and profiles to JSON. No login or cookies needed. | In name scraper | HOSTEDLOCAL | — | 2d ago |
Ready-made AI agents
Other use cases
FAQ
What is the best MCP server for web scraping?
By relevance and readiness, Firecrawl MCP Server, TidyTools: lead enrichment, RAG Markdown, transcripts, AI crawler checks and CRW Web Scraper come first: the use case appears in their name and they can be used as a hosted endpoint. Check each page for how to connect and what keys it needs.
How many MCP servers are there for web scraping?
Electra Index lists 384 active MCP servers for web scraping from the Official MCP Registry. 268 offer a hosted endpoint and 224 publish their source code.
Is there a hosted MCP server for web scraping, with nothing to install?
Yes. Firecrawl MCP Server, TidyTools: lead enrichment, RAG Markdown, transcripts, AI crawler checks and CRW Web Scraper declare a remote endpoint you add to your assistant's MCP settings.
Is there a ready-made AI agent for web scraping instead?
Yes. If you prefer a finished product to plugging tools into your own assistant, Apify, Browser Use and Firecrawl do this out of the box.
How this list is ordered: a tool comes first when the use case appears in its name rather than only in its description, then when it offers a hosted endpoint, then when its source code is public, then by how recently our robot saw it in the Official MCP Registry. The match to web Scraping comes from the publisher's description (keyword method), not from a test of the tool. Only active tools with a real description are listed. No tool pays to appear here.