Atalaya AI crawler check
Which AI crawlers (GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot) a website allows, and why.
What it does
Atalaya AI crawler check is an MCP server, a connector that lets an AI assistant use it as a tool. It is hosted: an assistant connects to it over the internet, nothing to install.
From the publisher's description, Electra Index matched it to one capability: web scraping. That makes it a candidate for tasks such as extract website data or collect data behind logins.
Facts come from the Official MCP Registry, as declared by the publisher. Capabilities are matched automatically (low confidence). None of this is a test of the tool.
At a glance
How to connect
As declared in the Official MCP Registry · hosted endpoint tested by Electra Index 2h ago (live check)Hosted endpoint
https://atalaya-ai.com/mcpstreamable-http
In Claude Code: claude mcp add --transport http atalaya-ai-crawler-check https://atalaya-ai.com/mcp
MCP settings (Claude Desktop, Cursor and other MCP clients)
{
"mcpServers": {
"atalaya-ai-crawler-check": {
"url": "https://atalaya-ai.com/mcp"
}
}
}Live check
Electra Index connected to the hosted endpoint 2h agoONLINE Atalaya AI crawler check answered an MCP connection on 03 Nov 2026 and introduced itself as atalaya-ai-crawler-check 1.0.0 (MCP protocol 2025-06-18).
2 tools offered to AI assistants
check_ai_crawler_access· Checks whether AI crawlers can reach and read a public website or web app: which AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended and more) robots.txt allows and the exact rule for each, how much tlist_ai_crawlers· Lists the AI crawler user-agent tokens Atalaya checks, by vendor and purpose (training, search index, user-triggered fetch), so you can write a robots.txt that keeps AI search while opting out of training.
What "online" means: the server answered an MCP connection at the time of the check. It is not a guarantee of security, quality or continuous uptime. How we test: we open an MCP session and ask for the tool list, as an AI assistant would. We never run a tool and never send a key. Checked every few days. Method
Is this your server? Monitoring Pro: a check every 30 minutes and an email within the hour when it stops answering. Launch offer: $39.99 once, for life.
Tasks it helps with
Share of each task's required capabilities it covers| Extract website data Web Scraping | 50% |
| Collect data behind logins Web Scraping | 50% |
| Monitor prices Web Scraping | 50% |
| Audit website SEO Web Scraping | 33% |
Similar tools
Listed for the same task: extract website data- Finekot APIREMOTELOCAL89 pay-per-call tools for agents: screenshots, scraping, PDF, OCR, TTS, STT, invoices, KYC, utils
- mcp-serverREMOTELOCALWeb scraping MCP server — scrape, extract structured data, screenshot any site with anti-bot bypass
- apify-mcp-serverREMOTELOCALExtract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡
- LLM Scraper by Nova (CIVAI)REMOTELOCALScrape websites by following links and extract structured data from natural language instructions
- mcpREMOTELOCALScrape any website, extract structured data, and collect web content at scale with AI agents
- thunderbit-mcp-serverREMOTELOCALAI-powered web scraping MCP. Distill pages to Markdown or extract structured data via JSON Schema
Ready-made AI agents
- Apify82$19/mo · free plan · Prices & score →
- Free plan · Prices & score →
- $16/mo · free plan · Prices & score →
- Free plan · Prices & score →
Facts & evidence
Each fact shows where it was seen and when.| Fact | Value | Evidence | Source | Last confirmed |
|---|---|---|---|---|
| Version | 1.1.0 | DECLARED | SRC-001 Official MCP Registry | 1h ago |
| Hosted endpoint | https://atalaya-ai.com/mcp | DECLARED | SRC-001 Official MCP Registry | 1h ago |
| Local install (package) | no | DECLARED | SRC-001 Official MCP Registry | 1h ago |
| Remote access (hosted) | yes | DECLARED | SRC-001 Official MCP Registry | 1h ago |
| Website | https://atalaya-ai.com/mcp-server/ | DECLARED | SRC-001 Official MCP Registry | 1h ago |
| Registry status | active | DECLARED | SRC-001 Official MCP Registry | 1h ago |
| MCP server | yes | DECLARED | SRC-001 Official MCP Registry | 1h ago |
Change history
- VERSION03 Nov 20261.0.0 → 1.1.0
- NEW03 Nov 2026first seen in the index
Is this page accurate?
Flag it and our robot re-checks the official source. Reports never change a score.Is Atalaya AI crawler check still online?
Free alerts · no account▲ 0Do you run Atalaya AI crawler check? Know when it stops answering
For publishers · optionalIts hosted endpoint can be monitored. Monitoring Pro connects every 30 minutes like an AI assistant, emails you within the hour when it stops answering, keeps a 90-day availability history and adds your answer rate to your badge.
Monitoring never changes a score or a rank.
Are you the publisher of Atalaya AI crawler check?
Free · show your listingAn independent listing builds trust with your buyers. Announce it, and add the badge to your website or README.
<a href="https://electraindex.com/mcp/atalaya-ai-crawler-check?utm_source=badge&utm_medium=share&utm_campaign=listing"><img src="https://electraindex.com/api/badge/atalaya-ai-crawler-check" alt="Listed on Electra Index"></a>Questions about Atalaya AI crawler check
How do I connect Atalaya AI crawler check?
Use the hosted endpoint https://atalaya-ai.com/mcp in your assistant's MCP settings. The exact settings are in "How to connect" above, as declared in the Official MCP Registry.
What tools does Atalaya AI crawler check offer?
When Electra Index connected on 03 Nov 2026, it listed 2 tools: check_ai_crawler_access, list_ai_crawlers. The full list is in "Live check" above.
Is Atalaya AI crawler check online?
Yes. Its hosted endpoint answered an MCP connection from Electra Index 2h ago.
What can I use Atalaya AI crawler check for?
Based on its description, it is most relevant to: extract website data, collect data behind logins, monitor prices, audit website SEO.