AI Crawlability Check
Check if AI crawlers like GPTBot and ClaudeBot can reach, index and quote any web page
What you can do with it
Share of each task's required capabilities it coversPrefer a ready-made agent?
An MCP server is a connector for your own assistant. These finished products do the job for you: collect data behind logins.Similar tools
Listed for the same task: collect data behind loginsReviews
No review yet. Used AI Crawlability Check? Be the first to help others choose.What it does
AI Crawlability Check is an MCP server, a connector that lets an AI assistant use it as a tool. It is hosted: an assistant connects to it over the internet, nothing to install.
From the publisher's description, Electra Index matched it to one capability: web scraping. That makes it a candidate for tasks such as collect data behind logins or extract website data.
Facts come from the Official MCP Registry, as declared by the publisher. Capabilities are matched automatically (low confidence). None of this is a test of the tool.
At a glance
How to connect
As declared in the Official MCP Registry · hosted endpoint tested by Electra Index 12h ago (live check)Hosted endpoint
https://mcp.milan-novotny.com/mcpstreamable-http
In Claude Code: claude mcp add --transport http ai-crawlability-check https://mcp.milan-novotny.com/mcp
MCP settings (Claude Desktop, Cursor and other MCP clients)
{
"mcpServers": {
"ai-crawlability-check": {
"url": "https://mcp.milan-novotny.com/mcp"
}
}
}Reliability
Re-tested about every 3 days · last check 12h agoObserved endpoint availability: the share of our conclusive checks that got an answer. A request for a key or sign-in counts as an answer (the server is up, its access is protected). Timeouts, unreachable endpoints, server errors and invalid MCP replies count as failures; rate-limited checks and checks during our own incidents are not counted. This is what we observed at each check, not continuous uptime: an outage between two checks may go unseen. The 90-day figure will appear once 90 days of checks exist (checks since 19 Nov 2026). How we measure
Live check
Electra Index connected to the hosted endpoint 12h agoONLINE AI Crawlability Check answered an MCP connection on 19 Nov 2026 and introduced itself as ai-crawlability-check 2.0.0 (MCP protocol 2025-06-18).
5 tools offered to AI assistants
check_ai_crawler_access· Reports which AI crawlers may fetch a public URL. Reads the site's robots.txt and returns allowed or blocked, with the deciding rule, for each known AI crawler from OpenAI, Anthropic, Perplexity, Google, Microsoft, Apple, Meta, Amazon and ocheck_ai_indexability· Checks whether a public page can be indexed by search and AI engines once a crawler reaches it. Measures HTTP status and redirects, noindex, canonical target, how much copy exists in the raw HTML without JavaScript, client-side rendering sicheck_ai_citability· Fetches a public page and scores how quotable its content is for AI engines once it is crawled and indexed. Measures answer-first structure, question headings, lists and tables, FAQ, paragraph and sentence length, statistic and source densicheck_seo_basics· Fetches a public page and runs 24 measurable on-page SEO checks: title and meta description length, H1, heading hierarchy, keyword placement and density, slug, canonical, internal and external links, anchor text, image alt text, schema andget_review_rubric· Returns a scoring rubric as text for the judgment items the URL tools cannot measure: geo (would an AI engine quote this article?) or seo (pre-publish SEO review). Fetches nothing.
What "online" means: the server answered an MCP connection at the time of the check. It is not a guarantee of security, quality or continuous uptime. How we test: we open an MCP session and ask for the tool list, as an AI assistant would. We never run a tool and never send a key. Re-tested about every 3 days. Method
Is this your server? Monitoring Pro: a check every 30 minutes and an email within the hour when it stops answering. Launch offer: $39.99 once, for life.
Facts & evidence
Each fact shows where it was seen and when.| Fact | Value | Evidence | Source | Last confirmed |
|---|---|---|---|---|
| Hosted endpoint | https://mcp.milan-novotny.com/mcp | DECLARED | SRC-001 Official MCP Registry | 12h ago |
| Local install (package) | no | DECLARED | SRC-001 Official MCP Registry | 12h ago |
| Remote access (hosted) | yes | DECLARED | SRC-001 Official MCP Registry | 12h ago |
| Website | https://www.milan-novotny.com/tools/ai-crawlability-mcp/ | DECLARED | SRC-001 Official MCP Registry | 12h ago |
| Repository | https://github.com/Milan344s/ai-crawlability-check | DECLARED | SRC-001 Official MCP Registry | 12h ago |
| Registry status | active | DECLARED | SRC-001 Official MCP Registry | 12h ago |
| Version | 2.0.0 | DECLARED | SRC-001 Official MCP Registry | 12h ago |
| MCP server | yes | DECLARED | SRC-001 Official MCP Registry | 12h ago |
Change history
- NEW19 Nov 2026first seen in the index
Is this page accurate?
Flag it and our robot re-checks the official source. Reports never change a score.Is AI Crawlability Check still online?
Free alerts · no account▲ 0Do you run AI Crawlability Check? Know when it stops answering
For publishers · optionalIts hosted endpoint can be monitored. Monitoring Pro connects every 30 minutes like an AI assistant, emails you within the hour when it stops answering, keeps a 90-day availability history and adds your answer rate to your badge.
Monitoring never changes a score or a rank.
Questions about AI Crawlability Check
How do I connect AI Crawlability Check?
Use the hosted endpoint https://mcp.milan-novotny.com/mcp in your assistant's MCP settings. The exact settings are in "How to connect" above, as declared in the Official MCP Registry.
What tools does AI Crawlability Check offer?
When Electra Index connected on 19 Nov 2026, it listed 5 tools: check_ai_crawler_access, check_ai_indexability, check_ai_citability, check_seo_basics, get_review_rubric. The full list is in "Live check" above.
Is AI Crawlability Check online?
Yes. Its hosted endpoint answered an MCP connection from Electra Index 12h ago.
What can I use AI Crawlability Check for?
Based on its description, it is most relevant to: collect data behind logins, extract website data, monitor prices, audit website SEO.