Agent Web Census
Open data on MCP servers (with live health) and which AI crawlers top websites block
What you can do with it
Share of each task's required capabilities it coversPrefer a ready-made agent?
An MCP server is a connector for your own assistant. These finished products do the job for you: extract website data.Similar tools
Listed for the same task: extract website dataReviews
No review yet. Used Agent Web Census? Be the first to help others choose.What it does
Agent Web Census is an MCP server, a connector that lets an AI assistant use it as a tool. It is hosted: an assistant connects to it over the internet, nothing to install.
From the publisher's description, Electra Index matched it to one capability: web scraping. That makes it a candidate for tasks such as extract website data or collect data behind logins.
Facts come from the Official MCP Registry, as declared by the publisher. Capabilities are matched automatically (low confidence). None of this is a test of the tool.
At a glance
How to connect
As declared in the Official MCP Registry · hosted endpoint tested by Electra Index 16h ago (live check)Hosted endpoint
https://datacensus.org/mcpstreamable-http
In Claude Code: claude mcp add --transport http agent-web-census https://datacensus.org/mcp
MCP settings (Claude Desktop, Cursor and other MCP clients)
{
"mcpServers": {
"agent-web-census": {
"url": "https://datacensus.org/mcp"
}
}
}Reliability
Re-tested about every 3 days · last check 16h agoObserved endpoint availability: the share of our conclusive checks that got an answer. A request for a key or sign-in counts as an answer (the server is up, its access is protected). Timeouts, unreachable endpoints, server errors and invalid MCP replies count as failures; rate-limited checks and checks during our own incidents are not counted. This is what we observed at each check, not continuous uptime: an outage between two checks may go unseen. The 90-day figure will appear once 90 days of checks exist (checks since 19 Nov 2026). How we measure
Live check
Electra Index connected to the hosted endpoint 16h agoONLINE Agent Web Census answered an MCP connection on 19 Nov 2026 and introduced itself as datacensus 0.1.0 (MCP protocol 2025-06-18).
4 tools offered to AI assistants
find_mcp_servers· Search the official MCP Registry (~65,000 servers) by keyword. Matches name, title and description; ranks servers whose remote endpoint passed a live initialize check first, then by number of tools. Returns name, title, description, remote/mcp_ecosystem_stats· Headline numbers of the MCP ecosystem: servers in the official registry, new servers in the last 7/30 days, remote vs package share, top package registries and categories, plus the weekly health check of remote servers (share working, requisite_ai_crawler_policy· Which AI crawlers does a website block in robots.txt? Looks up a domain in our scan of the top 10,000 websites (Tranco list) and returns, per AI bot (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, ...), whether it is blocked, partly resai_crawler_stats· Aggregate AI-crawler blocking statistics across the top 10,000 websites: percentage of sites with a reachable robots.txt that fully block, partly restrict or explicitly allow each AI bot. Give a bot name for one bot, or omit for the overall
What "online" means: the server answered an MCP connection at the time of the check. It is not a guarantee of security, quality or continuous uptime. How we test: we open an MCP session and ask for the tool list, as an AI assistant would. We never run a tool and never send a key. Re-tested about every 3 days. Method
Is this your server? Monitoring Pro: a check every 30 minutes and an email within the hour when it stops answering. Launch offer: $39.99 once, for life.
Facts & evidence
Each fact shows where it was seen and when.| Fact | Value | Evidence | Source | Last confirmed |
|---|---|---|---|---|
| Hosted endpoint | https://datacensus.org/mcp | DECLARED | SRC-001 Official MCP Registry | 16h ago |
| Local install (package) | no | DECLARED | SRC-001 Official MCP Registry | 16h ago |
| Remote access (hosted) | yes | DECLARED | SRC-001 Official MCP Registry | 16h ago |
| Website | https://agents.datacensus.org | DECLARED | SRC-001 Official MCP Registry | 16h ago |
| Repository | https://github.com/jirizaloudek/agentwebcensus | DECLARED | SRC-001 Official MCP Registry | 16h ago |
| Registry status | active | DECLARED | SRC-001 Official MCP Registry | 16h ago |
| Version | 0.1.0 | DECLARED | SRC-001 Official MCP Registry | 16h ago |
| MCP server | yes | DECLARED | SRC-001 Official MCP Registry | 16h ago |
Change history
- NEW19 Nov 2026first seen in the index
Is this page accurate?
Flag it and our robot re-checks the official source. Reports never change a score.Is Agent Web Census still online?
Free alerts · no account▲ 0Do you run Agent Web Census? Know when it stops answering
For publishers · optionalIts hosted endpoint can be monitored. Monitoring Pro connects every 30 minutes like an AI assistant, emails you within the hour when it stops answering, keeps a 90-day availability history and adds your answer rate to your badge.
Monitoring never changes a score or a rank.
Questions about Agent Web Census
How do I connect Agent Web Census?
Use the hosted endpoint https://datacensus.org/mcp in your assistant's MCP settings. The exact settings are in "How to connect" above, as declared in the Official MCP Registry.
What tools does Agent Web Census offer?
When Electra Index connected on 19 Nov 2026, it listed 4 tools: find_mcp_servers, mcp_ecosystem_stats, site_ai_crawler_policy, ai_crawler_stats. The full list is in "Live check" above.
Is Agent Web Census online?
Yes. Its hosted endpoint answered an MCP connection from Electra Index 16h ago.
What can I use Agent Web Census for?
Based on its description, it is most relevant to: extract website data, collect data behind logins, monitor prices, audit website SEO.