List your agent

LLMBenchmark.ai

MCP server● Hosted · onlineInstallablev1.0.1

Which LLM for which task: benchmark scores and API prices for 400+ models. Free, no key

Reviews

No review yet. Used LLMBenchmark.ai? Be the first to help others choose.

What it does

LLMBenchmark.ai is an MCP server, a connector that lets an AI assistant use it as a tool. It can be used hosted (nothing to install) or installed locally.

No capability identified yet from its description.

Facts come from the Official MCP Registry, as declared by the publisher. Capabilities are matched automatically (low confidence). None of this is a test of the tool.

At a glance

Hosted (remote)YES
Local installYES
Version1.0.1
PackagesPyPI
PriceNot in the registry
First seen19 Nov 2026
Last checked1d ago

How to connect

As declared in the Official MCP Registry · hosted endpoint tested by Electra Index 1d ago (live check)

Hosted endpoint

  • https://api.llmbenchmark.ai/mcp streamable-http

In Claude Code: claude mcp add --transport http llmbenchmark-ai https://api.llmbenchmark.ai/mcp

Install package

  • PYPI llmbenchmark-mcp v1.0.0 · runs locally (stdio)

MCP settings (Claude Desktop, Cursor and other MCP clients)

{
  "mcpServers": {
    "llmbenchmark-ai": {
      "url": "https://api.llmbenchmark.ai/mcp"
    }
  }
}

Reliability

Re-tested about every 3 days · last check 1d ago
Insufficient observations1 conclusive check in 30 days; a figure is shown from 10
1 / 0Answers / failures, 30 days
No key neededAccess status (latest answer)
Observed test history · one mark = one check
19 Nov19 Nov
AnsweredAnswered, key requiredNo valid answer

Observed endpoint availability: the share of our conclusive checks that got an answer. A request for a key or sign-in counts as an answer (the server is up, its access is protected). Timeouts, unreachable endpoints, server errors and invalid MCP replies count as failures; rate-limited checks and checks during our own incidents are not counted. This is what we observed at each check, not continuous uptime: an outage between two checks may go unseen. The 90-day figure will appear once 90 days of checks exist (checks since 19 Nov 2026). How we measure

Tool changes

Tool tracking since 20 Nov 2026 · test history since 19 Nov 2026

No tool added or removed since tracking started. 6 tools in the latest list.

Changes are confirmed by comparing complete tool lists only, read about every 3 days, and dated by the day we saw them. A renamed tool appears as one removal and one addition.

Live check

Electra Index connected to the hosted endpoint 1d ago

ONLINE LLMBenchmark.ai answered an MCP connection on 19 Nov 2026 and introduced itself as LLMBenchmark.ai 1.0.0 (MCP protocol 2025-06-18).

6 tools offered to AI assistants

  • recommend_model · Which model should I use for this task? Maps the task text to a category (coding, agentic, reasoning, math, knowledge, web design, or overall when nothing matches) by a fixed keyword map, filters by output price per million tokens, context
  • get_leaderboard · The top models on one category's board. category is one of overall, coding, agentic, reasoning, math, knowledge, design (see list_categories). limit is 1 to 50. overall is the LLMBenchmark Index: a weighted mean of the Vibe Coding Index, th
  • compare_models · Two models side by side: score on every category board where both were measured, prices, context. Names are matched loosely: 'claude opus', 'gpt-5' or a slug all work.
  • get_model · One model: maker, release date, prices, context, open weights, and its score and rank on every category board. Name or slug.
  • get_prices · API prices (USD per million tokens), cheapest output price first: the maker's own price when it serves the model on OpenRouter, else the median of providers (price_basis says which), plus the cheapest provider. Filter by model name and/or m
  • list_categories · The categories recommend_model and get_leaderboard know, the benchmark board behind each, and the task keywords that select it.

What "online" means: the server answered an MCP connection at the time of the check. It is not a guarantee of security, quality or continuous uptime. How we test: we open an MCP session and ask for the tool list, as an AI assistant would. We never run a tool and never send a key. Re-tested about every 3 days. Method

Is this your server? Monitoring Pro: a check every 30 minutes and an email within the hour when it stops answering. Launch offer: $39.99 once, for life.

Facts & evidence

Each fact shows where it was seen and when.
FactValueEvidenceSourceLast confirmed
Install packagellmbenchmark-mcpDECLAREDSRC-001 Official MCP Registry1d ago
Package registriespypiDECLAREDSRC-001 Official MCP Registry1d ago
Local install (package)yesDECLAREDSRC-001 Official MCP Registry1d ago
Version1.0.1DECLAREDSRC-001 Official MCP Registry1d ago
Hosted endpointhttps://api.llmbenchmark.ai/mcpDECLAREDSRC-001 Official MCP Registry1d ago
Remote access (hosted)yesDECLAREDSRC-001 Official MCP Registry1d ago
Websitehttps://llmbenchmark.ai/apiDECLAREDSRC-001 Official MCP Registry1d ago
Repositoryhttps://github.com/Take-Group/llmbenchmark-mcpDECLAREDSRC-001 Official MCP Registry1d ago
Registry statusactiveDECLAREDSRC-001 Official MCP Registry1d ago
MCP serveryesDECLAREDSRC-001 Official MCP Registry1d ago

Change history

  • CHANGED19 Nov 2026
    local install: no → yes
  • VERSION19 Nov 2026
    1.0.0 → 1.0.1
  • NEW19 Nov 2026
    first seen in the index

Is this page accurate?

Flag it and our robot re-checks the official source. Reports never change a score.

Do you run LLMBenchmark.ai? Know when it stops answering

For publishers · optional

Its hosted endpoint can be monitored. Monitoring Pro connects every 30 minutes like an AI assistant, emails you within the hour when it stops answering, keeps a 90-day availability history and adds your answer rate to your badge.

Monitor LLMBenchmark.aiLaunch offer $39.99 once, for life instead of $9.99/month · All plans

Monitoring never changes a score or a rank.

Are you the publisher of LLMBenchmark.ai?

Free · show your listing

An independent listing builds trust with your buyers. Announce it, and add the badge to your website or README.

Announce it on LinkedIn
Listed on Electra IndexListed on Electra Index
<a href="https://electraindex.com/mcp/llmbenchmark-ai?utm_source=badge&utm_medium=share&utm_campaign=listing"><img src="https://electraindex.com/api/badge/llmbenchmark-ai/card" width="260" height="72" alt="Listed on Electra Index"></a>

Questions about LLMBenchmark.ai

How do I connect LLMBenchmark.ai?

Use the hosted endpoint https://api.llmbenchmark.ai/mcp in your assistant's MCP settings. The exact settings are in "How to connect" above, as declared in the Official MCP Registry.

What tools does LLMBenchmark.ai offer?

When Electra Index connected on 19 Nov 2026, it listed 6 tools: recommend_model, get_leaderboard, compare_models, get_model, get_prices, list_categories. The full list is in "Live check" above.

Is LLMBenchmark.ai online?

Yes. Its hosted endpoint answered an MCP connection from Electra Index 1d ago.