evalsmith-mcp

MCP server · installable · v0.1.0 · io.github.diegoperezg7/evalsmith-mcp

NEW · 4h agoSeen in the registry 3h ago

Evaluate RAG retrieval, agent tool calls and prompt regressions with deterministic metrics.

What it does

evalsmith-mcp is an MCP server, a connector that lets an AI assistant use it as a tool. It is installed locally as a package and runs on your machine.

From the publisher's description, Electra Index matched it to one capability: knowledge base qa. That makes it a candidate for tasks such as answer support phone calls or answer customer questions.

Facts come from the Official MCP Registry, as declared by the publisher. Capabilities are matched automatically (low confidence). None of this is a test of the tool.

At a glance

Hosted (remote)NO

Local installYES

Version0.1.0

Packagesnpm

PriceNot in the registry

First seen28 Oct 2026

Last checked3h ago

How to connect

As declared in the Official MCP Registry · not tested by Electra Index

Install package

NPM evalsmith-mcp v0.1.0 · runs locally (stdio)

MCP settings (Claude Desktop, Cursor and other MCP clients)

{
  "mcpServers": {
    "evalsmith-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "evalsmith-mcp"
      ]
    }
  }
}

Tasks it helps with

Share of each task's required capabilities it covers

Answer support phone calls Knowledge Base QA	50%
Answer customer questions Knowledge Base QA	50%
Answer questions from internal documents Knowledge Base QA	50%
Build a help center Knowledge Base QA	50%
Onboard new employees Knowledge Base QA	50%
Automate customer support Knowledge Base QA	33%

Similar tools

Listed for the same task: answer support phone calls

atlas-mindREMOTELOCAL
Self-hosted git-native knowledge base with an MCP endpoint your AI reads, writes and rewinds
InfobrokerREMOTELOCAL
Multi-provider research MCP server: unified web search, fact-checking, personal knowledge base
Muhu island dialect of Estonian — dictionary and RAGREMOTELOCAL
Estonia's Muhu island dialect of Estonian. Dictionary, RAG and ERR audio/text source references
Stoic SageREMOTELOCAL
Semantic search and citation of Stoic texts: Marcus Aurelius, Seneca and Epictetus
OctobrainREMOTELOCAL
Persistent memory for AI assistants with semantic search and knowledge graph relationships
vault-indexREMOTELOCAL
Local hybrid keyword + vector search (SQLite FTS5 + sqlite-vec) over markdown vaults and code

Ready-made AI agents

An MCP server is a connector you add to your own assistant. These are finished products that do the same job for you:

Fireflies.ai80
$18/mo · free plan · Prices & score →
Fin AI Agent72
$29/mo · Prices & score →
Chatbase53
$40/mo · free plan · Prices & score →
Agentforce Service51
$5/mo · free plan · Prices & score →

All AI agents to answer support phone calls, ranked →

Facts & evidence

Each fact shows where it was seen and when.

Fact	Value	Evidence	Source	Last confirmed
Install package	evalsmith-mcp	DECLARED	SRC-001 Official MCP Registry	3h ago
Package registries	npm	DECLARED	SRC-001 Official MCP Registry	3h ago
Local install (package)	yes	DECLARED	SRC-001 Official MCP Registry	3h ago
Remote access (hosted)	no	DECLARED	SRC-001 Official MCP Registry	3h ago
Repository	https://github.com/diegoperezg7/evalsmith-mcp	DECLARED	SRC-001 Official MCP Registry	3h ago
Registry status	active	DECLARED	SRC-001 Official MCP Registry	3h ago
Version	0.1.0	DECLARED	SRC-001 Official MCP Registry	3h ago
MCP server	yes	DECLARED	SRC-001 Official MCP Registry	3h ago

Change history

NEW28 Oct 2026
first seen in the index

Is this page accurate?

Flag it and our robot re-checks the official source. Reports never change a score.

Is evalsmith-mcp still online?

Free alerts · no account

Do you publish evalsmith-mcp? Get it seen by people choosing a tool

For publishers · optional

Launch Spotlight: 60 days of clearly labelled Sponsored visibility on the use-case pages where evalsmith-mcp already appears, plus the weekly Pulse. No click in 60 days? The next 60 days are free.

See where it would appearLaunch offer $14.99 once instead of $69.99 · All plans

Sponsored placements never change a score or a rank.

Questions about evalsmith-mcp

How do I connect evalsmith-mcp?

Install the npm package evalsmith-mcp. The exact settings are in "How to connect" above, as declared in the Official MCP Registry.

What can I use evalsmith-mcp for?

Based on its description, it is most relevant to: answer support phone calls, answer customer questions, answer questions from internal documents, build a help center.