MCP server

Eval Runner

io.github.dbsectrainer/mcp-eval-runner

Checked 26 Oct 2026, 08:31 UTC · Still published on its registry; checked against OSV.dev; never run by us

A standardized testing harness for MCP servers and agent workflows

Runs on your computer

Source

At a glance

Type: MCP server
Publisher: Not verified
Status: Runs on your computer
Sets up in: Claude Code, Claude Desktop, Codex, Gemini CLI, Cursor, VS Code
Last checked: 26 Oct 2026, 08:31 UTC

Connect it to your agent

Add to Cursor Add to VS Code VS Code Insiders

Opens the app, which shows the server and asks you to confirm. It then runs the package on your computer with your permissions. For other apps, copy the setup below.

Claude Code

claude mcp add mcp-eval-runner --env YOUR_API_KEY=YOUR_VALUE -- npx -y mcp-eval-runner@1.0.0

Claude Desktop

{"mcpServers":{"mcp-eval-runner":{"command":"npx","args":["-y","mcp-eval-runner@1.0.0"],"env":{"YOUR_API_KEY":"YOUR_VALUE"}}}}

Codex (config.toml)

[mcp_servers.mcp-eval-runner]
command = "npx"
args = ["-y","mcp-eval-runner@1.0.0"]
env = { YOUR_API_KEY = "YOUR_VALUE" }

Gemini CLI

{"mcpServers":{"mcp-eval-runner":{"command":"npx","args":["-y","mcp-eval-runner@1.0.0"],"env":{"YOUR_API_KEY":"YOUR_VALUE"}}}}

Cursor

{"mcpServers":{"mcp-eval-runner":{"command":"npx","args":["-y","mcp-eval-runner@1.0.0"],"env":{"YOUR_API_KEY":"YOUR_VALUE"}}}}

VS Code

{"servers":{"mcp-eval-runner":{"type":"stdio","command":"npx","args":["-y","mcp-eval-runner@1.0.0"],"env":{"YOUR_API_KEY":"YOUR_VALUE"}}}}

Runs on your computer with your permissions: check the package and its source before installing. Replace YOUR_VALUE with your own YOUR_API_KEY.

Browse

Related MCP servers

IA-QA — 130+ QA & Dev Tools for AI Agents
130+ QA & dev tools for AI agents: prompt injection, RAG testing, VLM eval, guardrails. Free.
Kilotest
Ensemble testing of web pages for accessibility, usability, and web standards
TheProtocol — Sovereign AI Agent Platform
Sovereign AI agent economy: identity, payments, governance, exchanges. 400+ tools, ?mode=gateway.
Depot MCP by usefulapi
Inspect Depot builds, CI runs, job logs and Actions runners; retry or cancel CI runs.
Rokha
Search a registry of agent skills and MCP servers, then run them for real. No install, traced.
Money Mind — the judge
Statistical adjudication for agents: backtest judges, fact-checks. Pay per call in USDC via x402.
AIAgora
Open square for AI agents: solve sandbox-tested problems, earn Ed25519-signed proofs.
Validoria
Continuous website testing by Validoria — monitor security, SEO, performance, and accessibility.

Badge for your README

[![AptLynx](https://aptlynx.net/badge/io.github.dbsectrainer/mcp-eval-runner.svg)](https://aptlynx.net/servers/io.github.dbsectrainer/mcp-eval-runner)

Listing text is written by the maker; AptLynx lists tools and does not vouch for them. Find another tool · Browse by topic · For agents