SERVER

evals-mcp-server

Rank #13,734

io.github.cyanheads/evals-mcp-server

Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.

3 versions

1 GitHub stars

by cyanheads (135 servers)View repository ↗Claim this server

First listed

Jun 28, 2026

Last publish date

Sep 22, 2026

OVERVIEW

evals-mcp-server is a Model Context Protocol (MCP) server published by cyanheads. It ranks #13,734 of 132,046 servers tracked on MCP Toplist, and its repository has 1 GitHub stars. evals-mcp-server is listed across 4 registries — Official MCP, PulseMCP, Smithery and Glama, with 3 tracked versions. It was first listed on Jun 28, 2026 and most recently updated on Sep 22, 2026.

STANDING

#13,734of 132,046 tracked serversTop 25%

Ranks ahead of 118,312 of 132,046 servers on MCP Toplist.

CONNECT

Use evals-mcp-server

No setupRuns out of the box

No credentials or required configuration declared — add it to your MCP client and go.

npm package

claude mcp add evals-mcp-server -e "EVALS_DATA_DIR=<your EVALS_DATA_DIR>" -e "EVALS_REQUIRE_CONFIRMATION=<your EVALS_REQUIRE_CONFIRMATION>" -e "EVALS_DEFAULT_LICENSE=<your EVALS_DEFAULT_LICENSE>" -e "EVALS_CAPTURE_DIR=<your EVALS_CAPTURE_DIR>" -e "MCP_LOG_LEVEL=<your MCP_LOG_LEVEL>" -- npx -y @cyanheads/evals-mcp-server run start:stdio

Replace each placeholder with your own value before saving.

npm package

claude mcp add evals-mcp-server -e "MCP_HTTP_HOST=<your MCP_HTTP_HOST>" -e "MCP_HTTP_PORT=<your MCP_HTTP_PORT>" -e "MCP_HTTP_ENDPOINT_PATH=<your MCP_HTTP_ENDPOINT_PATH>" -e "MCP_AUTH_MODE=<your MCP_AUTH_MODE>" -e "EVALS_DATA_DIR=<your EVALS_DATA_DIR>" -e "EVALS_REQUIRE_CONFIRMATION=<your EVALS_REQUIRE_CONFIRMATION>" -e "EVALS_DEFAULT_LICENSE=<your EVALS_DEFAULT_LICENSE>" -e "EVALS_CAPTURE_DIR=<your EVALS_CAPTURE_DIR>" -e "MCP_LOG_LEVEL=<your MCP_LOG_LEVEL>" -- npx -y @cyanheads/evals-mcp-server run start:http

Replace each placeholder with your own value before saving.

npm package

[mcp_servers.evals-mcp-server]
command = "npx"
args = ["-y", "@cyanheads/evals-mcp-server", "run", "start:stdio"]

[mcp_servers.evals-mcp-server.env]
EVALS_DATA_DIR = "<your EVALS_DATA_DIR>"
EVALS_REQUIRE_CONFIRMATION = "<your EVALS_REQUIRE_CONFIRMATION>"
EVALS_DEFAULT_LICENSE = "<your EVALS_DEFAULT_LICENSE>"
EVALS_CAPTURE_DIR = "<your EVALS_CAPTURE_DIR>"
MCP_LOG_LEVEL = "<your MCP_LOG_LEVEL>"

Add to ~/.codex/config.toml. Replace each placeholder with your own value before saving.

npm package

[mcp_servers.evals-mcp-server]
command = "npx"
args = ["-y", "@cyanheads/evals-mcp-server", "run", "start:http"]

[mcp_servers.evals-mcp-server.env]
MCP_HTTP_HOST = "<your MCP_HTTP_HOST>"
MCP_HTTP_PORT = "<your MCP_HTTP_PORT>"
MCP_HTTP_ENDPOINT_PATH = "<your MCP_HTTP_ENDPOINT_PATH>"
MCP_AUTH_MODE = "<your MCP_AUTH_MODE>"
EVALS_DATA_DIR = "<your EVALS_DATA_DIR>"
EVALS_REQUIRE_CONFIRMATION = "<your EVALS_REQUIRE_CONFIRMATION>"
EVALS_DEFAULT_LICENSE = "<your EVALS_DEFAULT_LICENSE>"
EVALS_CAPTURE_DIR = "<your EVALS_CAPTURE_DIR>"
MCP_LOG_LEVEL = "<your MCP_LOG_LEVEL>"

Add to ~/.codex/config.toml. Replace each placeholder with your own value before saving.

npm package

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server",
        "run",
        "start:stdio"
      ],
      "env": {
        "EVALS_DATA_DIR": "<your EVALS_DATA_DIR>",
        "EVALS_REQUIRE_CONFIRMATION": "<your EVALS_REQUIRE_CONFIRMATION>",
        "EVALS_DEFAULT_LICENSE": "<your EVALS_DEFAULT_LICENSE>",
        "EVALS_CAPTURE_DIR": "<your EVALS_CAPTURE_DIR>",
        "MCP_LOG_LEVEL": "<your MCP_LOG_LEVEL>"
      }
    }
  }
}

Add to claude_desktop_config.json (Settings → Developer → Edit Config). Replace each placeholder with your own value before saving.

npm package

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server",
        "run",
        "start:http"
      ],
      "env": {
        "MCP_HTTP_HOST": "<your MCP_HTTP_HOST>",
        "MCP_HTTP_PORT": "<your MCP_HTTP_PORT>",
        "MCP_HTTP_ENDPOINT_PATH": "<your MCP_HTTP_ENDPOINT_PATH>",
        "MCP_AUTH_MODE": "<your MCP_AUTH_MODE>",
        "EVALS_DATA_DIR": "<your EVALS_DATA_DIR>",
        "EVALS_REQUIRE_CONFIRMATION": "<your EVALS_REQUIRE_CONFIRMATION>",
        "EVALS_DEFAULT_LICENSE": "<your EVALS_DEFAULT_LICENSE>",
        "EVALS_CAPTURE_DIR": "<your EVALS_CAPTURE_DIR>",
        "MCP_LOG_LEVEL": "<your MCP_LOG_LEVEL>"
      }
    }
  }
}

Add to claude_desktop_config.json (Settings → Developer → Edit Config). Replace each placeholder with your own value before saving.

npm package

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server",
        "run",
        "start:stdio"
      ],
      "env": {
        "EVALS_DATA_DIR": "<your EVALS_DATA_DIR>",
        "EVALS_REQUIRE_CONFIRMATION": "<your EVALS_REQUIRE_CONFIRMATION>",
        "EVALS_DEFAULT_LICENSE": "<your EVALS_DEFAULT_LICENSE>",
        "EVALS_CAPTURE_DIR": "<your EVALS_CAPTURE_DIR>",
        "MCP_LOG_LEVEL": "<your MCP_LOG_LEVEL>"
      }
    }
  }
}

Add to ~/.cursor/mcp.json (global) or .cursor/mcp.json (per project). Replace each placeholder with your own value before saving.

npm package

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server",
        "run",
        "start:http"
      ],
      "env": {
        "MCP_HTTP_HOST": "<your MCP_HTTP_HOST>",
        "MCP_HTTP_PORT": "<your MCP_HTTP_PORT>",
        "MCP_HTTP_ENDPOINT_PATH": "<your MCP_HTTP_ENDPOINT_PATH>",
        "MCP_AUTH_MODE": "<your MCP_AUTH_MODE>",
        "EVALS_DATA_DIR": "<your EVALS_DATA_DIR>",
        "EVALS_REQUIRE_CONFIRMATION": "<your EVALS_REQUIRE_CONFIRMATION>",
        "EVALS_DEFAULT_LICENSE": "<your EVALS_DEFAULT_LICENSE>",
        "EVALS_CAPTURE_DIR": "<your EVALS_CAPTURE_DIR>",
        "MCP_LOG_LEVEL": "<your MCP_LOG_LEVEL>"
      }
    }
  }
}

Add to ~/.cursor/mcp.json (global) or .cursor/mcp.json (per project). Replace each placeholder with your own value before saving.

npm package

{
  "servers": {
    "evals-mcp-server": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server",
        "run",
        "start:stdio"
      ],
      "env": {
        "EVALS_DATA_DIR": "<your EVALS_DATA_DIR>",
        "EVALS_REQUIRE_CONFIRMATION": "<your EVALS_REQUIRE_CONFIRMATION>",
        "EVALS_DEFAULT_LICENSE": "<your EVALS_DEFAULT_LICENSE>",
        "EVALS_CAPTURE_DIR": "<your EVALS_CAPTURE_DIR>",
        "MCP_LOG_LEVEL": "<your MCP_LOG_LEVEL>"
      }
    }
  }
}

Save as .vscode/mcp.json in your workspace. Replace each placeholder with your own value before saving.

npm package

{
  "servers": {
    "evals-mcp-server": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server",
        "run",
        "start:http"
      ],
      "env": {
        "MCP_HTTP_HOST": "<your MCP_HTTP_HOST>",
        "MCP_HTTP_PORT": "<your MCP_HTTP_PORT>",
        "MCP_HTTP_ENDPOINT_PATH": "<your MCP_HTTP_ENDPOINT_PATH>",
        "MCP_AUTH_MODE": "<your MCP_AUTH_MODE>",
        "EVALS_DATA_DIR": "<your EVALS_DATA_DIR>",
        "EVALS_REQUIRE_CONFIRMATION": "<your EVALS_REQUIRE_CONFIRMATION>",
        "EVALS_DEFAULT_LICENSE": "<your EVALS_DEFAULT_LICENSE>",
        "EVALS_CAPTURE_DIR": "<your EVALS_CAPTURE_DIR>",
        "MCP_LOG_LEVEL": "<your MCP_LOG_LEVEL>"
      }
    }
  }
}

Save as .vscode/mcp.json in your workspace. Replace each placeholder with your own value before saving.

npm package

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server",
        "run",
        "start:stdio"
      ],
      "env": {
        "EVALS_DATA_DIR": "<your EVALS_DATA_DIR>",
        "EVALS_REQUIRE_CONFIRMATION": "<your EVALS_REQUIRE_CONFIRMATION>",
        "EVALS_DEFAULT_LICENSE": "<your EVALS_DEFAULT_LICENSE>",
        "EVALS_CAPTURE_DIR": "<your EVALS_CAPTURE_DIR>",
        "MCP_LOG_LEVEL": "<your MCP_LOG_LEVEL>"
      }
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json. Replace each placeholder with your own value before saving.

npm package

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server",
        "run",
        "start:http"
      ],
      "env": {
        "MCP_HTTP_HOST": "<your MCP_HTTP_HOST>",
        "MCP_HTTP_PORT": "<your MCP_HTTP_PORT>",
        "MCP_HTTP_ENDPOINT_PATH": "<your MCP_HTTP_ENDPOINT_PATH>",
        "MCP_AUTH_MODE": "<your MCP_AUTH_MODE>",
        "EVALS_DATA_DIR": "<your EVALS_DATA_DIR>",
        "EVALS_REQUIRE_CONFIRMATION": "<your EVALS_REQUIRE_CONFIRMATION>",
        "EVALS_DEFAULT_LICENSE": "<your EVALS_DEFAULT_LICENSE>",
        "EVALS_CAPTURE_DIR": "<your EVALS_CAPTURE_DIR>",
        "MCP_LOG_LEVEL": "<your MCP_LOG_LEVEL>"
      }
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json. Replace each placeholder with your own value before saving.

npm package

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server",
        "run",
        "start:stdio"
      ],
      "env": {
        "EVALS_DATA_DIR": "<your EVALS_DATA_DIR>",
        "EVALS_REQUIRE_CONFIRMATION": "<your EVALS_REQUIRE_CONFIRMATION>",
        "EVALS_DEFAULT_LICENSE": "<your EVALS_DEFAULT_LICENSE>",
        "EVALS_CAPTURE_DIR": "<your EVALS_CAPTURE_DIR>",
        "MCP_LOG_LEVEL": "<your MCP_LOG_LEVEL>"
      }
    }
  }
}

Replace each placeholder with your own value before saving.

npm package

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server",
        "run",
        "start:http"
      ],
      "env": {
        "MCP_HTTP_HOST": "<your MCP_HTTP_HOST>",
        "MCP_HTTP_PORT": "<your MCP_HTTP_PORT>",
        "MCP_HTTP_ENDPOINT_PATH": "<your MCP_HTTP_ENDPOINT_PATH>",
        "MCP_AUTH_MODE": "<your MCP_AUTH_MODE>",
        "EVALS_DATA_DIR": "<your EVALS_DATA_DIR>",
        "EVALS_REQUIRE_CONFIRMATION": "<your EVALS_REQUIRE_CONFIRMATION>",
        "EVALS_DEFAULT_LICENSE": "<your EVALS_DEFAULT_LICENSE>",
        "EVALS_CAPTURE_DIR": "<your EVALS_CAPTURE_DIR>",
        "MCP_LOG_LEVEL": "<your MCP_LOG_LEVEL>"
      }
    }
  }
}

Replace each placeholder with your own value before saving.

BADGE

Show your rank

Maintain this server? Add the live rank badge to your README — it updates automatically as the leaderboard changes.

Markdown

[![MCP Toplist](https://mcptoplist.com/badge/io.github.cyanheads%2Fevals-mcp-server.svg)](https://mcptoplist.com/server/io.github.cyanheads%2Fevals-mcp-server)

HTML

<a href="https://mcptoplist.com/server/io.github.cyanheads%2Fevals-mcp-server"><img src="https://mcptoplist.com/badge/io.github.cyanheads%2Fevals-mcp-server.svg" alt="MCP Toplist: Top 25% of 132,046" /></a>

Variants: append ?metric=score or ?metric=stars to the image URL.

REGISTRIES

Listed on 4 registries

ORGANIZATION

cyanheads

Organization

cyanheads

Servers in org

135

Versions across org

2337

Other servers by cyanheads

View all cyanheads servers →

VERSIONS

Available versions (3)

Version	Published
0.1.4	Sep 22, 2026
0.1.3	Aug 22, 2026
0.1.2	Jun 28, 2026

FAQ

Frequently asked questions

Who maintains evals-mcp-server?: evals-mcp-server is maintained by cyanheads, which publishes 135 MCP servers (2337 total versions) tracked on MCP Toplist.
Is evals-mcp-server listed on the Official MCP Registry?: Yes — evals-mcp-server is listed on the Official MCP Registry, alongside PulseMCP, Smithery and Glama.
How many versions does evals-mcp-server have?: MCP Toplist tracks 3 versions of evals-mcp-server, most recently published on Sep 22, 2026.
Where can I find the source code for evals-mcp-server?: The source code for evals-mcp-server is hosted at github.com/cyanheads/evals-mcp-server.

Used in projects

Do you run this server?

Add to a project

Community projects list the MCP servers behind real agents and apps. Publish yours and this page will link to it.

EXPLORE

All MCP Servers Official MCP Servers GitHub MCP Servers Best MCP Servers Most Active MCP Servers New MCP Servers Best New MCP Servers