Robots Txt Checker
Rank #67,353io.github.ryuamarines/robots-txt-checker
Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).
Robots Txt Checker is a Model Context Protocol (MCP) server. It ranks #67,353 of 137,138 servers tracked on MCP Toplist. Robots Txt Checker is listed on Official MCP, with 2 tracked versions. It was first listed on Sep 2, 2026 and most recently updated on Sep 2, 2026.
Ranks ahead of 69,785 of 137,138 servers on MCP Toplist.
Use Robots Txt Checker
No credentials or required configuration declared — add it to your MCP client and go.
claude mcp add --transport http robots-txt-checker https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp[mcp_servers.robots-txt-checker]
url = "https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"Add to ~/.codex/config.toml.
https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcpSettings → Connectors → “Add custom connector”, then paste this URL.
{
"mcpServers": {
"robots-txt-checker": {
"url": "https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"
}
}
}Add to ~/.cursor/mcp.json (global) or .cursor/mcp.json (per project).
{
"servers": {
"robots-txt-checker": {
"type": "http",
"url": "https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"
}
}
}Save as .vscode/mcp.json in your workspace.
{
"mcpServers": {
"robots-txt-checker": {
"serverUrl": "https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json.
{
"mcpServers": {
"robots-txt-checker": {
"url": "https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"
}
}
}Show your rank
Maintain this server? Add the live rank badge to your README — it updates automatically as the leaderboard changes.
[](https://mcptoplist.com/server/io.github.ryuamarines%2Frobots-txt-checker)<a href="https://mcptoplist.com/server/io.github.ryuamarines%2Frobots-txt-checker"><img src="https://mcptoplist.com/badge/io.github.ryuamarines%2Frobots-txt-checker.svg" alt="MCP Toplist: Top 50% of 137,138" /></a>Variants: append ?metric=score or ?metric=stars to the image URL.
Listed on 1 registry
Available versions (2)
| Version | Published |
|---|---|
| 1.0.93057 | Sep 2, 2026 |
| 1.0.92958 | Sep 2, 2026 |
Frequently asked questions
- Is Robots Txt Checker listed on the Official MCP Registry?
- Yes — Robots Txt Checker is listed on the Official MCP Registry.
- How many versions does Robots Txt Checker have?
- MCP Toplist tracks 2 versions of Robots Txt Checker, most recently published on Sep 2, 2026.
Do you run this server?
Community projects list the MCP servers behind real agents and apps. Publish yours and this page will link to it.