RobotsGate
Rank #161,227smithery/mike-tusa/robotsgate
Generate and validate robots.txt rules for AI crawlers, check which AI bots a live site allows, and look up a sourced AI crawler registry. Free: 20 checks and 60 generate/validate calls per minute; Pro $9/mo. RobotsGate is not affiliated with Meta or any other crawler or agent operator. Quick start: connect directly to https://robotsgate.mike-tusa.workers.dev/mcp (Streamable HTTP, no Smithery account needed).
What you can do with RobotsGate
RobotsGate is a Model Context Protocol (MCP) server. It ranks #161,227 of 162,202 active servers on MCP Toplist. RobotsGate is listed on Smithery; no version information is available from the registries that list it or from its repository. It was first listed on Oct 8, 2026.
Not verifiedMCP Toplist has not yet written a checked profile for this server, so the paragraph above is assembled from registry data only. Its registry listings below are the authority on what it does.
What RobotsGate can and cannot do
Not verifiedMCP Toplist has not catalogued this server's tools or limitations. Check its registry listings below.
What you need before using RobotsGate
The hosted endpoint is declared as gated by authentication — connect via its URL and authenticate with the provider (OAuth flow or an API key/header, per its docs).
Declared by Smithery, last synced Oct 28, 2026. Not independently verified by MCP Toplist.
Hosted endpoint declared as requiring authentication.
Connect RobotsGate and confirm it works
claude mcp add --transport http robotsgate https://server.smithery.ai/mike-tusa/robotsgate/mcpThis endpoint requires authentication — see the server’s docs for credentials.
[mcp_servers.robotsgate]
url = "https://server.smithery.ai/mike-tusa/robotsgate/mcp"Add to ~/.codex/config.toml. This endpoint requires authentication — see the server’s docs for credentials.
https://server.smithery.ai/mike-tusa/robotsgate/mcpSettings → Connectors → “Add custom connector”, then paste this URL. This endpoint requires authentication — see the server’s docs for credentials.
{
"mcpServers": {
"robotsgate": {
"url": "https://server.smithery.ai/mike-tusa/robotsgate/mcp"
}
}
}Add to ~/.cursor/mcp.json (global) or .cursor/mcp.json (per project). This endpoint requires authentication — see the server’s docs for credentials.
{
"servers": {
"robotsgate": {
"type": "http",
"url": "https://server.smithery.ai/mike-tusa/robotsgate/mcp"
}
}
}Save as .vscode/mcp.json in your workspace. This endpoint requires authentication — see the server’s docs for credentials.
{
"mcpServers": {
"robotsgate": {
"serverUrl": "https://server.smithery.ai/mike-tusa/robotsgate/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json. This endpoint requires authentication — see the server’s docs for credentials.
{
"mcpServers": {
"robotsgate": {
"url": "https://server.smithery.ai/mike-tusa/robotsgate/mcp"
}
}
}This endpoint requires authentication — see the server’s docs for credentials.
After adding the config, ask your client to list this server's tools. A tool list confirms the connection; an empty list or an error means the server did not start or needs credentials.
What changed, and when this was checked
- First listed
- Oct 8, 2026
- Version history
- Unavailable — no registry exposes versions and no release tags were found
- Requirements evidence
- Declared by Smithery, last synced Oct 28, 2026. Not independently verified by MCP Toplist.
- Profile checked
- Not yet — purpose, capabilities and requirements above come from registry data only
- Ranking data as of
- Oct 28, 2026
- Smithery ↗listed since Oct 28, 2026 · still listed
Do you maintain RobotsGate? to correct or enrich this profile.
Version information unavailable
The registry that lists this server does not expose version metadata, and no release tags were found on the linked repository. MCP Toplist cannot say how, or whether, this server is versioned.
Ranks ahead of 975 of 162,202 servers on MCP Toplist.
Show your rank
Maintain this server? Add the live rank badge to your README — it updates automatically as the leaderboard changes.
[](https://mcptoplist.com/server/smithery%2Fmike-tusa%2Frobotsgate)<a href="https://mcptoplist.com/server/smithery%2Fmike-tusa%2Frobotsgate"><img src="https://mcptoplist.com/badge/smithery%2Fmike-tusa%2Frobotsgate.svg" alt="MCP Toplist: #161,227 of 162,202" /></a>Variants: append ?metric=score or ?metric=stars to the image URL.
Frequently asked questions
- Is RobotsGate listed on the Official MCP Registry?
- RobotsGate is not on the Official MCP Registry. It is listed on Smithery.
- How many versions does RobotsGate have?
- Version information is unavailable for RobotsGate: no registry that lists it exposes version metadata, and no release tags were found on its repository.
Do you run this server?
Community projects list the MCP servers behind real agents and apps. Publish yours and this page will link to it.