TheCrawler
Rank #31,398io.github.manchittlab/thecrawler
Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
TheCrawler is a Model Context Protocol (MCP) server published by manchittlab. It ranks #31,398 of 137,492 servers tracked on MCP Toplist, and its repository has 2 GitHub stars. TheCrawler is listed across 3 registries — Official MCP, PulseMCP and Glama, with 5 tracked versions. It was first listed on Apr 14, 2026 and most recently updated on Jul 2, 2026.
Ranks ahead of 106,094 of 137,492 servers on MCP Toplist.
Use TheCrawler
No credentials or required configuration declared — add it to your MCP client and go.
claude mcp add thecrawler -- npx -y thecrawler[mcp_servers.thecrawler]
command = "npx"
args = ["-y", "thecrawler"]Add to ~/.codex/config.toml.
{
"mcpServers": {
"thecrawler": {
"command": "npx",
"args": [
"-y",
"thecrawler"
]
}
}
}Add to claude_desktop_config.json (Settings → Developer → Edit Config).
{
"mcpServers": {
"thecrawler": {
"command": "npx",
"args": [
"-y",
"thecrawler"
]
}
}
}Add to ~/.cursor/mcp.json (global) or .cursor/mcp.json (per project).
{
"servers": {
"thecrawler": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"thecrawler"
]
}
}
}Save as .vscode/mcp.json in your workspace.
{
"mcpServers": {
"thecrawler": {
"command": "npx",
"args": [
"-y",
"thecrawler"
]
}
}
}Add to ~/.codeium/windsurf/mcp_config.json.
{
"mcpServers": {
"thecrawler": {
"command": "npx",
"args": [
"-y",
"thecrawler"
]
}
}
}Show your rank
Maintain this server? Add the live rank badge to your README — it updates automatically as the leaderboard changes.
[](https://mcptoplist.com/server/io.github.manchittlab%2Fthecrawler)<a href="https://mcptoplist.com/server/io.github.manchittlab%2Fthecrawler"><img src="https://mcptoplist.com/badge/io.github.manchittlab%2Fthecrawler.svg" alt="MCP Toplist: Top 25% of 137,492" /></a>Variants: append ?metric=score or ?metric=stars to the image URL.
Listed on 3 registries
manchittlab
Available versions (5)
| Version | Published |
|---|---|
| 0.5.8 | Jul 2, 2026 |
| 0.5.7 | Jun 29, 2026 |
| 0.5.4 | Jun 26, 2026 |
| 0.5.3 | Jun 26, 2026 |
| 0.1.1 | Apr 18, 2026 |
Frequently asked questions
- Who maintains TheCrawler?
- TheCrawler is maintained by manchittlab, which publishes 1 MCP server (5 total versions) tracked on MCP Toplist.
- Is TheCrawler listed on the Official MCP Registry?
- Yes — TheCrawler is listed on the Official MCP Registry, alongside PulseMCP and Glama.
- How many versions does TheCrawler have?
- MCP Toplist tracks 5 versions of TheCrawler, most recently published on Jul 2, 2026.
- Where can I find the source code for TheCrawler?
- The source code for TheCrawler is hosted at github.com/manchittlab/thecrawler.
Do you run this server?
Community projects list the MCP servers behind real agents and apps. Publish yours and this page will link to it.