Web Crawler MCP Server
Rank #50,644glama/dhannusch/smart-web-crawler-mcp
An intelligent web crawling server that uses Cloudflare's headless browser to render dynamic pages and Workers AI to extract relevant links based on natural language queries. It enables AI assistants to search and filter website content while providing secure access through GitHub OAuth authentication.
Web Crawler MCP Server is a Model Context Protocol (MCP) server published by dhannusch. It ranks #50,644 of 132,345 servers tracked on MCP Toplist, and its repository has 3 GitHub stars. Web Crawler MCP Server is listed on Glama, and ships as a single rolling release with no explicit version metadata. It was first listed on Jan 19, 2026.
Ranks ahead of 81,701 of 132,345 servers on MCP Toplist.
Use Web Crawler MCP Server
Requires user-supplied configuration before first use — typically an API key, token or connection string set via environment variables.
This server doesn't publish a machine-readable install config — see the repository README for install instructions.
Show your rank
Maintain this server? Add the live rank badge to your README — it updates automatically as the leaderboard changes.
[](https://mcptoplist.com/server/glama%2Fdhannusch%2Fsmart-web-crawler-mcp)<a href="https://mcptoplist.com/server/glama%2Fdhannusch%2Fsmart-web-crawler-mcp"><img src="https://mcptoplist.com/badge/glama%2Fdhannusch%2Fsmart-web-crawler-mcp.svg" alt="MCP Toplist: Top 50% of 132,345" /></a>Variants: append ?metric=score or ?metric=stars to the image URL.
Listed on 1 registry
dhannusch
Other servers by dhannusch
View all dhannusch servers →Not versioned
This server is published through a registry that does not expose explicit version metadata, and no GitHub release tags were found on the linked repository. The listing tracks a single rolling release.
Frequently asked questions
- Who maintains Web Crawler MCP Server?
- Web Crawler MCP Server is maintained by dhannusch, which publishes 2 MCP servers (0 total versions) tracked on MCP Toplist.
- Is Web Crawler MCP Server listed on the Official MCP Registry?
- Web Crawler MCP Server is not on the Official MCP Registry. It is listed on Glama.
- How many versions does Web Crawler MCP Server have?
- Web Crawler MCP Server ships as a single rolling release with no explicit version metadata.
- Where can I find the source code for Web Crawler MCP Server?
- The source code for Web Crawler MCP Server is hosted at github.com/dhannusch/smart-web-crawler-mcp.
Do you run this server?
Community projects list the MCP servers behind real agents and apps. Publish yours and this page will link to it.