Web Crawler MCP Server
Rank #25212glama/dhannusch/smart-web-crawler-mcp
An intelligent web crawling server that uses Cloudflare's headless browser to render dynamic pages and Workers AI to extract relevant links based on natural language queries. It enables AI assistants to search and filter website content while providing secure access through GitHub OAuth authentication.
Web Crawler MCP Server is a Model Context Protocol (MCP) server published by dhannusch. It ranks #25212 of 58,832 servers tracked on MCP Toplist, and its repository has 3 GitHub stars. Web Crawler MCP Server is listed on Glama, and ships as a single rolling release with no explicit version metadata. It was first listed on Jan 19, 2026.
Ranks ahead of 33,620 of 58,832 servers on MCP Toplist.
Listed on 1 registry
dhannusch
Not versioned
This server is published through a registry that does not expose explicit version metadata. The listing tracks a single rolling release.
Frequently asked questions
- What is Web Crawler MCP Server?
- An intelligent web crawling server that uses Cloudflare's headless browser to render dynamic pages and Workers AI to extract relevant links based on natural language queries. It enables AI assistants to search and filter website content while providing secure access through GitHub OAuth authentication.
- Who maintains Web Crawler MCP Server?
- Web Crawler MCP Server is maintained by dhannusch, which publishes 1 MCP server (0 total versions) tracked on MCP Toplist.
- Is Web Crawler MCP Server an official MCP server?
- Web Crawler MCP Server is not on the Official MCP Registry. It is listed on Glama.
- How many versions does Web Crawler MCP Server have?
- Web Crawler MCP Server ships as a single rolling release with no explicit version metadata.
- Where can I find the source code for Web Crawler MCP Server?
- The source code for Web Crawler MCP Server is hosted at github.com/dhannusch/smart-web-crawler-mcp.