Web Crawler
Rank #71,381pulsemcp/jitsmaster-web-crawler
Configurable web crawler that extracts structured content from websites while respecting robots.txt rules and offering customizable settings for depth, delay, and concurrency.
Web Crawler is a Model Context Protocol (MCP) server published by jitsmaster. It ranks #71,381 of 137,492 servers tracked on MCP Toplist, and its repository has 1 GitHub stars. Web Crawler is listed on PulseMCP, and ships as a single rolling release with no explicit version metadata. It was first listed on Jan 10, 2025.
Ranks ahead of 66,111 of 137,492 servers on MCP Toplist.
Show your rank
Maintain this server? Add the live rank badge to your README — it updates automatically as the leaderboard changes.
[](https://mcptoplist.com/server/pulsemcp%2Fjitsmaster-web-crawler)<a href="https://mcptoplist.com/server/pulsemcp%2Fjitsmaster-web-crawler"><img src="https://mcptoplist.com/badge/pulsemcp%2Fjitsmaster-web-crawler.svg" alt="MCP Toplist: #71,381 of 137,492" /></a>Variants: append ?metric=score or ?metric=stars to the image URL.
Listed on 1 registry
jitsmaster
Not versioned
This server is published through a registry that does not expose explicit version metadata, and no GitHub release tags were found on the linked repository. The listing tracks a single rolling release.
Frequently asked questions
- Who maintains Web Crawler?
- Web Crawler is maintained by jitsmaster, which publishes 1 MCP server (0 total versions) tracked on MCP Toplist.
- Is Web Crawler listed on the Official MCP Registry?
- Web Crawler is not on the Official MCP Registry. It is listed on PulseMCP.
- How many versions does Web Crawler have?
- Web Crawler ships as a single rolling release with no explicit version metadata.
- Where can I find the source code for Web Crawler?
- The source code for Web Crawler is hosted at github.com/jitsmaster/webscrapemcpserver.
Do you run this server?
Community projects list the MCP servers behind real agents and apps. Publish yours and this page will link to it.