webcrawl-mcp
If you are the rightful owner of webcrawl-mcp and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcphub.com.
The Webcrawl MCP Server is a production-ready implementation of the Model Context Protocol (MCP) designed for comprehensive web crawling and intelligent content extraction.
crawl
Basic web crawling tool for extracting page content, metadata, and links.
smartCrawl
Intelligent crawling tool with relevance scoring and smart navigation.
extractLinks
Tool for extracting and categorizing links from a web page.
searchInPage
Tool for searching specific content within a web page.
generateSitemap
Tool for creating a sitemap by crawling website pages.
webSearch
Tool for performing web searches with multi-engine support.
getDateTime
Utility tool for date/time functions with timezone support.