webcrawl-mcp

webcrawl-mcp

3.2

If you are the rightful owner of webcrawl-mcp and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcphub.com.

The Webcrawl MCP Server is a production-ready implementation of the Model Context Protocol (MCP) designed for comprehensive web crawling and intelligent content extraction.

crawl

Basic web crawling tool for extracting page content, metadata, and links.

smartCrawl

Intelligent crawling tool with relevance scoring and smart navigation.

extractLinks

Tool for extracting and categorizing links from a web page.

searchInPage

Tool for searching specific content within a web page.

generateSitemap

Tool for creating a sitemap by crawling website pages.

webSearch

Tool for performing web searches with multi-engine support.

getDateTime

Utility tool for date/time functions with timezone support.