SteffenHebestreit/webcrawl-mcp
If you are the rightful owner of webcrawl-mcp and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcphub.com.
The Webcrawl MCP Server is a production-ready implementation of the Model Context Protocol (MCP) designed for comprehensive web crawling and intelligent content extraction.
Tools
Functions exposed to the LLM to take actions
crawl
Basic web crawling tool for extracting page content, metadata, and links.
smartCrawl
Intelligent crawling tool with relevance scoring and smart navigation.
extractLinks
Tool for extracting and categorizing links from a web page.
searchInPage
Tool for searching specific content within a web page.
generateSitemap
Tool for creating a sitemap by crawling website pages.
webSearch
Tool for performing web searches with multi-engine support.
getDateTime
Utility tool for date/time functions with timezone support.
Prompts
Interactive templates invoked by user choice
No prompts
Resources
Contextual data attached and managed by the client