mcp-server-webcrawl

mcp-server-webcrawl

3.4

If you are the rightful owner of mcp-server-webcrawl and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcphub.com.

Advanced search and retrieval for web crawler data.

mcp-server-webcrawl is a powerful tool designed to enhance the capabilities of AI clients in filtering and analyzing web content. It provides a full-text search interface with boolean support, allowing users to filter resources by type, HTTP status, and more. The server is compatible with various web crawlers, making it versatile for different web content retrieval needs. It is free, open-source, and requires Claude Desktop and Python (>=3.10) for installation. The tool is particularly useful for creating a comprehensive website knowledgebase and supports Markdown and snippets for efficient data handling.

Features

  • Claude Desktop ready
  • Multi-crawler compatible
  • Filter by type, status, and more
  • Boolean search support
  • Support for Markdown and snippets