crawl4ai-mcp-server

crawl4ai-mcp-server

3.3

If you are the rightful owner of crawl4ai-mcp-server and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcphub.com.

Crawl4AI MCP Server is a high-performance Model Context Protocol server designed for web scraping and crawling, enabling AI assistants to perform deep research efficiently.

The Crawl4AI MCP Server is a custom implementation of the Model Context Protocol (MCP) that integrates with the Crawl4AI library, providing advanced web scraping and crawling capabilities. Deployed on CloudFlare Workers, it allows AI assistants to access these features remotely. The server supports single webpage scraping, web crawling, URL discovery, and asynchronous crawling. It also offers content processing features like deep research, structured data extraction, and content search. With seamless MCP integration, OAuth authentication, and high performance, it is optimized for speed and security.

Features

  • Web Data Acquisition: Includes single webpage scraping, web crawling, URL discovery, and asynchronous crawling.
  • Content Processing: Offers deep research, structured data extraction, and content search capabilities.
  • Integration & Security: Features seamless MCP integration, OAuth authentication, and high performance.

Tools

  1. crawl

    Crawl web pages from a starting URL.

  2. getCrawl

    Retrieve crawl data by ID.

  3. listCrawls

    List all crawls or filter by domain.

  4. search

    Search indexed documents by query.

  5. extract

    Extract structured content from a URL.