crawl-mcp

walksoda/crawl-mcp

3.4

If you are the rightful owner of crawl-mcp and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcphub.com.

Crawl4AI MCP Server is a comprehensive Model Context Protocol server that integrates the powerful crawl4ai library, offering advanced web crawling, content extraction, and AI-powered analysis capabilities through a standardized MCP interface.

Tools

Functions exposed to the LLM to take actions

crawl_url

Advanced web crawling with deep crawling support and intelligent filtering.

deep_crawl_site

Comprehensive site mapping and recursive crawling.

intelligent_extract

AI-powered content extraction with advanced filtering and analysis.

extract_entities

High-speed entity extraction using regex patterns.

process_file

Convert various file formats to Markdown using Microsoft MarkItDown.

Prompts

Interactive templates invoked by user choice

No prompts

Resources

Contextual data attached and managed by the client

No resources