crawl4ai-mcp
If you are the rightful owner of crawl4ai-mcp and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcphub.com.
Crawl4AI MCP Server integrates web scraping and crawling capabilities with Cursor AI, providing tools for LLMs in Cursor Composer's agent mode.
The Crawl4AI MCP Server is a robust implementation of the Model Context Protocol (MCP) that seamlessly integrates with Cursor AI. It is designed to enhance the capabilities of language models by providing them with web scraping and crawling functionalities. This server allows LLMs to access and process web data efficiently, making it a valuable tool for applications that require real-time data retrieval and analysis. The server supports single-page scraping and comprehensive website crawling, offering flexibility in data collection. With Python 3.10 or higher as a prerequisite, the server is easy to set up and integrate into existing systems. The server's tools are exposed to LLMs, enabling them to perform tasks such as extracting content and metadata from web pages and crawling websites to a specified depth and page limit. This integration empowers LLMs to operate with enhanced context and data-driven insights.
Features
- Single page scraping
- Website crawling
Tools
scrape_webpage
Scrapes the content and metadata from a single webpage using Crawl4AI.
crawl_website
Crawls a website starting from the given URL up to a specified depth and page limit using Crawl4AI.
