mcp-crawl4ai-rag

rbj2000/mcp-crawl4ai-rag

3.3

If you are the rightful owner of mcp-crawl4ai-rag and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcphub.com.

MCP Crawl4AI RAG is a database-agnostic server that integrates web crawling with Retrieval Augmented Generation (RAG) capabilities, supporting multiple vector database backends.

Tools

Functions exposed to the LLM to take actions

crawl_single_page

Quickly crawl a single web page and store its content in the vector database.

smart_crawl_url

Intelligently crawl a full website based on the type of URL provided.

get_available_sources

Get a list of all available sources (domains) in the database.

perform_rag_query

Search for relevant content using semantic search with optional source filtering.

search_code_examples

Search specifically for code examples and their summaries from crawled documentation.

Prompts

Interactive templates invoked by user choice

No prompts

Resources

Contextual data attached and managed by the client

No resources