pragmar_mcp_server_webcrawl

pragmar_mcp_server_webcrawl

3.1
ai_chatbotcloud_platforms

If you are the rightful owner of pragmar_mcp_server_webcrawl and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcphub.com.

mcp-server-webcrawl bridges the gap between web crawlers and AI language models using the Model Context Protocol (MCP).

mcp-server-webcrawl is a powerful tool designed to integrate web crawling capabilities with AI language models through the Model Context Protocol (MCP). It allows AI clients to filter and analyze web content autonomously or under user direction. The server features a full-text search interface with boolean support and resource filtering by type, HTTP status, and more. It is compatible with various web crawlers such as WARC, wget, InterroBot, Katana, and SiteOne. This open-source tool requires Claude Desktop and Python (>=3.10) and can be installed via pip. It is designed to provide a comprehensive menu for LLMs to search web content effectively.

Features

  • Claude Desktop ready
  • Fulltext search support
  • Filter by type, status, and more
  • Multi-crawler compatible
  • Quick MCP configuration

Related MCP Servers

View all ai_chatbot servers →
elevenlabs-mcp

elevenlabs-mcp

4.6

by elevenlabs

Official ElevenLabs Model Context Protocol (MCP) server for interaction with Text to Speech and audio processing APIs.

ai_chatbot
mindsdb

mindsdb

4.5

by mindsdb

MindsDB is an open-source server that enables seamless interaction with large-scale federated data using the Model Context Protocol (MCP).

databases
osp_marketing_tools

osp_marketing_tools

4.4

by open-strategy-partners

A comprehensive suite of tools for technical marketing content creation, optimization, and product positioning based on Open Strategy Partners' proven methodologies.

communication
mcp-notion-server

mcp-notion-server

4.3

by suekou

MCP Server for the Notion API, enabling LLM to interact with Notion workspaces. Additionally, it employs Markdown conversion to reduce context size when communicating with LLMs, optimizing token usage and making interactions more efficient.

databases
Sequential Thinking

Sequential Thinking

4.3

by modelcontextprotocol

An MCP server implementation that provides a tool for dynamic and reflective problem-solving through a structured thinking process.

research_and_data
tavily-mcp

tavily-mcp

4.3

by tavily-ai

The Tavily MCP server is a Model Context Protocol server that integrates with AI systems to provide real-time web search and data extraction capabilities.

browser_automation
paelladoc

paelladoc

4.3

by jlcases

PAELLADOC is an AI-First Development framework implementing the Model Context Protocol (MCP) to enhance LLM interactions with external tools and context.

ai_chatbot
ai-agent-marketplace-index-mcp

ai-agent-marketplace-index-mcp

4.1

by AI-Agent-Hub

MCP Server for AI Agent Marketplace Index from DeepNLP, allowing AI assistants to search available AI agents by keywords or categories.

browser_automation
rapidocr-mcp

rapidocr-mcp

4.0

by z4none

RapidOCR MCP Server is a Model Context Protocol server that provides an easy-to-use OCR interface.

ai_chatbot
exa-mcp-server

exa-mcp-server

3.8

by exa-labs

A Model Context Protocol (MCP) server allows AI assistants to use the Exa AI Search API for real-time web searches in a secure manner.

research_and_data
magic-mcp

magic-mcp

3.8

by 21st-dev

Magic Component Platform (MCP) is a powerful AI-driven tool that helps developers create beautiful, modern UI components instantly through natural language descriptions.

developer_tools
ableton-mcp

ableton-mcp

3.8

by ahujasid

AbletonMCP connects Ableton Live to Claude AI through the Model Context Protocol (MCP), allowing Claude to directly interact with and control Ableton Live.

ai_chatbot
blender-mcp

blender-mcp

3.8

by ahujasid

BlenderMCP connects Blender to Claude AI through the Model Context Protocol (MCP), enabling prompt-assisted 3D modeling, scene creation, and manipulation.

entertainment_and_media
unity-mcp

unity-mcp

3.8

by justinpbarnett

Unity MCP connects your Unity Editor to LLMs using the Model Context Protocol, enabling AI assistants to interact with Unity for asset management, scene control, script editing, and task automation.

ai_chatbot
mcp-crawl4ai-rag

mcp-crawl4ai-rag

3.8

by coleam00

Crawl4AI RAG MCP Server is a powerful implementation of the Model Context Protocol (MCP) integrated with Crawl4AI and Supabase, providing AI agents and AI coding assistants with advanced web crawling and RAG capabilities.

browser_automation
whatsapp-mcp

whatsapp-mcp

3.8

by lharries

This is a Model Context Protocol (MCP) server for WhatsApp, allowing users to interact with their WhatsApp messages and contacts through an LLM like Claude.

communication
azure-mcp

azure-mcp

3.8

by Azure

The Azure MCP Server implements the MCP specification to create a seamless connection between AI agents and Azure services.

cloud_platforms
unreal-mcp

unreal-mcp

3.8

by chongdashu

This project enables AI assistant clients like Cursor, Windsurf, and Claude Desktop to control Unreal Engine through natural language using the Model Context Protocol (MCP).

developer_tools
hyper-mcp

hyper-mcp

3.7

by tuananh

hyper-mcp is a fast, secure MCP server that extends its capabilities through WebAssembly plugins.

ai_chatbot
Tianji

Tianji

3.7

by msgbyte

A server based on Model Context Protocol (MCP) that provides tools for interacting with the Tianji platform.

ai_chatbot
minima

minima

3.7

by dmayboroda

Minima is an open-source RAG on-premises container solution that integrates with ChatGPT and MCP, allowing for fully local or hybrid installations.

ai_chatbot
just-prompt

just-prompt

3.7

by disler

Just Prompt is a lightweight MCP server providing a unified interface to various LLM providers.

ai_chatbot
MCP-Chinese-Getting-Started-Guide

MCP-Chinese-Getting-Started-Guide

3.7

by liaokongVFX

The Model Context Protocol (MCP) is a groundbreaking open-source protocol enabling large language models to seamlessly connect with various external data sources and tools. It provides a standardized method for AI models to interact with their environment, much like a USB-C interface for AI applications.

ai_chatbot
Baidu AI Search

Baidu AI Search

3.7

by baidubce

Baidu AI Search integrates Baidu's search capabilities with large language model technology to provide intelligent responses with real-time web information references.

research_and_data
MCP Component Server

MCP Component Server

3.7

by baidubce

The MCP Component Server is a FastMCP server-based implementation that converts AppBuilder Components into FastMCP tools, enabling seamless integration of Baidu cloud AI services into MCP-compatible environments.

cloud_platforms
blender-mcp-vxai

blender-mcp-vxai

3.7

by VxASI

Blender MCP VXAI is a powerful integration that allows you to control Blender using natural language through MCP Clients.

ai_chatbot
obsidian-mcp-tools

obsidian-mcp-tools

3.6

by jacksteamdev

MCP Tools for Obsidian enables AI applications like Claude Desktop to securely access and work with your Obsidian vault through the Model Context Protocol (MCP).

ai_chatbot