MCPHub
MCP Servers
luminati-io
web-scraping-with-mcp

luminati-io/web-scraping-with-mcp

3.3

browser_automation ai_chatbot developer_tools communication

If you are the rightful owner of web-scraping-with-mcp and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcphub.com.

This guide provides a comprehensive overview of setting up and using an MCP server for web scraping, particularly with Anthropic's Model Context Protocol (MCP) and Bright Data's tools.

Tools

Functions exposed to the LLM to take actions

fetch_page

Fetches the HTML content of a given URL using Playwright and saves it to a temporary file.

extract_info

Parses the saved HTML file to extract details like title, price, rating, and features, returning a structured dictionary.

Prompts

Interactive templates invoked by user choice

No prompts

Resources

Contextual data attached and managed by the client

No resources

Related MCP Servers

View all browser_automation servers →

mcp-playwright

by executeautomation

A Model Context Protocol server that provides browser automation capabilities using Playwright.

browser_automation

markdownify-mcp

by zcaceres

Markdownify is a Model Context Protocol (MCP) server that converts various file types and web content to Markdown format.

brightdata-mcp

by brightdata

Bright Data MCP server enables real-time web data access for LLMs, agents, and apps, facilitating seamless web navigation and data retrieval.

browser_automation

mcp-webresearch

by mzxrai

A Model Context Protocol (MCP) server for web research, enabling real-time information retrieval and research capabilities within the Claude Desktop app.

research_and_data

tavily-mcp

by tavily-ai

The Tavily MCP server is a Model Context Protocol server that integrates with AI systems to provide real-time web search and data extraction capabilities.

browser_automation

mcp-local-rag

by nkapila6

mcp-local-rag is a primitive RAG-like web search model context protocol server that runs locally without the need for APIs.

research_and_data

mcp-crawl4ai-rag

by coleam00

Crawl4AI RAG MCP Server is a powerful implementation of the Model Context Protocol (MCP) integrated with Crawl4AI and Supabase, providing AI agents and AI coding assistants with advanced web crawling and RAG capabilities.

browser_automation

firecrawl-mcp-server

by firecrawl

Firecrawl MCP Server is a Model Context Protocol server that integrates with Firecrawl for web scraping capabilities.

browser_automation

mobile-mcp

by mobile-next

Mobile Next is an MCP server designed for mobile development and automation across iOS, Android, simulators, emulators, and physical devices.

browser_automation

playwright-mcp

by microsoft

Playwright MCP is a Model Context Protocol server that provides browser automation capabilities using Playwright, enabling LLMs to interact with web pages through structured accessibility snapshots.

browser_automation

website-downloader

by pskill9

The Website Downloader MCP Server is designed to download entire websites using wget, preserving the website structure and converting links for local use.

browser_automation

mcp-browser-use

by Saik0s

AI-driven browser automation server implementing the Model Context Protocol (MCP) for natural language browser control and web research.

browser_automation

google-search

by web-agent-master

A Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches and extract results.

browser_automation

mcp-selenium

by angiejones

A Model Context Protocol (MCP) server implementation for Selenium WebDriver, enabling browser automation through standardized MCP clients.

browser_automation

browser-tools-mcp

by AgentDeskAI

BrowserTools MCP is a browser monitoring and interaction tool that enhances AI applications by capturing and analyzing browser data through a Chrome extension.

browser_automation

RedNote-MCP

by iFurySt

RedNote MCP is a Model Context Protocol server for accessing content on Xiaohongshu.

browser_automation

moling

by gojue

MoLing is a dependency-free local office automation assistant that interacts with the system through operating system APIs, enabling file system operations and command execution.

mcp-server-rag-web-browser

by apify

Implementation of an MCP server for the RAG Web Browser Actor, enabling AI agents to perform web searches and extract information from web pages.

browser_automation

search1api-mcp

by fatwang2

A Model Context Protocol (MCP) server that provides search and crawl functionality using Search1API.

browser_automation

webscraper

by saishridhar

Webscraper MCP is an MCP server designed for Claude desktop, enabling it to scrape text from websites, YouTube transcripts, and PDFs.

browser_automation

markmap-mcp-server

by jinzcdev

Markmap MCP Server is a tool for converting Markdown text into interactive mind maps using the Model Context Protocol.

developer_tools

jcrawl4ai-mcp-server

by rainyheart

jcrawl4ai-mcp-server is a Java-based MCP server for interacting with the Crawl4ai API, enabling web crawling with specified parameters.

browser_automation

comfyui-mcp-server

by joenorton

A lightweight Python-based MCP server interfacing with ComfyUI for image generation via AI agent requests.

browser_automation

mcp-ui

by machaojin1917939763

MCP聊天应用是一个基于Vue.js构建的现代化聊天界面，支持通过Model Context Protocol (MCP)与各种服务和工具进行交互。

scrapeless-mcp-server

by scrapeless-ai

Seamlessly integrate real-time Google SERP results into your LLM applications using the Scrapeless MCP server.

browser_automation

Sketch-Context-MCP

by jshmllr

A Model Context Protocol (MCP) server for integrating Sketch designs with IDEs such as Cursor, Cline, or Windsurf.

browser_automation

bing-search-mcp

by leehanchung

A Model Context Protocol (MCP) server for Microsoft Bing Search API integration, allowing AI assistants to perform web, news, and image searches.

browser_automation