Home
MCP Servers
luminati-io
web-scraping-with-mcp

web-scraping-with-mcp

3.3

browser_automation ai_chatbot developer_tools communication

If you are the rightful owner of web-scraping-with-mcp and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcphub.com.

This guide provides a comprehensive overview of setting up and using an MCP server for web scraping, particularly with Anthropic's Model Context Protocol (MCP) and Bright Data's tools.

fetch_page

Fetches the HTML content of a given URL using Playwright and saves it to a temporary file.

extract_info

Parses the saved HTML file to extract details like title, price, rating, and features, returning a structured dictionary.

Related MCP Servers

View all browser_automation servers →

Fetch

by modelcontextprotocol

A Model Context Protocol server that provides web content fetching capabilities, enabling LLMs to retrieve and process content from web pages.

browser_automation

fetcher-mcp

by jae-jae

Fetcher MCP is a server designed to fetch web page content using the Playwright headless browser.

browser_automation

mcp-local-rag

by nkapila6

mcp-local-rag is a primitive RAG-like web search model context protocol server that runs locally without the need for APIs.

research_and_data

playwright-mcp

by microsoft

Playwright MCP is a Model Context Protocol server that provides browser automation capabilities using Playwright, enabling LLMs to interact with web pages through structured accessibility snapshots.

browser_automation

browser-tools-mcp

by AgentDeskAI

BrowserTools MCP is a browser monitoring and interaction tool that enhances AI applications by capturing and analyzing browser data through a Chrome extension.

browser_automation

mcp-crawl4ai-rag

by coleam00

Crawl4AI RAG MCP Server is a powerful implementation of the Model Context Protocol (MCP) integrated with Crawl4AI and Supabase, providing AI agents and AI coding assistants with advanced web crawling and RAG capabilities.

browser_automation

mcp-server-weibo

by Selenium39

The Weibo MCP Server (TypeScript Version) is designed for scraping Weibo user information, feeds, and search functionality using the Model Context Protocol.

browser_automation

browser-use-mcp-server

by co-browser

An MCP server that enables AI agents to control web browsers using browser-use.

browser_automation

Notte Browser

by nottelabs

The Notte MCP Server is a Model Context Protocol server designed to manage sessions, run agents, and perform actions such as observing, scraping, and authenticating within the agentic ecosystem.

cloud_platforms

mcp-webresearch

by mzxrai

A Model Context Protocol (MCP) server for web research, enabling real-time information retrieval and research capabilities within the Claude Desktop app.

research_and_data

duckduckgo-mcp-server

by nickclyde

A Model Context Protocol (MCP) server that provides web search capabilities through DuckDuckGo, with additional features for content fetching and parsing.

browser_automation

google-search

by web-agent-master

A Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches and extract results.

browser_automation

moling

by gojue

MoLing is a dependency-free local office automation assistant that interacts with the system through operating system APIs, enabling file system operations and command execution.

search1api-mcp

by fatwang2

A Model Context Protocol (MCP) server that provides search and crawl functionality using Search1API.

browser_automation

Redbook-Search-Comment-MCP2.0

by chenningling

小红书自动搜索评论工具（MCP Server 2.0）是一个基于 Playwright 开发的自动化工具，旨在帮助用户自动登录小红书、搜索关键词、获取笔记内容及发布AI生成评论。

browser_automation

puppeteer-mcp-server

by merajmehrabi

The Puppeteer MCP Server provides browser automation capabilities using Puppeteer, enabling interaction with both new and existing Chrome browser instances.

browser_automation

g-search-mcp

by jae-jae

G-Search MCP is a powerful MCP server for Google search that enables parallel searching with multiple keywords simultaneously.

browser_automation

mcp-browser-use

by vinayak-mehta

mcp-browser-use is a protocol server that connects MCP clients with browsers using the browser-use library.

browser_automation

website-downloader

by pskill9

The Website Downloader MCP Server is designed to download entire websites using wget, preserving the website structure and converting links for local use.

browser_automation

mcp-ui

by machaojin1917939763

MCP聊天应用是一个基于Vue.js构建的现代化聊天界面，支持通过Model Context Protocol (MCP)与各种服务和工具进行交互。

playwright-mcp

by cloudflare

Cloudflare Playwright MCP integrates Playwright for automated browser testing with Cloudflare Workers.

browser_automation

mcp-server

by browserstack

BrowserStack MCP Server enables developers and testers to use BrowserStack's Test Platform directly from AI tools, facilitating manual and automated testing on real devices and browsers.

cloud_platforms

web-browser-mcp-server

by blazickjp

The Web Browser MCP Server allows AI models to browse and extract content from the web using the Message Control Protocol (MCP).

browser_automation

bing-search-mcp

by leehanchung

A Model Context Protocol (MCP) server for Microsoft Bing Search API integration, allowing AI assistants to perform web, news, and image searches.

browser_automation

browser-control-mcp

by eyalzh

An MCP server paired with a browser extension that enables AI agents to manage the user's local browser for research and information retrieval.

browser_automation

Sketch-Context-MCP

by jshmllr

A Model Context Protocol (MCP) server for integrating Sketch designs with IDEs such as Cursor, Cline, or Windsurf.

browser_automation

xhs-mcp-server

by aicu-icu

小红书MCP服务器是基于Electron和小红书Web API的开发工具，旨在提供快速、便捷的开发体验。

browser_automation