umutc/scrapedo-mcp-server
If you are the rightful owner of scrapedo-mcp-server and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcphub.com.
Scrapedo MCP Server is a comprehensive Model Context Protocol server designed for advanced web scraping operations.
Scrapedo MCP Server
Enable Claude Desktop to scrape websites using the Scrapedo API. Simple setup, powerful features.
What is this?
This is an MCP (Model Context Protocol) server that gives Claude Desktop the ability to:
- Scrape any website (with or without JavaScript)
- Take screenshots
- Use proxies from different countries
- Convert web pages to markdown
Quick Start (2 minutes)
1. Get your Scrapedo API key
Sign up at scrape.do to get your free API key.
2. Setup Claude Desktop
Run this command:
npx scrapedo-mcp-server init
That's it! The tool will automatically configure Claude Desktop for you.
3. Start using it in Claude
Just ask Claude to scrape any website:
"Can you scrape the latest news from https://example.com?"
"Take a screenshot of the Google homepage"
"Get the product prices from this e-commerce site using a US proxy"
Manual Installation Options
Install globally with npm
npm install -g scrapedo-mcp-server
scrapedo-mcp init
Install from source
git clone https://github.com/umutc/scrapedo-mcp-server.git
cd scrapedo-mcp-server
npm install
npm run build
Manual Claude Desktop configuration
Add to ~/Library/Application Support/Claude/claude_desktop_config.json
:
{
"mcpServers": {
"scrapedo": {
"command": "npx",
"args": ["scrapedo-mcp-server", "start"],
"env": {
"SCRAPEDO_API_KEY": "your_api_key_here"
}
}
}
}
What Can It Do?
Basic Web Scraping
// Claude can now do this:
scrape("https://example.com")
JavaScript-Rendered Pages
// For modern SPAs and dynamic content:
scrape_with_js("https://app.example.com", {
waitSelector: ".content-loaded"
})
Screenshots
// Capture any webpage:
take_screenshot("https://example.com", {
fullPage: true
})
Use Proxies
// Scrape from different locations:
scrape_with_proxy("https://example.com", {
geoCode: "us" // Use US proxy
})
Convert to Markdown
// Get clean, readable content:
scrape_to_markdown("https://blog.example.com/article")
Project Structure
scrapedo-mcp-server/
āāā src/ # TypeScript source code
ā āāā index.ts # MCP server entry point
ā āāā cli.ts # CLI tool for setup
ā āāā tools/ # Scraping tool implementations
āāā dist/ # Compiled JavaScript (generated)
āāā package.json # Project configuration
āāā README.md # You are here
API Costs
Scrapedo uses a credit system:
- Basic scraping: 1 credit
- JavaScript rendering: 5 credits
- Residential proxy: 10 credits
- Residential + JS: 25 credits
Check your usage anytime by asking Claude: "Check my Scrapedo usage stats"
Common Use Cases
- Price Monitoring: Track product prices across e-commerce sites
- News Aggregation: Collect articles from multiple sources
- Data Research: Gather public information for analysis
- Content Migration: Export content from websites
- SEO Analysis: Check how pages render for search engines
- Competitive Analysis: Monitor competitor websites
FAQ
Q: Do I need to install anything?
A: Just Node.js 18+. Everything else is handled by npx.
Q: How do I update?
A: Run npx scrapedo-mcp-server@latest init
to get the newest version.
Q: Is this free?
A: The MCP server is free. Scrapedo offers a free tier with limited credits.
Q: Can I use this with other MCP clients?
A: Yes! This works with any MCP-compatible client, not just Claude Desktop.
Q: How do I see debug logs?
A: Set LOG_LEVEL=DEBUG
in your environment or configuration.
Troubleshooting
Issue | Solution |
---|---|
"Tool not found" | Restart Claude Desktop |
"401 Unauthorized" | Check your API key is correct |
"Insufficient credits" | Check usage with get_usage_stats |
"Empty response" | The site might need JavaScript rendering |
Need Help?
- š
- š¬ Report Issues
- š§ Scrapedo Support
Contributing
We welcome contributions! See for guidelines.
License
MIT - See file
Built with ā¤ļø to make web scraping easy in Claude Desktop