MCP server for web scraping. Supports ChatGPT conversations and X/Twitter posts via extensible plugin architecture. Multiple scraping methods: Playwright, Apify, requests.
Quick Install
Copy the config for your editor. Some servers may need additional setup — check the README.
Claude Desktop
Claude Code
Cursor
Add to claude_desktop_config.json:
{
"mcpServers": {
"mcp-server-web-scrap": {
"command": "uvx",
"args": [
"mcp-server-web-scraper"
]
}
}
}
📋 Copy
Run in terminal:
claude mcp add mcp-server-web-scrap uvx mcp-server-web-scraper
📋 Copy
Add to .cursor/mcp.json:
{
"mcpServers": {
"mcp-server-web-scrap": {
"command": "uvx",
"args": [
"mcp-server-web-scraper"
]
}
}
}
📋 Copy
Or install with pip: pip install mcp-server-web-scraper