Modular web scraper with Clean Architecture — wreq TLS fingerprinting, RAG export, MCP server, TUI, AI semantic cleaning. 1,337 tests, Miri verified.
View on GitHub →
🔍 Audit Wallet Slippage →
Quick Install
Copy the config for your editor. Some servers may need additional setup — check the README.
Add to claude_desktop_config.json:
{
"mcpServers": {
"rust_scraper": {
"command": "cargo",
"args": [
"run",
"--",
"rust_scraper"
]
}
}
}
Run in terminal:
claude mcp add rust_scraper cargo run -- rust_scraper
Add to .cursor/mcp.json:
{
"mcpServers": {
"rust_scraper": {
"command": "cargo",
"args": [
"run",
"--",
"rust_scraper"
]
}
}
}
README Excerpt
**Web scraper de alto rendimiento con arquitectura modular para datasets RAG, crawling inteligente y exportación multi-formato.** --- ```bash git clone https://github.com/XaviCode1000/rust_scraper.git cd rust_scraper cargo install --path crates/rust_scraper_cli rust_scraper --url https://example.com rust_scraper --url https://example.com --use-sitemap --max-pages 50
Tools (10)
consoledefaultmcpotelpersistencerust_scraper_airust_scraper_clirust_scraper_corerust_scraper_mcprust_scraper_tui
Topics
clean-architecturemcpragrusttuiweb-scraping