anansi

mdowis/anansi

★ 1 stars Python 🌐 Browser/Web Updated 6d ago

A self-healing web scraper built for hostile sites: selectors repair themselves, browser rendering kicks in when needed, and Chrome TLS fingerprinting evades bot detection. Ships with an MCP server so any LLM can drive a full crawl through conversation.

View on GitHub →

Quick Install

Copy the config for your editor. Some servers may need additional setup — check the README.

Add to claude_desktop_config.json:

{
  "mcpServers": {
    "anansi": {
      "command": "uvx",
      "args": [
        "anansi"
      ]
    }
  }
}

Or install with pip: pip install anansi

README Excerpt

<img src="https://repository-images.githubusercontent.com/1238896536/d711cc76-8358-4a4a-9160-341131498877"> > *The spider that learns.* Every web scraper starts working. The question is how long before it breaks. **Anansi is built on a different assumption: the web is adversarial and unstable, and your scraper should handle that without your involvement.**

Tools (20)

Scraperactionschunk_indexchunk_sizeclickcrawl_metricscrawl_siteexport_crawlextractfetch_and_extractfetch_urlfetch_urlsfillformatget_crawl_itemslist_crawlspause_crawlpressproxyresume_crawl

Topics

adaptive-scrapingai-agentanti-botcrawlerdata-extractionllm-toolsmcpmcp-serverpydanticpythonself-healingstealth-browsertls-fingerprintweb-scraperweb-scraping

anansi

Quick Install

README Excerpt

Tools (20)

Topics

Related Browser/Web Servers