crawlie

Galllodgement343/crawlie

★ 0 stars Rust Search Updated today

Scan websites for technical SEO and GEO issues using this local crawler, CLI tool, and MCP server.

View on GitHub → Try with Claude — $10 free →

Quick Install

Copy the config for your editor. Some servers may need additional setup — check the README.

Add to claude_desktop_config.json:

{
  "mcpServers": {
    "crawlie": {
      "command": "cargo",
      "args": [
        "run",
        "--",
        "crawlie"
      ]
    }
  }
}

README Excerpt

Crawlie maps websites and pages to help you improve search rankings and manage your online information. The software crawls through links to provide a clear view of your site structure. It works for both local business needs and large scale search engine optimization tasks. Your computer must meet these basic standards to run the software smoothly.

Topics

aeobeautifulsoupcrawlerelixirelixir-librarygenstagegeomarketing-toolsmcppythonrequestsseleniumseotkinter-gui

crawlie

Quick Install

README Excerpt

Topics

Related Search Servers