adityaarsharma

adityaarsharma / librecrawl-mcp

Public

Self-hosted SEO crawler for Claude — Screaming Frog-level audits, unlimited pages, 1-click install. 19 MCP tools.

ai-agent ai-seo core-web-vitals docker google-search-console
15
1
80% credibility
Found May 26, 2026 at 15 stars -- GitGems finds repos before they trend. Get early access to the next one.
Sign Up Free
AI Analysis
Python
AI Summary

LibreCrawl MCP is a self-hosted SEO auditing tool that gives AI assistants the ability to crawl websites, detect technical issues like broken links and missing meta tags, analyze page speed and structured data, and generate comprehensive Markdown reports with prioritized fix recommendations.

How It Works

1
🔍 You discover your site needs a checkup

You realize your website might have hidden problems — broken links, missing titles, or pages Google can't find.

2
💡 You learn about automated site auditing

You find a free tool that can crawl your entire website and find every SEO issue automatically.

3
⚡ You install everything with one click

You run one simple command and everything installs itself — the crawler, the AI connection, all set up on your own computer.

4
🔗 You connect it to your AI assistant

You tell your AI assistant about the new tool and it becomes part of your workflow, ready whenever you need it.

5
🚀 You ask for a full site audit

You simply ask your AI to 'audit my website' and it gets to work, checking hundreds of pages in the background.

📊 You get your complete SEO report

Your AI delivers a complete report showing every broken link, missing image text, slow page, and more — with a prioritized checklist of exactly what to fix first.

Sign up to see the full architecture

4 more

Sign Up Free

Star Growth

See how this repo grew from 15 to 15 stars Sign Up Free
Repurpose This Repo

Repurpose is a Pro feature

Generate ready-to-use prompts for X threads, LinkedIn posts, blog posts, YouTube scripts, and more -- with full repo context baked in.

Unlock Repurpose
AI-Generated Review

What is librecrawl-mcp?

LibreCrawl MCP is a self-hosted SEO crawler that wraps the LibreCrawl engine as an MCP server, giving AI agents like Claude, Cursor, and Windsurf the ability to run full technical site audits on demand. You ask your AI to "audit example.com" and it crawls the site, runs 37 SEO checks across 17 categories, and saves a Markdown report with a prioritised fix checklist. Python-based, runs in Docker, and keeps all data on your own machine.

Why is it gaining traction?

The hook is simple: Screaming Frog's free tier caps you at 500 pages and the paid version costs GBP 149 per year. This gives you unlimited crawls, Core Web Vitals, Schema.org validation, and GSC integration for zero cost. The 1-click install script handles Docker, PM2, and MCP registration automatically. It works with any MCP-compatible AI agent, so you're not locked into a single tool.

Who should use this?

Solo SEO consultants and small agencies who want automated audits without buying Screaming Frog. Developers building SEO tooling who need crawl data in their AI workflows. Anyone running self-hosted infrastructure who wants SEO checks without sending site data to third-party services.

Verdict

A clever idea with a polished install experience, but the 15-star count and single-developer authorship mean you're betting on a project that hasn't proven long-term maintenance. The 0.800000011920929% credibility score reflects this early-stage reality. Worth trying if you need the specific workflow it enables, but treat it as a personal tool rather than a production dependency.

Sign up to read the full AI review Sign Up Free

Similar repos coming soon.