thunderbit-open

thunderbit-open / thunderbit-mcp-server

Public

AI-powered web scraping and structured data extraction. CLI + MCP server + Claude Code plugin for the Thunderbit Open API.

thunderbit.comopen-api ai-agents claude data-extraction llm markdown
12
2
100% credibility
Found May 07, 2026 at 12 stars -- GitGems finds repos before they trend. Get early access to the next one.
Sign Up Free
AI Analysis
JavaScript
AI Summary

An open-source monorepo offering command-line tools, an AI assistant server, and a plugin for distilling web pages to clean Markdown and extracting structured data via Thunderbit's service.

How It Works

1
🔍 Discover Thunderbit tools

You hear about handy helpers that grab clean content and organized info from any website for your projects or AI chats.

2
🆓 Get free starter access

Visit thunderbit.com/open-api to sign up quickly and get your free pass to start pulling web info.

3
Pick your way to use it
💻
Run it yourself

Set up the standalone tool to process sites directly.

🤖
Link to AI chat

Hook it up to your AI assistant so it handles web tasks automatically.

4
🌐 Turn pages into gold

Hand over a website link, and watch it transform messy pages into neat text or neatly sorted details exactly as needed.

5
📈 Tackle lots at once

Line up a bunch of websites to process together, saving time on big lists.

🎉 Ready-to-use info

Celebrate having spotless, structured web content perfect for reading, analyzing, or feeding to your AI!

Sign up to see the full architecture

4 more

Sign Up Free

Star Growth

See how this repo grew from 12 to 12 stars Sign Up Free
Repurpose This Repo

Repurpose is a Pro feature

Generate ready-to-use prompts for X threads, LinkedIn posts, blog posts, YouTube scripts, and more -- with full repo context baked in.

Unlock Repurpose
AI-Generated Review

What is thunderbit-mcp-server?

Thunderbit-mcp-server is a JavaScript monorepo delivering AI-powered web scraping via the Thunderbit Open API, turning messy web pages into clean Markdown or structured JSON. Developers get a CLI for distilling single pages, extracting data with JSON schemas, AI-suggesting fields, and batching up to 100 URLs; an MCP server for Claude Desktop, Cursor, or any MCP client; plus a Claude Code plugin with natural-language skills. It tackles dynamic sites with rendering modes and geo-targeting, no custom browser code needed.

Why is it gaining traction?

MCP protocol integration lets AI assistants like Claude call scraping tools directly in chats, unlike standalone scrapers requiring API glue. AI field suggestion and batch polling streamline workflows for ai powered web scraping, beating Puppeteer fragility on JS-heavy pages. Free API keys and 1-credit distill jobs hook devs testing ai powered projects github style.

Who should use this?

Backend devs scraping e-commerce for price monitoring or datasets; AI builders piping web content into RAG via Markdown; researchers batch-distilling news/HN for analysis. Ideal for CLI automation in scripts/CI or Cursor users extracting during ai powered development.

Verdict

Solid pick for MCP-enabled ai powered web scrapers—install via npm, set API key, done. With 12 stars and 1.0% credibility, it's immature but docs shine and MIT license invites forks; scale lightly until stars climb.

(198 words)

Sign up to read the full AI review Sign Up Free

Similar repos coming soon.