FayAndXan

FayAndXan / spectrawl

Public

The unified web layer for AI agents. Search (8 engines), stealth browse, auth, and act on 24 platforms. One npm install, self-hosted.

www.npmjs.compackagespectrawl ai-agents browser-automation mcp mcp-server model-context-protocol
16
3
100% credibility
Found Mar 11, 2026 at 10 stars -- GitGems finds repos before they trend. Get early access to the next one.
Sign Up Free
AI Analysis
JavaScript
AI Summary

Spectrawl is a self-hosted toolkit that allows AI agents to perform web searches, stealth browsing, content crawling, authentication management, and automated posting across 19 platforms.

How It Works

1
🌐 Discover Spectrawl

You hear about Spectrawl, a simple tool that lets your AI helper search the web, read pages, and share on social sites without hassle.

2
📥 Get it ready

Download and set up Spectrawl on your computer with one easy step – no complicated setup needed.

3
🔗 Connect free search

Link a free AI search service so Spectrawl can find great web info instantly.

4
🔍 Your first deep search

Type a question and watch Spectrawl pull full web pages, summaries, and trusted sources right to you.

5
🕵️ Browse and share safely

Sneak onto any site to read content or post updates to places like Reddit, Twitter, or GitHub using saved logins.

6
Pick your way to use
💻
Personal mode

Run searches and posts right from your scripts whenever you need.

🌍
Share mode

Start a simple web service so multiple AI helpers can use it together.

🚀 AI web powers unlocked

Now your AI can explore the internet, gather real info, and connect with the world – all running safely on your own setup.

Sign up to see the full architecture

5 more

Sign Up Free

Star Growth

See how this repo grew from 10 to 16 stars Sign Up Free
Repurpose This Repo

Repurpose is a Pro feature

Generate ready-to-use prompts for X threads, LinkedIn posts, blog posts, YouTube scripts, and more -- with full repo context baked in.

Unlock Repurpose
AI-Generated Review

What is spectrawl?

Spectrawl is a self-hosted JavaScript package that gives AI agents unified web access: search across 8 engines (including free Gemini Grounded with 5,000 queries/month), stealth browsing, site crawling, auth management, and actions on 24 platforms like GitHub, Reddit, and X. One npm install replaces stitching Playwright, search APIs, and platform scripts into a single web layer with CLI, HTTP API, and MCP server support. Developers get full page content, not snippets, for agent reasoning.

Why is it gaining traction?

It stands out with self-hosted stealth (Camoufox/Playwright) that bypasses bot detection where Tavily fails, plus built-in posting to GitHub unified repos, Reddit, Dev.to, and more—no extra deps. Free tier crushes Tavily's limits, cached repeats hit <1ms, and source ranking boosts GitHub/docs while penalizing spam. The unified web client license (MIT) and one-command setup hook devs tired of API key sprawl.

Who should use this?

AI agent builders integrating web tools into LangChain/Claude/Cursor workflows, especially for autonomous content engines needing GitHub unified planning or multi-platform acts. Indie hackers launching on Product Hunt/IndieHackers/HN via adapters. Node.js devs wanting a unified web server for stealth scraping behind logins without vendor lock-in.

Verdict

Early alpha (10 stars, 1.0% credibility) with solid README but light tests—prototype for non-prod agents. Grab it if you need self-hosted unified webui now; watch for stability as xanOS ecosystem grows.

(187 words)

Sign up to read the full AI review Sign Up Free

Similar repos coming soon.