yazinsai

yazinsai / site-md

Public

Serve clean Markdown from your Next.js site to AI agents, crawlers, and LLMs. Humans get HTML, agents get clean Markdown of the same pages. Two-file install.

www.npmjs.compackagesite-md ai-agents content-negotiation crawler llm llms-txt
10
1
100% credibility
Found Apr 21, 2026 at 10 stars -- GitGems finds repos before they trend. Get early access to the next one.
Sign Up Free
AI Analysis
TypeScript
AI Summary

site-md adds clean Markdown versions of Next.js site pages specifically for AI agents and crawlers, while serving HTML to human visitors.

How It Works

1
👀 Discover site-md

You hear about a simple way to make your website easy for AI assistants to read without messy code.

2
🪄 Start the easy setup

Run one quick command in your project folder and it scans everything automatically.

3
💬 Share your site details

Answer two friendly questions about your site's name and a short welcome note for visitors.

4
📋 See the smart plan

It shows exactly what it will add or update, keeping all your existing work safe.

5
✅ Give the go-ahead

Click yes, and it gently weaves in the changes without breaking anything.

6
🔄 Restart your preview

Refresh your local site preview, and everything is ready to go.

🎉 AI visitors love it!

Now smart agents get clean, simple text versions of your pages while people see the pretty design.

Sign up to see the full architecture

5 more

Sign Up Free

Star Growth

See how this repo grew from 10 to 10 stars Sign Up Free
Repurpose This Repo

Repurpose is a Pro feature

Generate ready-to-use prompts for X threads, LinkedIn posts, blog posts, YouTube scripts, and more -- with full repo context baked in.

Unlock Repurpose
AI-Generated Review

What is site-md?

site-md is a TypeScript middleware for Next.js App Router sites that serves clean Markdown versions of your pages to AI agents, crawlers, and LLMs while humans get standard HTML. Run `npx site-md` for a two-file install that auto-detects bots via User-Agent or Accept headers, handles paths like `/docs.md` or `?format=md`, and publishes `/llms.txt` as a site index—think github serve static files but optimized for AI readability, like a cleaner service stripping HTML cruft. No rewrites or duplicate content needed.

Why is it gaining traction?

Its one-command CLI merges into existing middleware and next.config without breaking your setup, plus configurable bot policies (block training scrapers, passthrough admin paths) and extras like `/llms-full.txt` for full-site Markdown dumps. Developers love the zero-config defaults for common bots (GPTBot, ClaudeBot) and caching, making sites instantly AI-ready without ng serve clean cache hassles or manual github serve html tweaks—beats docling serve github alternatives by integrating seamlessly with Next.js.

Who should use this?

Next.js maintainers of docs sites, blogs, or public APIs who want AI agents to consume content without HTML parsing breakage. Ideal for indie hackers building github serve website tools or serve cleaning company landing pages, especially if you're tired of fragmented LLM indexes or need site md bethpage-style clean outputs for crawlers like kiwix serve github.

Verdict

Grab it if you're on Next.js 15+ and want quick AI optimization—solid docs and tests make setup reliable despite 10 stars and 1.0% credibility score signaling early maturity. Skip for production without monitoring bot traffic first.

(198 words)

Sign up to read the full AI review Sign Up Free

Similar repos coming soon.