PLA-yi

PLA-yi / social-media-scraper

Public

Unified web dashboard for scraping Douyin, TikTok, Reddit, X and YouTube — FastAPI + Vue 3, real-time SSE logs, AI chat analysis

12
3
69% credibility
Found Feb 28, 2026 at 11 stars -- GitGems finds repos before they trend. Get early access to the next one.
Sign Up Free
AI Analysis
Python
AI Summary

A browser-based dashboard for collecting videos, posts, and comments from Douyin, TikTok, Reddit, X (Twitter), and YouTube platforms, featuring real-time monitoring, download options, and AI-powered comment analysis.

How It Works

1
📰 Discover the tool

You find a handy web dashboard online that collects posts, videos, and comments from popular social apps like TikTok, YouTube, and Twitter.

2
📥 Get it ready

Download the files to your computer and prepare it with a few simple steps so everything works smoothly.

3
🚀 Launch the dashboard

Start the tool and open your browser to see the friendly control panel.

4
Pick your search
🔎
Keyword hunt

Enter words or topics to find matching videos and posts.

👤
Profile scoop

Paste a username or channel link to grab their recent content.

5
⚡ Watch the magic

Hit start and see posts and comments pouring in real-time, with pause if needed.

6
🤖 Chat with your data

Load your collected comments and ask an AI smart questions for quick insights.

🎉 Treasure found

Browse your neatly saved files with videos, comments, and analysis – ready for whatever you need!

Sign up to see the full architecture

5 more

Sign Up Free

Star Growth

See how this repo grew from 11 to 12 stars Sign Up Free
Repurpose This Repo

Repurpose is a Pro feature

Generate ready-to-use prompts for X threads, LinkedIn posts, blog posts, YouTube scripts, and more -- with full repo context baked in.

Unlock Repurpose
AI-Generated Review

What is social-media-scraper?

This Python project delivers a unified web dashboard for scraping posts, videos, and comments from Douyin, TikTok, Reddit, X, and YouTube—all from one browser interface built with FastAPI and Vue 3. It handles keyword searches or profile/channel feeds, outputs structured JSON/CSV data, and streams real-time logs via SSE for monitoring runs without refreshes. Developers get a social media scraper git repo that centralizes access, skipping fragmented CLIs or APIs.

Why is it gaining traction?

The unified web interface stands out by bundling five platforms into a single control panel with pause/resume controls, fast mode for 3x quicker keyword scrapes on Douyin/TikTok, and built-in AI chat analysis on comment datasets using providers like Moonshot or OpenRouter. Real-time SSE logs and one-click data cleanup beat juggling separate tools, while manual login flows make it reliable against captchas. It's a practical social media ai scraper and comment scraper that just works for bulk pulls.

Who should use this?

Social media analysts scraping comments for sentiment trends, marketers tracking competitor posts across platforms, or researchers building datasets from YouTube channels and Reddit subs. Ideal for data engineers needing unified web access to feeds without OAuth hassles, or indie devs prototyping social media post scrapers. Skip if you're after enterprise-scale with official APIs.

Verdict

Grab it for quick social media data pulls—the unified web server shines for prototyping, despite 10 stars signaling early maturity and a 0.699999988079071% credibility score from sparse tests/docs. Solid Apache 2.0 license; watch for anti-scrape blocks on heavy use.

(198 words)

Sign up to read the full AI review Sign Up Free

Similar repos coming soon.