jsmonhq

jsmonhq / xnew

Public

xnew is a fast, low-memory CLI that appends only unique lines to files. Built in Go for large datasets, it streams input efficiently and scales cleanly from thousands to hundreds of millions of lines.

jsmon.sh bugbounty cli cybersecurity data-analysis data-processing
15
2
100% credibility
Found Apr 17, 2026 at 15 stars -- GitGems finds repos before they trend. Get early access to the next one.
Sign Up Free
AI Analysis
Go
AI Summary

xnew is a tool that adds only new, unique lines from your input to a large existing text file quickly and with very little memory use.

How It Works

1
🔍 Discover xnew

You find xnew while searching for a quick way to add fresh lines to your huge list without any repeats or slowdowns.

2
💻 Get xnew ready

You easily add xnew to your computer so it's all set to handle your big files.

3
📁 Prepare your lists

Gather your large existing file full of lines and the new lines you want to include.

4
⚡ Add only new lines

Feed your new lines into xnew with your big file, and it magically appends just the unique ones super fast, even for millions of lines.

5
🔧 Choose how to save

Decide to update the original file, create a new one, trim extra spaces, or work quietly without extra chatter.

🎉 Perfect big list

Your massive file is now updated with only fresh unique lines, feeling lightning-quick and effortless.

Sign up to see the full architecture

4 more

Sign Up Free

Star Growth

See how this repo grew from 15 to 15 stars Sign Up Free
Repurpose This Repo

Repurpose is a Pro feature

Generate ready-to-use prompts for X threads, LinkedIn posts, blog posts, YouTube scripts, and more -- with full repo context baked in.

Unlock Repurpose
AI-Generated Review

What is xnew?

xnew is a Go-built CLI that reads lines from stdin and appends only unique ones to a target file, skipping duplicates. It solves the pain of growing massive text files—like logs or datasets with hundreds of millions of lines—without bloating memory or slowing down. Pipe in new data via cat new.txt | xnew existing.txt to efficiently keep files clean, with options to output separately (-o), trim spaces (-trim), or run quiet (-q).

Why is it gaining traction?

It crushes alternatives like anew on speed for large files, clocking 3-4x faster appends on 100M-line tests while using minimal RAM. Developers dig the streaming approach that scales cleanly from thousands to hundreds of millions of lines, making it a go-to for fast, low-overhead deduping. Built in Go, it delivers snappy performance without the bloat of scripting tools.

Who should use this?

Data engineers processing append-only logs or news feeds from sources like news berlin, news5 live, or xnews aggregators. DevOps teams balancing datasets, such as new balance inventories or new balance 530 stock lists, where duplicates kill efficiency. Anyone near news in der nähe scraping or ETL pipelines needing quick, unique appends to files.

Verdict

Grab it if you handle big text streams—installs easily via go install and docs cover usage cleanly—but with just 15 stars and 1.0% credibility score, it's early days; test on your datasets first before production. Solid benchmarks make it worth a spin for Go fans.

(178 words)

Sign up to read the full AI review Sign Up Free

Similar repos coming soon.