3spky5u-oss

3spky5u-oss / HandsOn

Public

Give Claude eyes and hands. Screen capture and desktop automation plugin for Claude Code.

27
0
100% credibility
Found Feb 23, 2026 at 25 stars -- GitGems finds repos before they trend. Get early access to the next one.
Sign Up Free
AI Analysis
Python
AI Summary

HandsOn is a plugin for Claude Code that provides screen capture, UI element detection, and desktop automation tools to let AI visually verify and interact with applications.

How It Works

1
💡 Discover HandsOn

While building apps with your AI coding helper Claude, you learn about HandsOn, a handy add-on that lets it see and interact with screens.

2
📦 Add the Plugin

You simply tell Claude to add HandsOn from its plugin store, and it handles the rest automatically.

3
🔄 Restart and Grant Access

Restart Claude, and on first use, allow screen viewing and control permissions so it can help with your desktop.

4
🖥️ Check Your App Visually

Ask Claude to open your app, take a picture of the screen, spot any layout glitches, and fix them right away – no more describing problems!

5
🖱️ Automate Tasks

Guide Claude to click buttons, fill forms, or navigate old apps using smart text finding and mouse control.

✅ Perfect Results

Your app looks flawless, tasks are done effortlessly, and Claude handles the visuals like a pro teammate.

Sign up to see the full architecture

4 more

Sign Up Free

Star Growth

See how this repo grew from 25 to 27 stars Sign Up Free
Repurpose This Repo

Repurpose is a Pro feature

Generate ready-to-use prompts for X threads, LinkedIn posts, blog posts, YouTube scripts, and more -- with full repo context baked in.

Unlock Repurpose
AI-Generated Review

What is HandsOn?

HandsOn is a Python plugin for Claude Code that equips Claude with screen capture and desktop automation capabilities on Windows and macOS. It lets Claude inspect UIs it builds, click through apps, fill forms, and automate legacy software lacking APIs—closing the gap between code generation and real-world verification. Install via the Claude marketplace, then prompt Claude to "review our UI work visually" or "open localhost:3000 and test the login."

Why is it gaining traction?

Unlike basic pyautogui wrappers, HandsOn prioritizes accessibility trees for precise, DPI-aware targeting, falling back to OCR and framework detection (Qt, WPF, Electron) when needed. Developers love the seamless loop: Claude builds a UI, screenshots it, spots misalignments, and iterates without manual descriptions. With 28 tools like smart_find and batch_actions, it slashes round-trips for give Claude access to browser or give Claude access to local files workflows.

Who should use this?

Frontend devs using Claude Code to prototype React/Vue apps who hate describing visual bugs. QA engineers automating end-to-end tests on Electron or WinForms apps without Selenium. Ops folks scripting desktop tasks like "give Claude sudo" for UAC handling or give Claude access to GitHub private repos via browser flows—perfect for hands-on LLM experimentation akin to github handson ml setups.

Verdict

Grab it if you're deep in Claude Code and need desktop eyes/hands—docs are solid, install is painless despite alpha quirks like occasional misclicks. At 18 stars and 1.0% credibility, it's early; test on non-critical tasks until maturity improves.

(198 words)

Sign up to read the full AI review Sign Up Free

Similar repos coming soon.