novynlabs-repo

novynlabs-repo / Jarvey

Public

A macOS open-source computer use assistant control plane and interface

agents ai-agent computer-use desktop-automation gpt
12
2
100% credibility
Found Mar 09, 2026 at 10 stars -- GitGems finds repos before they trend. Get early access to the next one.
Sign Up Free
AI Analysis
Swift
AI Summary

Jarvey is a native macOS app that lets users control their desktop with voice commands using AI to plan and execute actions like opening apps, navigating interfaces, and running commands.

How It Works

1
🖥️ Discover Jarvey

You find Jarvey, a friendly voice helper for your Mac that listens to your words and takes action on your desktop.

2
📥 Download and Launch

Grab the ready app from releases, unzip, and open it – it guides you gently from the first screen.

3
🔑 Quick Setup

Connect your AI brain, allow mic and screen access, and pick a simple hotkey like Option+Space – it feels safe and straightforward.

4
🗣️ Press and Speak

Hold your hotkey, talk naturally like 'open my notes and add a reminder', and release to send.

5
✨ Watch It Work

Jarvey thinks, asks if needed, then clicks, types, and handles your task across apps – it's like having a smart helper.

✅ Tasks Done Effortlessly

Your Mac now responds to voice for everyday chores, saving time and feeling magical every time.

Sign up to see the full architecture

4 more

Sign Up Free

Star Growth

See how this repo grew from 10 to 12 stars Sign Up Free
Repurpose This Repo

Repurpose is a Pro feature

Generate ready-to-use prompts for X threads, LinkedIn posts, blog posts, YouTube scripts, and more -- with full repo context baked in.

Unlock Repurpose
AI-Generated Review

What is Jarvey?

Jarvey is a voice-first macOS agent that lets you talk to your computer via a global hotkey like Option+Space—it listens with OpenAI Realtime, plans using GPT models, and acts on your desktop by opening apps, filling forms, navigating UIs, or managing files. Built in Swift for a native overlay app with a local Node sidecar, it handles screenshots, mouse clicks, typing, and scrolling while storing durable memory locally. Think Harvey Specter negotiating your Mac's chaos, or a Jarvey from Harry Potter sneaking through your apps—hands-free control for everyday desktop drudgery.

Why is it gaining traction?

Unlike clunky macOS GitHub Desktop clients or basic clipboard managers, Jarvey delivers real-time voice interaction with intelligent multi-step planning, permission-guided onboarding, and approval gates for risky actions. Developers dig the self-contained releases (ad-hoc signed zips), easy builds via npm run dev, and privacy focus—no telemetry, all local except OpenAI calls. It's a fresh take on macOS open source apps, bridging voice AI with native GUI control better than fragmented GitHub CLI runners or SSH key tools.

Who should use this?

Mac power users juggling apps and tabs, like designers voice-commanding Figma edits or devs scripting browser tests without lifting hands. Suited for remote workers tired of alt-tabbing through GitHub runners, or anyone experimenting with computer-use agents on Sonoma+. Skip if you're not granting Accessibility/Screen Recording perms.

Verdict

Promising early experiment for macOS open source fans, but 10 stars and 1.0% credibility signal alpha maturity—docs are solid, tests exist, but expect bugs in voice bridging. Download the release zip and test on a throwaway account; worth watching as voice agents mature.

(198 words)

Sign up to read the full AI review Sign Up Free

Similar repos coming soon.