anaisbetts

anaisbetts / mcp-computer-use

Public

An MCP server that implements OpenAI CUA for Desktop

12
2
100% credibility
Found Apr 24, 2026 at 12 stars -- GitGems finds repos before they trend. Get early access to the next one.
Sign Up Free
AI Analysis
Rust
AI Summary

This repository implements a helper server that allows AI assistants to capture screenshots and simulate mouse clicks, keyboard typing, and drags on the user's local desktop across Windows, macOS, and Linux.

How It Works

1
🔍 Discover AI desktop helper

You hear about a handy tool that lets your smart AI assistant see your screen and move your mouse or type for you.

2
📥 Get the helper ready

Download the simple program and place it where your AI app can find it, like adding a new gadget to your setup.

3
🔐 Allow safe access

In your computer's settings, give permission for screen viewing and input control, just like trusting a helpful friend.

4
🚀 Start your AI assistant

Open your favorite AI app, and it automatically connects to the helper to gain desktop powers.

5
🖱️ See AI take control

Your AI grabs a picture of your screen, clicks buttons, scrolls, or types exactly where needed – watching it work feels magical.

✨ Tasks done effortlessly

Now your AI handles boring computer chores for you, saving time and making work smoother every day.

Sign up to see the full architecture

4 more

Sign Up Free

Star Growth

See how this repo grew from 12 to 12 stars Sign Up Free
Repurpose This Repo

Repurpose is a Pro feature

Generate ready-to-use prompts for X threads, LinkedIn posts, blog posts, YouTube scripts, and more -- with full repo context baked in.

Unlock Repurpose
AI-Generated Review

What is mcp-computer-use?

This Rust-built MCP computer use server turns your desktop into an AI-controllable playground, implementing OpenAI's Computer Use tool for mouse clicks, drags, typing, keypresses, scrolls, waits, and screenshots. It speaks JSON-RPC over stdio, feeding back scaled screenshots with coordinate remaps so models hit the right spots on Windows, macOS computer use MCP, or Linux Wayland. Launch via cargo build --release and flags like --split for per-action tools or --max-image-dimension=900.

Why is it gaining traction?

Dead-on match to OpenAI CUA schema means Claude Desktop computer use MCP or other agents work without tweaks, unlike shimmable alternatives. Smart downscaling keeps images model-friendly while remapping clicks precisely, and dual modes suit batched prompts or fine-grained permissions. Cross-platform from mcp computer use Windows to macOS, with file-based screenshots via --images-as-files.

Who should use this?

MCP agent devs wiring LLMs to automate local UIs, like testing apps in Cursor or Claude Desktop. Frontend teams bypassing mocks for real browser control in mcp github copilot vscode workflows. Experimenters building mcp computer use claude agents on macOS or Windows needing reliable screen grabs and inputs.

Verdict

Promising mcp computer use github entry with thorough docs and tests, but 12 stars and 1.0% credibility signal early days—expect tweaks for edge cases. Grab it from mcp github server list if desktop AI control fits; grant Accessibility/Screen Recording perms and prototype fast.

(198 words)

Sign up to read the full AI review Sign Up Free

Similar repos coming soon.