Hands-Rust MCP/CLI that sees the Windows desktop and clicks real Chrome
Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.
Want to reach these readers? Sponsor an issue.
I built Hands because I wanted a coding agent to use this Windows PC and a real Chrome profile the way I do: look at the screen, move the real mouse, type, click , without turning Chrome into an automation browser.It is a Rust MCP/CLI. A harness (Grok, Codex, Claude Code, OpenCode, etc.) calls tools like observe, click, type, scroll. Observe is a screenshot path plus a small element list (UIA + optional Chrome DOM ids). Click is OS SendInput on a Bézier path, not a Chrome DevTools click.There is no Playwright, no Puppeteer, no remote debugging port. Daily Chrome is launched with no extra flags, or attached if it’s already open. Sites that key on CDP/automation flags mostly don’t see that. They can still see injected input (LLMHF_INJECTED).A tiny unpacked Chrome extension can fuse page structure (chr: ids, listing cards) so the model isn’t guessing from pixels. Sideload is manual. Fusion dies if the service worker goes inactive; reload the card.What it is good for: personal research on your own desk. “Find a Camry on cars.com,” read a page, fill a ZIP, dismiss a cookie banner.What it is not: • Not a sandbox. It can click whatever is on screen, including checkout and Easy Apply. • Confirm-before-money is best-effort classification in the binary, not a guarantee. Prompt injection from the screenshot/DOM is real; the binary treats that text as untrusted, the model might not. • Not a CAPTCHA solver on daily Chrome. Two visible tries, then it yields and waits for the puzzle to go away. • Windows only. • Install is: build the exe, register a native-messaging host, sideload the extension, point an MCP client at hands mcp. README is the runbook. Missing an API key does not fail the build; do_task is optional. • Logs live under %LOCALAPPDATA%\hands\logs\. The extension asks for <all_urls> so it can map the tab you’re looking at.Repo: https://github.com/Ryan-AI-Studios/hands (MIT)Happy to answer how observe/fusion/the fence work. If you try it, Pause/Break is the kill switch.
HN · launched Aug 23, 2026 · 5 upvotes (top 87%) · 0 views
Niche: computer and browser automation agents · 127 launches, 0 in the last 7 days ▼ -100% · Explore this niche →
Category and tags
- Horizontal
- Agent / copilot
- Developer
- AI-native
- Commercial product
More like this: all 127 launches in computer and browser automation agents →
Could you build this?
Partial While an MCP server wrapper is straightforward, reliable cross-window OS-level screen capture and low-level mouse/keyboard interaction on Windows require low-level OS automation hooks.
What it would actually take: The architecture requires an MCP protocol server in Rust interacting with Windows Win32 APIs (SendInput, Desktop Duplication API, or Graphics.Capture). The hard part is managing DPI scaling, elevated permissions, anti-cheat/antivirus interference, and accurate multi-monitor coordinate translation without UI test harnesses. It requires systems programming expertise in Windows desktop APIs and OS security boundaries.
Discussion
2 comments analyzed.
Feature requests: recording or visual walkthrough
Competitors
Other products that read as similar to this one : 144 launches clear the similarity bar, closest 8 shown.
Attention rank: #131 of 145 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).
Launched 284 days after the earliest competitor.
- Browser Hands · ph · 2026-11-13 · 1 upvotes · similarity 0.48
- easi.run · ph · 2026-11-03 · 2 upvotes · similarity 0.44
- Webmcp-react · hn · 2026-03-05 · 5 upvotes · similarity 0.44
- KittyBrowser, I built a web browser in your terminal · hn · 2026-11-13 · 7 upvotes · similarity 0.43
- Webctl · hn · 2026-01-14 · 134 upvotes · similarity 0.41
- CH-UI v2 · hn · 2026-02-20 · 9 upvotes · similarity 0.41
- Codex CLI compiled to WASM running in the browser · hn · 2026-08-19 · 5 upvotes · similarity 0.41
- Model Tools Protocol (MTP) · hn · 2026-02-10 · 9 upvotes · similarity 0.40
The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.