I'm 15, built an AI that watches your screen and acts before you ask
Details
- External ID
- 48561017
- Source
- HN
- Company
- —
- Product
- I'm 15, built an AI that watches your screen and acts before you ask
- Website domain
- github.com
- Launched
- June 16, 2026
- Cohort
- —
- Upvotes
- 5
- Upvotes percentile
- 0.12568306010928962
- Tags
- —
- Fetched at
- Sept. 7, 2026, 9:26 p.m.
- Updated at
- Sept. 7, 2026, 9:26 p.m.
Description
Can I have some feedback?
Enrichment
- Theme
- ai video generation and editing tools
- Vertical
- Horizontal
- Function
- Agent / copilot
- Audience
- B2C
- AI stance
- AI-native
- Project type
- Commercial product
- Normalized one-liner
- ai agent that watches screen and takes actions
- Manually corrected
- False
Could you build this?
Partial Capturing screen frames and passing them to multimodal LLMs (like GPT-4o or Claude) with OS automation scripts is doable, but low-latency real-time proactive intent detection is extremely difficult to make useful.
What it would actually take: Built with Python/Electron/Rust using native OS accessibility APIs and screen capture (MSS, Quartz, or DXGI), pipelining frame diffs to a vision model alongside OCR and active application hooks. The core hard problem is local proactive filtering: deciding when to trigger expensive model calls without massive latency or false-positive interruptions, while respecting local user privacy.
Discussion
1 comment analyzed.
Feature requests: Add image/video to repository, Add license file, Add one-liner terminal install command
Competitors
Other products that read as similar to this one — 288 launches clear the similarity bar, closest 8 shown.
Attention rank: #236 of 289 (itself plus its competitors, highest first — normalized so YC and Product Hunt are compared fairly).
Launched 230 days after the earliest competitor.
- I built an AI agent to yell at me about my ADHD · hn · 2026-06-30 · 6 upvotes · similarity 0.51
- I built an 11-LLM consensus engine to detect AI hallucination · hn · 2026-06-19 · 6 upvotes · similarity 0.49
- ClankerView · hn · 2026-05-05 · 5 upvotes · similarity 0.47
- See how much your AI knows about you · hn · 2026-08-24 · 22 upvotes · similarity 0.47
- Feedback widget with screenshots, annotations, and AI triage · hn · 2026-08-05 · 5 upvotes · similarity 0.45
- See What AI Models "Think" About You · hn · 2026-04-07 · 5 upvotes · similarity 0.45
- An AI-Powered Widget for Collecting User Feedback · hn · 2026-08-03 · 11 upvotes · similarity 0.45
- Watch all the AI agents on your machine · hn · 2026-09-22 · 7 upvotes · similarity 0.44
Other launches for this product
- No other launches for this product.
Same idea, different domain
Nobody's really built a agent / copilot tool for Agriculture yet.