Nicheloom visits: 58,094 all-time · 7,637 in the last 7 days

The opportunity tracker for new startups.

Today: 1,953 launches · Niche of the day: specialized calculation tools · See what launched today →

Portal2Bench

Can AI agents solve Portal 2?

Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.

Want to reach these readers? Sponsor an issue.

HN · launched Nov 14, 2026 · 5 upvotes (top 86%) · 0 views

Niche: ai benchmarking platforms · 145 launches, 4 in the last 7 days ▼ -56% · Explore this niche →

Category and tags

  • Horizontal
  • Observability & eval
  • Developer
  • AI-native
  • Hobby / open-source project

Visit website ↗ Source listing ↗

Could you build this?

Partial The UI, leaderboard, and results pages are easy to vibe-code, but the core is a game-control harness that pauses Portal 2, feeds screenshots to models, and enforces budgets. Running and trusting the benchmark also requires substantial model compute and research-grade evaluation design.

What it would actually take: The harness needs a way to pause and step Portal 2 (engine console or custom hooks), capture screenshots, read player position, and inject input. It also needs a planner loop that calls frontier model APIs under cost and step caps, plus per-chamber reproducibility checks. The hard parts are reliable game-state access and the API budget, which runs to tens of dollars per run across many models.

Discussion

No comments on this launch.

Competitors

Other products that read as similar to this one : 3308 launches clear the similarity bar, closest 8 shown.

Attention rank: #2823 of 3309 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).

Launched 381 days after the earliest competitor.

The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.