Nicheloom visits: 60,805 all-time · 7,913 in the last 7 days

The opportunity tracker for new startups.

Today: 1,919 launches · Niche of the day: browser-based utility tools · See what launched today →

Redactle LLM Leaderboard

Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.

Want to reach these readers? Sponsor an issue.

I got nerd sniped and ran a bunch of evaluations to see how well models could play Redactle. It turns out Gemini flash is in a league of it's own in both performance and cost. It's able to one-shot every eval in a just a few seconds.

HN · launched Sep 3, 2026 · 5 upvotes (top 87%) · 0 views

Niche: llm benchmarking tools · 84 launches, 1 in the last 7 days · Explore this niche →

Category and tags

  • Horizontal
  • Observability & eval
  • Developer
  • AI-native
  • Hobby / open-source project

Visit website ↗ Source listing ↗

Could you build this?

Yes A straightforward evaluation harness that queries the Redactle game/Wikipedia articles against LLM APIs (Gemini, Claude, GPT) and displays the resulting benchmark scores on a web leaderboard.

Discussion

1 comment analyzed.

Competitors mentioned: Gemini

Concerns raised: Pattern matching breaks when wiki text is rewritten, One-shot performance limited to ~33% accuracy

Competitors

Other products that read as similar to this one : 47 launches clear the similarity bar, closest 8 shown.

Attention rank: #45 of 48 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).

Launched 286 days after the earliest competitor.

The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.