Redactle LLM Leaderboard
Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.
Want to reach these readers? Sponsor an issue.
I got nerd sniped and ran a bunch of evaluations to see how well models could play Redactle. It turns out Gemini flash is in a league of it's own in both performance and cost. It's able to one-shot every eval in a just a few seconds.
HN · launched Sep 3, 2026 · 5 upvotes (top 87%) · 0 views
Niche: llm benchmarking tools · 84 launches, 1 in the last 7 days · Explore this niche →
Category and tags
- Horizontal
- Observability & eval
- Developer
- AI-native
- Hobby / open-source project
Visit website ↗ Source listing ↗
More like this: all 84 launches in llm benchmarking tools →
Could you build this?
Yes A straightforward evaluation harness that queries the Redactle game/Wikipedia articles against LLM APIs (Gemini, Claude, GPT) and displays the resulting benchmark scores on a web leaderboard.
Discussion
1 comment analyzed.
Competitors mentioned: Gemini
Concerns raised: Pattern matching breaks when wiki text is rewritten, One-shot performance limited to ~33% accuracy
Competitors
Other products that read as similar to this one : 47 launches clear the similarity bar, closest 8 shown.
Attention rank: #45 of 48 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).
Launched 286 days after the earliest competitor.
- Gemini 3.7 Flash · ph · 2026-08-14 · 240 upvotes · similarity 0.49
- TetrisBench · hn · 2026-01-26 · 111 upvotes · similarity 0.45
- Gemini 3.1 Flash Live · ph · 2026-03-27 · 320 upvotes · similarity 0.43
- Google Gemini 3.8 Flash and Cyber · ph · 2026-09-04 · 237 upvotes · similarity 0.43
- Gemini 3.6 Flash Family · ph · 2026-07-22 · 182 upvotes · similarity 0.43
- Gemini 3.1 Flash-Lite · ph · 2026-05-16 · 168 upvotes · similarity 0.42
- Fly By · hn · 2026-09-01 · 84 upvotes · similarity 0.40
- Agentic Video Understanding in Gemini · ph · 2026-09-06 · 209 upvotes · similarity 0.40
The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.