Nicheloom

Market intelligence for builders — see what's gaining traction before it's crowded.

Redactle LLM Leaderboard

Details

External ID
49544338
Source
HN
Company
—
Product
Redactle LLM Leaderboard
Website domain
redactle.net
Launched
Sept. 3, 2026
Cohort
—
Upvotes
5
Upvotes percentile
0.12998405103668262
Tags
—
Fetched at
Sept. 10, 2026, 5:31 a.m.
Updated at
Sept. 10, 2026, 5:31 a.m.

Description

I got nerd sniped and ran a bunch of evaluations to see how well models could play Redactle. It turns out Gemini flash is in a league of it's own in both performance and cost. It's able to one-shot every eval in a just a few seconds.

Enrichment

Theme
multimodal AI models and agents
Vertical
Horizontal
Function
Analytics & BI
Audience
Developer
AI stance
AI-native
Project type
Hobby / open-source project
Normalized one-liner
leaderboard for llm performance
Manually corrected
False

Could you build this?

Yes A straightforward evaluation harness that queries the Redactle game/Wikipedia articles against LLM APIs (Gemini, Claude, GPT) and displays the resulting benchmark scores on a web leaderboard.

Discussion

1 comment analyzed.

Competitors mentioned: Gemini

Concerns raised: Pattern matching breaks when wiki text is rewritten, One-shot performance limited to ~33% accuracy

Competitors

Other products that read as similar to this one — 28 launches clear the similarity bar, closest 8 shown.

Attention rank: #28 of 29 (itself plus its competitors, highest first — normalized so YC and Product Hunt are compared fairly).

Launched 286 days after the earliest competitor.

Other launches for this product

Same idea, different domain

Nobody's really built a analytics & bi tool for Legal yet.