I benchmarked Gemma 4 E2B
the 2B model beat the 12B on multi-turn
Details
- External ID
- 47756892
- Source
- HN
- Company
- —
- Product
- I benchmarked Gemma 4 E2B
- Website domain
- aiexplr.com
- Launched
- April 13, 2026
- Cohort
- —
- Upvotes
- 8
- Upvotes percentile
- 0.4813624678663239
- Tags
- —
- Fetched at
- Sept. 7, 2026, 9:26 p.m.
- Updated at
- Sept. 7, 2026, 9:26 p.m.
Enrichment
- Theme
- lightweight and on-device AI runtimes
- Vertical
- Horizontal
- Function
- Observability & eval
- Audience
- Developer
- AI stance
- Not AI
- Project type
- Hobby / open-source project
- Normalized one-liner
- benchmark results for gemma language models
- Manually corrected
- False
Could you build this?
Yes This is a benchmarking study and blog post running open-source Hugging Face models across 10 evaluation test suites locally on Apple Silicon. The evaluation harness and scripts are straightforward to build with AI assistance.
Discussion
1 comment analyzed.
Concerns raised: Lack of transparency on test cases used, Unclear definition of multi-turn evaluation
Competitors
Other products that read as similar to this one — 27 launches clear the similarity bar, closest 8 shown.
Attention rank: #13 of 28 (itself plus its competitors, highest first — normalized so YC and Product Hunt are compared fairly).
Launched 94 days after the earliest competitor.
- Cactus Hybrid: We taught Gemma 4 to know when it's wrong · hn · 2026-07-22 · 191 upvotes · similarity 0.46
- Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac · hn · 2026-07-29 · 919 upvotes · similarity 0.44
- Google Gemma 4 12B · ph · 2026-06-04 · 309 upvotes · similarity 0.44
- Running Gemma-4 26B at 124 tokens/SEC on a CPU, no GPU · hn · 2026-06-30 · 10 upvotes · similarity 0.43
- I made a Gemma 4 Mac app that names screenshots with local AI · hn · 2026-05-31 · 7 upvotes · similarity 0.39
- Fine-tune an 8B model on a 4 GB laptop GPU · hn · 2026-08-04 · 139 upvotes · similarity 0.38
- I made a vertical-pedalling bike with a novel drivetrain [video] · hn · 2026-05-07 · 26 upvotes · similarity 0.37
- Google Gemma 4 · ph · 2026-04-03 · 439 upvotes · similarity 0.37
Other launches for this product
- No other launches for this product.
Same idea, different domain
Nobody's really built a observability & eval tool for Media & entertainment yet.