Compute:Arena
Community submitted local AI benchmarks
Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.
Want to reach these readers? Sponsor an issue.
Benchmarking AI models on real hardware is way harder than it looks. Between AMD, NVIDIA, Apple Silicon, Intel, and Qualcomm, plus hundreds of open source models and quants, getting the test bench right is a challenge.So we're making it dead simple. We're open sourcing our internal testing harness. Anyone can run open source models on their own hardware and submit results to the public leaderboard.It's live now, with a few hundred submissions already.If you want to know how a specific model performs on a given hardware, chances are the data is already there.This is the same tool we use internally to track model and chip performance. Try it out and tell us what to improve
HN · launched Sep 17, 2026 · 5 upvotes (top 87%) · 0 views
Niche: ai benchmarking platforms · 145 launches, 4 in the last 7 days ▼ -56% · Explore this niche →
Category and tags
- Horizontal
- Observability & eval
- Developer
- AI-native
- Hobby / open-source project
Visit website ↗ Source listing ↗
More like this: all 145 launches in ai benchmarking platforms →
Could you build this?
Partial A web leaderboard and database for benchmark results is easy to vibe-code, but the local hardware profiling agent requires cross-platform benchmarking harnesses across Metal, ROCm, and CUDA.
What it would actually take: Requires a Python/C++ CLI harness that wraps llama.cpp and native runtimes, captures signed hardware telemetry (Metal, CUDA, ROCm), and standardizes prefill/decode timing benchmarks. Requires deep understanding of low-level LLM inference engines, tokenization metrics, and cryptographic result verification.
Discussion
2 comments analyzed.
Concerns raised: unfamiliar models on front page
Competitors
Other products that read as similar to this one : 314 launches clear the similarity bar, closest 8 shown.
Attention rank: #286 of 315 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).
Launched 317 days after the earliest competitor.
- Compute:Arena · ph · 2026-09-17 · 78 upvotes · similarity 0.68
- local-ai-recipe-kit · github · 2026-09-29 · 13 upvotes · similarity 0.55
- RunLLMLocal · ph · 2026-11-01 · 1 upvotes · similarity 0.55
- PantheonGPU · hn · 2026-08-18 · 13 upvotes · similarity 0.54
- What runs on my GPU · ph · 2026-11-04 · 3 upvotes · similarity 0.52
- benchboard · github · 2026-09-18 · 18 upvotes · similarity 0.51
- Benchmark Registry · ph · 2026-09-30 · 1 upvotes · similarity 0.51
- local-enough · github · 2026-09-29 · 8 upvotes · similarity 0.50
The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.