exl3xpu
EXL3 (exllamav3 trellis) inference on Intel Arc Battlemage: bit-exact ESIMD kernels as a vLLM XPU plugin
Details
- External ID
- 1382442259
- Source
- GITHUB
- Company
- —
- Product
- exl3xpu
- Website domain
- github.com
- Launched
- Sept. 22, 2026
- Cohort
- —
- Upvotes
- 10
- Upvotes percentile
- 0.28183448629259544
- Tags
- —
- Fetched at
- Sept. 26, 2026, 10:54 p.m.
- Updated at
- Sept. 26, 2026, 10:54 p.m.
Enrichment
- Theme
- ML inference and model optimization
- Vertical
- Horizontal
- Function
- Model & infra
- Audience
- Developer
- AI stance
- AI-native
- Project type
- Hobby / open-source project
- Normalized one-liner
- exllamav3 inference kernels for intel arc gpus in vllm
- Manually corrected
- False
Could you build this?
No Writing bit-exact low-level ESIMD GPU kernels for Intel Arc Battlemage hardware to support ExLlamaV3 Trellis quantization in vLLM requires rare, deep low-level systems and GPU architecture expertise.
What it would actually take: Requires C++, Intel oneAPI, DPC++/ESIMD, and the vLLM engine architecture. The hard part is implementing hand-tuned SIMD vector assembly/kernels targeting Intel's Xe2 architecture execution units, managing register allocation, sub-byte bit packing/unpacking, and matching bit-exact mathematical outputs for complex multi-bit quantization schemes. This necessitates senior compiler/GPU kernel engineering expertise and specialized hardware profiling tools.
Competitors
Other products that read as similar to this one — 1031 launches clear the similarity bar, closest 8 shown.
Attention rank: #713 of 1032 (itself plus its competitors, highest first — normalized so YC and Product Hunt are compared fairly).
Launched 326 days after the earliest competitor.
- Tiny-vLLM · hn · 2026-05-29 · 205 upvotes · similarity 0.59
- Extctl, a super simple systemd-sysext wrapper · hn · 2026-08-18 · 5 upvotes · similarity 0.57
- LLM Inference Calculator · hn · 2026-08-28 · 6 upvotes · similarity 0.56
- Spliff · hn · 2026-01-17 · 5 upvotes · similarity 0.55
- A (marginally) useful x86-64 ELF executable in 298 bytes · hn · 2026-04-07 · 13 upvotes · similarity 0.55
- qwen38-exl3-dflash2 · github · 2026-09-15 · 18 upvotes · similarity 0.55
- Kairo · hn · 2026-09-14 · 5 upvotes · similarity 0.53
- IronMule · ph · 2026-09-17 · 1 upvotes · similarity 0.53
Other launches for this product
- No other launches for this product.
Same idea, different domain
Nobody's really built a model & infra tool for Fintech yet.