fast-long-context
Easy local setup for Qwen3.8-27B Abliterated: 256K context and measured 240-300 tokens/s generation on an RTX 5090.
Details
- External ID
- 1378402113
- Source
- GITHUB
- Company
- —
- Product
- fast-long-context
- Website domain
- github.com
- Launched
- Sept. 20, 2026
- Cohort
- —
- Upvotes
- 29
- Upvotes percentile
- 0.7161798616448886
- Tags
- —
- Fetched at
- Sept. 24, 2026, 5:02 p.m.
- Updated at
- Sept. 24, 2026, 5:02 p.m.
Enrichment
- Theme
- lightweight and on-device AI runtimes
- Vertical
- Horizontal
- Function
- Model & infra
- Audience
- Developer
- AI stance
- AI-native
- Project type
- Hobby / open-source project
- Normalized one-liner
- local inference setup for qwen 27b models
- Manually corrected
- False
Could you build this?
Yes This is an orchestration and setup script/wrapper around existing open-source inference backends (like vLLM, SGLang, or TensorRT-LLM) configured for high-throughput Qwen inference on an RTX 5090.
Competitors
Other products that read as similar to this one — 111 launches clear the similarity bar, closest 8 shown.
Attention rank: #32 of 112 (itself plus its competitors, highest first — normalized so YC and Product Hunt are compared fairly).
Launched 315 days after the earliest competitor.
- qwen3.6-35b-a3b-144T-S · github · 2026-09-20 · 15 upvotes · similarity 0.52
- qwen38-exl3-dflash2 · github · 2026-09-15 · 18 upvotes · similarity 0.51
- Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s · hn · 2026-09-01 · 240 upvotes · similarity 0.50
- fast-long-context-cinference · github · 2026-09-21 · 34 upvotes · similarity 0.48
- qwen38-flash-next-w4a16-cmp170hx · github · 2026-09-16 · 10 upvotes · similarity 0.48
- qwen21-fast-comfyui · github · 2026-09-23 · 17 upvotes · similarity 0.47
- I fine-tuned Qwen 3.5 (0.8B–4B) on a Mac for text-to-SQL · hn · 2026-03-05 · 7 upvotes · similarity 0.44
- collabosm · github · 2026-09-25 · 90 upvotes · similarity 0.44
Other launches for this product
- No other launches for this product.
Same idea, different domain
Nobody's really built a model & infra tool for Fintech yet.