Korean-llm-v4
한국어 사전학습과 SFT를 위한 1.09B 파라미터 풀스크래치 LLM — RoPE, KV Cache, BF16·8-bit AdamW 최적화, 데이터셋 캐싱 및 학습 모니터링 지원.
Details
- External ID
- 1362809792
- Source
- GITHUB
- Company
- —
- Product
- Korean-llm-v4
- Website domain
- huggingface.co
- Launched
- Sept. 9, 2026
- Cohort
- —
- Upvotes
- 21
- Upvotes percentile
- 0.6211247758134768
- Tags
- adamw, adamw8bit, bf16, bitsandbytes, huggingface, korean, model, python, pytorch, rmsnorm, rope, swiglu, tinker, transformer
- Fetched at
- Sept. 13, 2026, 5:56 p.m.
- Updated at
- Sept. 13, 2026, 5:56 p.m.
Enrichment
- Theme
- niche developer utilities and guides
- Vertical
- Horizontal
- Function
- Model & infra
- Audience
- Developer
- AI stance
- AI-native
- Project type
- Hobby / open-source project
- Normalized one-liner
- 1.09b parameter korean llm trained from scratch
- Manually corrected
- False
Could you build this?
No Pretraining a 1.09B parameter language model from scratch requires high-performance GPU clusters, petabyte-scale data curation, and distributed training systems engineering.
What it would actually take: Requires PyTorch with Megatron-LM or DeepSpeed, FlashAttention, and tokenizers running across multi-node GPU clusters (A100/H100s). Involves scraping, deduplicating, and filtering tens of billions of Korean tokens, tuning learning rate schedules, and managing checkpointing and hardware failure recovery.
Competitors
Other products that read as similar to this one — 296 launches clear the similarity bar, closest 8 shown.
Attention rank: #111 of 297 (itself plus its competitors, highest first — normalized so YC and Product Hunt are compared fairly).
Launched 307 days after the earliest competitor.
- PlusCodex · github · 2026-09-17 · 10 upvotes · similarity 0.53
- android-mac-lab · github · 2026-09-28 · 7 upvotes · similarity 0.50
- EarShot · github · 2026-09-12 · 10 upvotes · similarity 0.49
- KV-psi, using Linux PSI to to trim an LLM KV cache · hn · 2026-06-27 · 8 upvotes · similarity 0.49
- xkkgame · github · 2026-09-30 · 17 upvotes · similarity 0.48
- re-sseol-ch · github · 2026-09-29 · 17 upvotes · similarity 0.46
- N-RPG · github · 2026-09-12 · 13 upvotes · similarity 0.45
- nurigeul · github · 2026-09-26 · 8 upvotes · similarity 0.45
Other launches for this product
- No other launches for this product.
Same idea, different domain
Nobody's really built a model & infra tool for Fintech yet.