LLM EXPLORER 59,420 MODELS INDEXED

Polyglot Ko 12B Qlora by nakhyeon

By nakhyeon · 7 downloads

Polyglot Ko 12B Qlora is an open-source language model by nakhyeon. Features: 12b LLM, VRAM: 25.9GB, License: mit, LLM Explorer Score: 0.09.

  Deploy:azure   Endpoints compatible   Gpt neox   Lora   Region:us   Safetensors   Sharded   Tensorflow

Polyglot Ko 12B Qlora Parameters and Internals

LLM NamePolyglot Ko 12B Qlora
Repository πŸ€—https://huggingface.co/nakhyeon/polyglot-ko-12b-qlora 
Model Size12b
Required VRAM25.9 GB
Updated2026-07-25
Maintainernakhyeon
Model Files  0.1 GB   10.0 GB: 1-of-3   9.9 GB: 2-of-3   6.0 GB: 3-of-3
Model ArchitectureAutoModelForCausalLM
Licensemit
Is Biasednone
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|endoftext|>
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesdense_h_to_4h|embed_out|dense|query_key_value|dense_4h_to_h
LoRA Alpha32
LoRA Dropout0.05
R Param8

Best Alternatives to Polyglot Ko 12B Qlora

Best Alternatives
Context / RAM
Downloads
Likes
Ramen 12B0K / 24.5 GB90
Noodles Merge 12B0K / 24.5 GB60
Broth 12B0K / 24.5 GB110
Ultra Instruct 12B0K / 24.5 GB244
Orthrus 12B V0.80K / 24.5 GB44
WorldBuilder 12B0K / 24.5 GB60
CleverBoi Nemo 12B V20K / 0.2 GB3404
Note: green Score (e.g. "73.2") means that the model is better than nakhyeon/polyglot-ko-12b-qlora.