| LLM Name | Polyglot Ko 12B Qlora | 
| Repository ๐ค | https://huggingface.co/nakhyeon/polyglot-ko-12b-qlora | 
| Model Size | 12b | 
| Required VRAM | 25.9 GB | 
| Updated | 2025-09-23 | 
| Maintainer | nakhyeon | 
| Model Files | |
| Model Architecture | AutoModelForCausalLM | 
| License | mit | 
| Is Biased | none | 
| Tokenizer Class | PreTrainedTokenizerFast | 
| Padding Token | <|endoftext|> | 
| PEFT Type | LORA | 
| LoRA Model | Yes | 
| PEFT Target Modules | dense_h_to_4h|embed_out|dense|query_key_value|dense_4h_to_h | 
| LoRA Alpha | 32 | 
| LoRA Dropout | 0.05 | 
| R Param | 8 | 
| Best Alternatives | Context / RAM | Downloads | Likes | 
|---|---|---|---|
| Ramen 12B | 0K / 24.5 GB | 8 | 0 | 
| Noodles Merge 12B | 0K / 24.5 GB | 8 | 0 | 
| Broth 12B | 0K / 24.5 GB | 6 | 0 | 
| Ultra Instruct 12B | 0K / 24.5 GB | 3 | 4 | 
| Orthrus 12B V0.8 | 0K / 24.5 GB | 4 | 4 | 
| WorldBuilder 12B | 0K / 24.5 GB | 5 | 0 | 
| CleverBoi Nemo 12B V2 | 0K / 0.2 GB | 145 | 4 | 
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐