KoAlpaca 65B LoRA by beomi

 ยป  All LLMs  ยป  beomi  ยป  KoAlpaca 65B LoRA   URL Share it on

  Adapter   Alpaca   En   Finetuned   Ko   Koalpaca   Llama   Lora   Region:us
Model Card on HF ๐Ÿค—: https://huggingface.co/beomi/KoAlpaca-65B-LoRA 

KoAlpaca 65B LoRA Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
KoAlpaca 65B LoRA (beomi/KoAlpaca-65B-LoRA)
๐ŸŒŸ Advertise your project ๐Ÿš€

KoAlpaca 65B LoRA Parameters and Internals

Model Type 
finetuned, LoRA
Additional Notes 
The repository contains only the LoRA weights, not the full model weights.
Supported Languages 
ko (high), en (high)
Training Details 
Data Sources:
Korean dataset, English dataset
Methodology:
Finetuning (LoRA)
LLM NameKoAlpaca 65B LoRA
Repository ๐Ÿค—https://huggingface.co/beomi/KoAlpaca-65B-LoRA 
Model Size65b
Required VRAM0.1 GB
Updated2025-09-16
Maintainerbeomi
Model Files  0.1 GB   0.0 GB
Supported Languagesko en
Model ArchitectureAdapter
Licensemit
Is Biasednone
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesq_proj|v_proj
LoRA Alpha16
LoRA Dropout0.05
R Param8

Best Alternatives to KoAlpaca 65B LoRA

Best Alternatives
Context / RAM
Downloads
Likes
...os 65B Gpt4 1.4.1 PI 8192 Peft0K / 1.6 GB01
Enterredaas 65B QLoRA0K / 1.6 GB04
Alpaca Lora 65B En Pt Es Ca0K / 0.1 GB02
Guanaco 65B0K / 3.2 GB088
Saiga 65b Lora0K / 0.3 GB06
VicUnlocked Alpaca 65B QLoRA0K / 1.6 GB016
Qlora Self Instruct 65B0K / 3.2 GB02
Qlora Flan 65B0K / 3.2 GB01
Alpaca Lora 65B0K / 0.1 GB025
Alpaca 65B0K / 0.1 GB017
Note: green Score (e.g. "73.2") means that the model is better than beomi/KoAlpaca-65B-LoRA.

Rank the KoAlpaca 65B LoRA Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51387 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124