EEVE Korean 2.8B V1.0 is an open-source language model by yanolja. Features: 2.8b LLM, VRAM: 5.7GB, Context: 2K, License: apache-2.0, LLM Explorer Score: 0.15, Arc: 57.3, HellaSwag: 72.2, MMLU: 51.6, GSM8K: 36.4.
Model hasn't been fine-tuned with instruction-based training
Additional Notes
The model is fine-tuned specifically for Korean tasks using an extended Korean vocabulary. It expands upon the English-trained base model by adding new Korean tokens and partially fine-tuning relevant embeddings.