LLM EXPLORER 56,604 MODELS INDEXED

EEVE Korean 10.8B V1.0 by yanolja

By yanolja · 6257 downloads

EEVE Korean 10.8B V1.0 is an open-source language model by yanolja. Features: 10.7b LLM, VRAM: 21.6GB, Context: 4K, License: apache-2.0, LLM Explorer Score: 0.14.

  Arxiv:2402.14714   Autotrain compatible Base model:finetune:upstage/so... Base model:upstage/solar-10.7b...   Conversational   Endpoints compatible   Generated from trainer   Llama   Region:us   Safetensors   Sharded   Tensorflow

EEVE Korean 10.8B V1.0 Parameters and Internals

Model Type 
text generation
Use Cases 
Areas:
Research, Commercial applications
Primary Use Cases:
Korean language tasks
Limitations:
The model hasn't been fine-tuned with instruction-based training.
Additional Notes 
The model is fine-tuned for improved understanding of the Korean language, utilizing Korean web-crawled datasets for enhanced performance. The vocabulary was carefully expanded with new Korean tokens.
Supported Languages 
Korean (Extended proficiency)
Training Details 
Data Sources:
Korean web-crawled datasets available on HuggingFace
Data Volume:
100GB Korean corpus
Methodology:
Subword-based embedding with a seven-stage training process involving parameter freezing, progressively training from input embeddings to full parameters
Model Architecture:
Adapting foundational models from English to Korean with causal language modeling pre-training
LLM NameEEVE Korean 10.8B V1.0
Repository πŸ€—https://huggingface.co/yanolja/EEVE-Korean-10.8B-v1.0 
Base Model(s)  upstage/SOLAR-10.7B-v1.0   upstage/SOLAR-10.7B-v1.0
Model Size10.7b
Required VRAM21.6 GB
Updated2025-09-02
Maintaineryanolja
Model Typellama
Model Files  4.9 GB: 1-of-5   4.9 GB: 2-of-5   5.0 GB: 3-of-5   4.9 GB: 4-of-5   1.9 GB: 5-of-5
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version4.37.0
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size40960
Torch Data Typebfloat16

Quantized Models of the EEVE Korean 10.8B V1.0

Model
Likes
Downloads
VRAM
...orean Instruct 10.8B V1.0 Gguf238746 GB

Best Alternatives to EEVE Korean 10.8B V1.0

Best Alternatives
Context / RAM
Downloads
Likes
SOLAR 10.7B Instruct V1.0 128K128K / 21.4 GB633
SOLAR 10.7B V1.0 Instruct 16K16K / 21.4 GB632
SOLAR 10.7B V1.0 Base 16K16K / 21.4 GB690
SauerkrautLM SOLAR Instruct8K / 21.4 GB6246
Fimbulvetr V2 Kuro Lotus Bf168K / 21.5 GB64
PiVoT SOLAR 10.7B RP8K / 21.4 GB547
MetaModelv28K / 21.4 GB1970
Kazemi 1.2 Solar8K / 21.4 GB00
Bucharest 0.25K / 21.4 GB61
Somer24K / 21.4 GB100
Note: green Score (e.g. "73.2") means that the model is better than yanolja/EEVE-Korean-10.8B-v1.0.