LLM EXPLORER 59,420 MODELS INDEXED

83K Continued Pretraining Qwen2.5 0.5B Instruct Unsloth Merged 16bit by FlofloB

By FlofloB · 19 downloads

83K Continued Pretraining Qwen2.5 0.5B Instruct Unsloth Merged 16bit is an open-source language model by FlofloB. Features: 0.5b LLM, VRAM: 1.3GB, Context: 32K, License: apache-2.0, Quantized, Instruction-Based, Merged, LLM Explorer Score: 0.18.

  Merged Model   4bit   Conversational Dataset:uncovai/fineweb cc-mai...   En   Endpoints compatible   Instruct   Model-index   Pytorch   Quantized   Qwen2   Region:us   Safetensors   Sft   Trl   Unsloth

83K Continued Pretraining Qwen2.5 0.5B Instruct Unsloth Merged 16bit Parameters and Internals

LLM Name83k Continued Pretraining Qwen2.5 0.5B Instruct Unsloth Merged 16bit
Repository πŸ€—https://huggingface.co/FlofloB/83k_continued_pretraining_Qwen2.5-0.5B-Instruct_Unsloth_merged_16bit 
Base Model(s)  unsloth/qwen2.5-0.5b-instruct-bnb-4bit   unsloth/qwen2.5-0.5b-instruct-bnb-4bit
Merged ModelYes
Model Size0.5b
Required VRAM1.3 GB
Updated2026-07-09
MaintainerFlofloB
Model Typeqwen2
Instruction-BasedYes
Model Files  1.3 GB   1.3 GB
Supported Languagesen
Quantization Type4bit
Model ArchitectureQwen2ForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.46.2
Tokenizer ClassQwen2Tokenizer
Padding Token<|PAD_TOKEN|>
Vocabulary Size151936
Torch Data Typefloat16
Errorsreplace

Best Alternatives to 83K Continued Pretraining Qwen2.5 0.5B Instruct Unsloth Merged 16bit

Best Alternatives
Context / RAM
Downloads
Likes
Pgabl Ft Nama Siswa32K / 1 GB2530
Legal Rag Qwen Sft32K / 1 GB2040
Atomight V2.2 UltraThink 0.5B32K / 1 GB541
...mmanuel Siagian Exp1 Lr2e5 R1632K / 1 GB110
BoyBarley Sparky32K / 1 GB170
...0.5B Instruct Unsloth Bnb 4bit32K / 0.5 GB343286
Qwen2.5 0.5B Instruct 4bit32K / 0.3 GB157697
Qwen2.5 0.5B Instruct Bnb 4bit32K / 0.5 GB145984
...5 Coder 0.5B Instruct Bnb 4bit32K / 0.5 GB66124
TinySphinx32K / 1 GB340
Note: green Score (e.g. "73.2") means that the model is better than FlofloB/83k_continued_pretraining_Qwen2.5-0.5B-Instruct_Unsloth_merged_16bit.