LLM EXPLORER 62,589 MODELS INDEXED

Qwen3.5 0.8B GPT6 Luna Distill Karpy by NasledieLab

By NasledieLab · 884 downloads

Qwen3.5 0.8B GPT6 Luna Distill Karpy is an open-source language model by NasledieLab. Features: 0.8b LLM, VRAM: 0.2GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.33.

Base model:quantized:unsloth/q... Base model:unsloth/qwen3.5-0.8...   Conversational   Endpoints compatible   Gguf   Image-text-to-text   Llama.cpp   Lm-studio   Ollama   Q4   Quantized   Qwen3 5   Region:us

Qwen3.5 0.8B GPT6 Luna Distill Karpy Parameters and Internals

LLM NameQwen3.5 0.8B GPT6 Luna Distill Karpy
Repository πŸ€—https://huggingface.co/NasledieLab/Qwen3.5-0.8B-GPT6-Luna-Distill-Karpy 
Model Nameunsloth/Qwen3.5-0.8B
Base Model(s)  unsloth/Qwen3.5-0.8B   unsloth/Qwen3.5-0.8B
Model Size0.8b
Required VRAM0.2 GB
Updated2026-09-30
MaintainerNasledieLab
Model Typeqwen3_5
Model Files  0.5 GB   0.2 GB
GGUF QuantizationYes
Quantization Typegguf|q4|q4_k
Model ArchitectureQwen3_5ForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version5.17.0
Tokenizer ClassTokenizersBackend
Padding Token<|vision_pad|>
Errorsreplace

Best Alternatives to Qwen3.5 0.8B GPT6 Luna Distill Karpy

Best Alternatives
Context / RAM
Downloads
Likes
Mavery Lehrling 0.8B MLX 4bit0K / 0.4 GB771
Qwen3.5 0.8B MLX 4bit0K / 0.6 GB51135
Qwen3.5 0.8B 8bit0K / 1 GB47922
Qwen3.5 0.8B 4bit0K / 0.6 GB25493
Qwen3.5 0.8B OptiQ 4bit0K / 0.2 GB149422
Chartreader 0.8B OptiQ 4bit0K / 0.7 GB1052
OvisOCR20K / 1.7 GB212348475
Qwen3.5 0.8B0K / 1.8 GB2839884655
Intern Decision 0.8B0K / 0.2 GB24216
Tev1 0.8B Experimental0K / 1.8 GB6449
Note: green Score (e.g. "73.2") means that the model is better than NasledieLab/Qwen3.5-0.8B-GPT6-Luna-Distill-Karpy.