Stablelm 2 Zephyr 1.6B GGUF is an open-source language model by second-state. Features: 6b LLM, VRAM: 0.7GB, Context: 4K, License: other, Quantized, Instruction-Based, LLM Explorer Score: 0.11.
| Model Type |
| |
| Additional Notes |
| |
| Supported Languages |
|
| LLM Name | Stablelm 2 Zephyr 1.6B GGUF |
| Repository 🤗 | https://huggingface.co/second-state/stablelm-2-zephyr-1.6b-GGUF |
| Model Name | StableLM 2 Zephyr 1.6B |
| Model Creator | stabilityai |
| Base Model(s) | |
| Model Size | 6b |
| Required VRAM | 0.7 GB |
| Updated | 2026-05-28 |
| Maintainer | second-state |
| Model Type | stablelm |
| Instruction-Based | Yes |
| Model Files | |
| Supported Languages | en |
| GGUF Quantization | Yes |
| Quantization Type | gguf|q2|q4_k|q5_k |
| Model Architecture | StableLmForCausalLM |
| License | other |
| Context Length | 4096 |
| Model Max Length | 4096 |
| Transformers Version | 4.38.0 |
| Vocabulary Size | 100352 |
| Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Stablelm 2 Zephyr 1 6b | 4K / 1 GB | 7006 | 187 |
| Stablelm 2 Zephyr 1 6b 4bit | 4K / 1.2 GB | 64 | 5 |
| Stablelm 2 1 6b Chat | 4K / 6.6 GB | 1945 | 34 |
| Stablelm 2 Zephyr 1 6b | 4K / 3.3 GB | 14 | 1 |