LLM EXPLORER 59,420 MODELS INDEXED

Zephyr Quiklang 3B 4K by Walmart-the-bag

By Walmart-the-bag · 4 downloads

Zephyr Quiklang 3B 4K is an open-source language model by Walmart-the-bag. Features: 3b LLM, VRAM: 5.9GB, Context: 4K, License: other, LLM Explorer Score: 0.1.

Base model:finetune:walmart-th... Base model:walmart-the-bag/zep...   Causal lm   Conversational   Custom code   Dataset:teknium/openhermes   Feature-extraction   Pytorch   Region:us   Stablelm epoch

Zephyr Quiklang 3B 4K Parameters and Internals

Model Type 
text-generation, causal_lm
Additional Notes 
This is a 4K version with 1000 more samples of openhermes than the original model.
Training Details 
Data Sources:
teknium/openhermes, unalignment/toxic-dpo-v0.1
Data Volume:
10000 samples
Methodology:
finetuning
Hardware Used:
1xA6000-48GB
LLM NameZephyr Quiklang 3B 4K
Repository πŸ€—https://huggingface.co/Walmart-the-bag/zephyr-quiklang-3b-4K 
Base Model(s)  Zephyr Quiklang 3B   Walmart-the-bag/zephyr-quiklang-3b
Model Size3b
Required VRAM5.9 GB
Updated2025-09-23
MaintainerWalmart-the-bag
Model Typestablelm_epoch
Model Files  5.9 GB   0.0 GB
Model ArchitectureStableLMEpochForCausalLM
Licenseother
Context Length4096
Model Max Length4096
Transformers Version4.34.1
Tokenizer ClassGPTNeoXTokenizer
Padding Token<|endoftext|>
Vocabulary Size50304
Torch Data Typefloat16

Quantized Models of the Zephyr Quiklang 3B 4K

Model
Likes
Downloads
VRAM
Zephyr Quiklang 3B 4K GGUF4871 GB
Zephyr Quiklang 3B 4K GPTQ221 GB

Best Alternatives to Zephyr Quiklang 3B 4K

Best Alternatives
Context / RAM
Downloads
Likes
Stable Code 3B Mlx16K / 5.6 GB171
Aura 3B4K / 5.6 GB32
Slim Extract4K / 5.6 GB1013
Slim Boolean4K / 5.6 GB94
Slim Sa Ner4K / 5.6 GB206
Slim Tags 3B4K / 5.6 GB114
Slim Summary4K / 5.6 GB108
Slim Xsum4K / 5.6 GB146
Tofu 3B4K / 5.6 GB52
Memphis CoT 3B4K / 5.6 GB2431
Note: green Score (e.g. "73.2") means that the model is better than Walmart-the-bag/zephyr-quiklang-3b-4K.