LLM EXPLORER 61,561 MODELS INDEXED

Vietcuna 7B V3 AWQ by phatjk

By phatjk · 6 downloads

Vietcuna 7B V3 AWQ is an open-source language model by phatjk. Features: 7b LLM, VRAM: 7.2GB, Quantized, LLM Explorer Score: 0.1.

  4-bit   Awq   Bloom   Endpoints compatible   Quantized   Region:us   Safetensors

Vietcuna 7B V3 AWQ Parameters and Internals

Model Type 
text-generation
Release Notes 
Version:
GEMM
Notes:
The model makes use of zero_point and quantization settings with a q_group_size of 128 and w_bit of 4.
LLM NameVietcuna 7B V3 AWQ
Repository πŸ€—https://huggingface.co/phatjk/vietcuna-7b-v3-AWQ 
Base Model(s)  Vietcuna 7B V3   vilm/vietcuna-7b-v3
Model Size7b
Required VRAM7.2 GB
Updated2026-07-27
Maintainerphatjk
Model Typebloom
Model Files  7.2 GB
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureBloomForCausalLM
Transformers Version4.35.2
Tokenizer ClassBloomTokenizer
Padding Token<pad>
Vocabulary Size250880
Torch Data Typefloat16

Best Alternatives to Vietcuna 7B V3 AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Vietcuna 7B V3 AWQ0K / 7.2 GB60
Tigerbot 7B Sft V1 4bit0K / 5.2 GB56
Phoenix Inst Chat 7B Int42K / 5.2 GB96
...tral 7B Instruct V0.2 Uld Loss0K / 2.2 GB140
... 7B Instruct V0.2 Text Teacher0K / 2.2 GB130
...Qa Llama 2 7B Chat Hf Uld Loss0K / 2.2 GB50
...lama 2 7B Chat Hf Text Teacher0K / 2.2 GB50
Yayi 7B0K / 28.2 GB11730
Gogpt 7B Bloom0K / 32.3 GB1273
Phoenix Inst Chat 7B0K / 16.2 GB6143
Note: green Score (e.g. "73.2") means that the model is better than phatjk/vietcuna-7b-v3-AWQ.