LLM EXPLORER 59,516 MODELS INDEXED

Mistral Finetune 16bit Ver9 Main GPTQ by obamaTeo

By obamaTeo · 6 downloads

Mistral Finetune 16bit Ver9 Main GPTQ is an open-source language model by obamaTeo. Features: 1.2b LLM, VRAM: 4.2GB, Context: 32K, Quantized, Fine-Tuned, LLM Explorer Score: 0.12.

  Arxiv:1910.09700   16bit   4-bit   Autotrain compatible   Conversational   Endpoints compatible   Finetuned   Gptq   Mistral   Quantized   Region:us   Safetensors

Mistral Finetune 16bit Ver9 Main GPTQ Parameters and Internals

LLM NameMistral Finetune 16bit Ver9 Main GPTQ
Repository πŸ€—https://huggingface.co/obamaTeo/mistral-finetune-16bit-ver9-main-GPTQ 
Model Size1.2b
Required VRAM4.2 GB
Updated2025-09-23
MaintainerobamaTeo
Model Typemistral
Model Files  4.2 GB
GPTQ QuantizationYes
Quantization Typegptq|16bit
Model ArchitectureMistralForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.40.2
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Mistral Finetune 16bit Ver9 Main GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
Turdus GPTQ32K / 4.2 GB85
Hare1.0 Beta32K / 2.4 GB501
Mistralmawq32K / 4.2 GB140
Quantized Kheopss AWQ 4bits V132K / 4.2 GB170
MistralLite AWQ32K / 4.2 GB423
SFR Embedding Mistral AWQ32K / 4.2 GB160
Yugo55A GPT AWQ32K / 4.2 GB60
Openchat 3.5 16K AWQ32K / 4.2 GB31
Openchat 3.5 0106 AWQ8K / 4.2 GB31
Note: green Score (e.g. "73.2") means that the model is better than obamaTeo/mistral-finetune-16bit-ver9-main-GPTQ.