LLM EXPLORER 59,516 MODELS INDEXED

Yugo55A GPT AWQ by datatab

By datatab · 6 downloads

Yugo55A GPT AWQ is an open-source language model by datatab. Features: 1.2b LLM, VRAM: 4.2GB, Context: 32K, Quantized, LLM Explorer Score: 0.12.

  4-bit   Autotrain compatible   Awq   Conversational   Endpoints compatible   Mistral   Quantized   Region:us   Safetensors

Yugo55A GPT AWQ Parameters and Internals

LLM NameYugo55A GPT AWQ
Repository πŸ€—https://huggingface.co/datatab/Yugo55A-GPT-AWQ 
Model Size1.2b
Required VRAM4.2 GB
Updated2024-11-13
Maintainerdatatab
Model Typemistral
Model Files  4.2 GB
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureMistralForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.38.2
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Yugo55A GPT AWQ

Best Alternatives
Context / RAM
Downloads
Likes
Quantized Kheopss AWQ 4bits V132K / 4.2 GB170
MistralLite AWQ32K / 4.2 GB423
SFR Embedding Mistral AWQ32K / 4.2 GB160
Openchat 3.5 16K AWQ32K / 4.2 GB31
Openchat 3.5 0106 AWQ8K / 4.2 GB31
Hare1.0 Beta32K / 2.4 GB501
Mistralmawq32K / 4.2 GB140
... Finetune 16bit Ver9 Main GPTQ32K / 4.2 GB60
Turdus GPTQ32K / 4.2 GB85
Note: green Score (e.g. "73.2") means that the model is better than datatab/Yugo55A-GPT-AWQ.