Elliott LLaMa GPTQ by elliotthwang

 ยป  All LLMs  ยป  elliotthwang  ยป  Elliott LLaMa GPTQ   URL Share it on

  Endpoints compatible   Gptq   Llama   Pytorch   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Elliott LLaMa GPTQ Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Elliott LLaMa GPTQ (elliotthwang/Elliott-LLaMa-GPTQ)
๐ŸŒŸ Advertise your project ๐Ÿš€

Elliott LLaMa GPTQ Parameters and Internals

LLM NameElliott LLaMa GPTQ
Repository ๐Ÿค—https://huggingface.co/elliotthwang/Elliott-LLaMa-GPTQ 
Model Size6.7b
Required VRAM13.5 GB
Updated2026-02-16
Maintainerelliotthwang
Model Typellama
Model Files  10.0 GB: 1-of-2   3.5 GB: 2-of-2   10.0 GB: 1-of-2   3.5 GB: 2-of-2
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureLlamaForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.31.0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Elliott LLaMa GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
...pseek Coder 6.7B Instruct GPTQ16K / 3.9 GB36525
Magicoder S DS 6.7B GPTQ16K / 3.9 GB107
Deepseek Coder 6.7B Base GPTQ16K / 3.9 GB1065
Finance Chat GPTQ4K / 3.9 GB283
Law Chat GPTQ4K / 3.9 GB174
Gorilla Openfunctions V1 GPTQ4K / 3.9 GB155
...lliott Chinese LLaMa GPTQ V1.02K / 13.5 GB18210
Elliott Chinese LLaMa GPTQ2K / 13.5 GB16920
AmberChat GPTQ2K / 3.9 GB301
...LI LlumiX 32K Instruct F16 0.232K / 13.5 GB21
Note: green Score (e.g. "73.2") means that the model is better than elliotthwang/Elliott-LLaMa-GPTQ.

Rank the Elliott LLaMa GPTQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51611 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124