LLM EXPLORER 60,702 MODELS INDEXED

OpenAssistant Llama2 13B Orca V2 8K 3166 GPTQ by TheBloke

By TheBloke · 48 downloads

OpenAssistant Llama2 13B Orca V2 8K 3166 GPTQ is an open-source language model by TheBloke. Features: 13b LLM, VRAM: 7.3GB, Context: 8K, License: other, Quantized, Instruction-Based, LLM Explorer Score: 0.08.

  4-bit Base model:openassistant/llama... Base model:quantized:openassis... Dataset:nickrosh/evol-instruct... Dataset:rombodawg/megacodetrai...   Dataset:shahules786/orca-chat Dataset:theblackcat102/evol-co...   Ext 8k   Gptq   Instruct   Llama   Quantized   Region:us   Safetensors

OpenAssistant Llama2 13B Orca V2 8K 3166 GPTQ Parameters and Internals

LLM NameOpenAssistant Llama2 13B Orca V2 8K 3166 GPTQ
Repository πŸ€—https://huggingface.co/TheBloke/OpenAssistant-Llama2-13B-Orca-v2-8K-3166-GPTQ 
Model NameLlama2 13B Orca v2 8K
Model CreatorOpenAssistant
Base Model(s)  OpenAssistant/llama2-13b-orca-v2-8k-3166   OpenAssistant/llama2-13b-orca-v2-8k-3166
Model Size13b
Required VRAM7.3 GB
Updated2026-08-08
MaintainerTheBloke
Model Typellama
Instruction-BasedYes
Model Files  7.3 GB
GPTQ QuantizationYes
Context Length8k
Quantization Typegptq
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length8192
Model Max Length8192
Transformers Version4.31.0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32016
Torch Data Typefloat16

Best Alternatives to OpenAssistant Llama2 13B Orca V2 8K 3166 GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
NexusRaven 13B GPTQ16K / 7.3 GB357
CodeLlama 13B Instruct GPTQ16K / 7.3 GB7539
Leo Hessianai 13B Chat GPTQ8K / 7.3 GB471
...sianai 13B Chat Bilingual GPTQ8K / 7.3 GB24
Mythalion 13B GPTQ4K / 7.3 GB200552
Swallow 13B Instruct GPTQ4K / 7.5 GB62
...2 13B Ft Instruct Es Gptq 3bit4K / 5.7 GB63
Pygmalion 2 13B GPTQ4K / 7.3 GB3541
LoKuS 13B GPTQ4K / 7.3 GB712
Speechless Llama2 13B GPTQ4K / 7.3 GB72
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/OpenAssistant-Llama2-13B-Orca-v2-8K-3166-GPTQ.