LLM EXPLORER 60,702 MODELS INDEXED

LlongOrca 13B 16K GPTQ by TheBloke

By TheBloke · 3 downloads

LlongOrca 13B 16K GPTQ is an open-source language model by TheBloke. Features: 13b LLM, VRAM: 7.3GB, Context: 16K, License: llama2, Quantized, LLM Explorer Score: 0.08.

  Arxiv:2301.13688   Arxiv:2306.02707   Arxiv:2307.09288   4-bit Base model:open-orca/llongorca... Base model:quantized:open-orca...   Dataset:open-orca/openorca   En   Gptq   Llama   Quantized   Region:us   Safetensors

LlongOrca 13B 16K GPTQ Parameters and Internals

LLM NameLlongOrca 13B 16K GPTQ
Repository πŸ€—https://huggingface.co/TheBloke/LlongOrca-13B-16K-GPTQ 
Model NameLlongOrca 13B 16K
Model CreatorOpen-Orca
Base Model(s)  LlongOrca 13B 16K   Open-Orca/LlongOrca-13B-16k
Model Size13b
Required VRAM7.3 GB
Updated2026-07-28
MaintainerTheBloke
Model Typellama
Model Files  7.3 GB
Supported Languagesen
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureLlamaForCausalLM
Licensellama2
Context Length16384
Model Max Length16384
Transformers Version4.32.0.dev0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32004
Torch Data Typebfloat16

Best Alternatives to LlongOrca 13B 16K GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
Yarn Llama 2 13B 128K GPTQ128K / 7.3 GB3016
LongAlign 13B 64K GPTQ64K / 7.3 GB51
...boros L2 13B 2 1 YaRN 64K GPTQ64K / 7.3 GB63
Yarn Llama 2 13B 64K GPTQ64K / 7.3 GB201
OrcaMaid V3 13B 32K GPTQ32K / 7.3 GB133
OrcaMaid V2 FIX 13B 32K GPTQ32K / 7.3 GB124
EverythingLM 13B 16K GPTQ16K / 7.3 GB7014
LlongOrca 13B 16K GPT16K / 7.3 GB50
Tinybra 13B GPTQ 32g 4BIT16K / 8 GB31
Tinybra 13B GPTQ 4BIT16K / 7 GB50
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/LlongOrca-13B-16K-GPTQ.