LLM EXPLORER 63,407 MODELS INDEXED

Llama 2 70B Guanaco QLoRA GGML by TheBloke

By TheBloke · 2 downloads

Llama 2 70B Guanaco QLoRA GGML is an open-source language model by TheBloke. Features: 70b LLM, VRAM: 28.6GB, License: llama2, Quantized, LLM Explorer Score: 0.08.

Base model:finetune:mikael110/... Base model:mikael110/llama-2-7...   En   Ggml   Llama   Llama2   Quantized   Region:us

Llama 2 70B Guanaco QLoRA GGML Parameters and Internals

Model Type 
llama
LLM NameLlama 2 70B Guanaco QLoRA GGML
Repository πŸ€—https://huggingface.co/TheBloke/llama-2-70b-Guanaco-QLoRA-GGML 
Model NameLlama2 70B Guanaco QLoRA
Model CreatorMikael110
Base Model(s)  Llama 2 70B Guanaco Qlora   Mikael110/llama-2-70b-guanaco-qlora
Model Size70b
Required VRAM28.6 GB
Updated2026-08-01
MaintainerTheBloke
Model Typellama
Model Files  28.6 GB   36.1 GB   33.0 GB   29.7 GB   38.9 GB   43.2 GB   41.4 GB   38.9 GB   47.5 GB   48.8 GB   47.5 GB
Supported Languagesen
GGML QuantizationYes
Quantization Typeggml
Model ArchitectureAutoModel
Licensellama2

Best Alternatives to Llama 2 70B Guanaco QLoRA GGML

Best Alternatives
Context / RAM
Downloads
Likes
Synthia 70B V1.1 GGML0K / 28.6 GB34
Llama 2 70B Chat GGML0K / 28.6 GB10161
...boros L2 70B 2.1 Creative GGML0K / 28.6 GB43
...iction.live Kimiko V2 70B GGML0K / 28.6 GB82
Lemur 70B Chat V1 GGML0K / 29 GB43
Model 007 70B GGML0K / 28.6 GB61
Airoboros L2 70B 2.1 GGML0K / 28.6 GB62
Nous Hermes Llama2 70B GGML0K / 29 GB413
Llama 2 70B Orca 200K GGML0K / 28.6 GB73
Genz 70B GGML0K / 28.6 GB63
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/llama-2-70b-Guanaco-QLoRA-GGML.