What are the hardware requirements for Llama 2 70B Guanaco Qlora?

Llama 2 70B Guanaco Qlora requires approximately 1.7 GB of VRAM. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Llama 2 70B Guanaco Qlora and how large is it?

Llama 2 70B Guanaco Qlora is developed by Mikael110, a model with 70b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Llama 2 70B Guanaco Qlora?

Llama 2 70B Guanaco Qlora is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Llama 2 70B Guanaco Qlora by Mikael110 — VRAM 1.7GB

Name: Llama 2 70B Guanaco Qlora
Author: Mikael110

Llama 2 70B Guanaco Qlora is an open-source language model by Mikael110. Features: 70b LLM, VRAM: 1.7GB, LLM Explorer Score: 0.08.

Adapter En Finetuned Llama2 Lora Region:us

Model Card on HF 🤗: https://huggingface.co/Mikael110/llama-2-70b-guanaco-qlora

Llama 2 70B Guanaco Qlora Benchmarks

LLME Score: 0.08291

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Llama 2 70B Guanaco Qlora (Mikael110/llama-2-70b-guanaco-qlora)

🌟 Advertise your project 🚀

Llama 2 70B Guanaco Qlora Parameters and Internals

Model Type

text classification

Additional Notes

This repo contains the QLoRA adapter. A 7b version of the adapter can be found [here](https://huggingface.co/Mikael110/llama-2-7b-guanaco-qlora). A 13b version of the adapter can be found [here](https://huggingface.co/Mikael110/llama-2-13b-guanaco-qlora).

Training Details

Methodology:

Finetuned using QLoRA

LLM Name	Llama 2 70B Guanaco Qlora
Repository 🤗	https://huggingface.co/Mikael110/llama-2-70b-guanaco-qlora
Model Size	70b
Required VRAM	1.7 GB
Updated	2026-04-03
Maintainer	Mikael110
Model Files	1.7 GB
Supported Languages	en
Model Architecture	Adapter
Is Biased	none
PEFT Type	LORA
LoRA Model	Yes
PEFT Target Modules	down_proj\|k_proj\|up_proj\|gate_proj\|o_proj\|q_proj\|v_proj
LoRA Alpha	16
LoRA Dropout	0.05
R Param	64

Quantized Models of the Llama 2 70B Guanaco Qlora

Model	Likes	Downloads	VRAM
Llama 2 70B Guanaco QLoRA GGUF	0	12	29 GB
Llama 2 70B Guanaco QLoRA AWQ	0	7	36 GB
Llama 2 70B Guanaco QLoRA GGUF	5	139	29 GB
Llama 2 70B Guanaco QLoRA GPTQ	37	20	36 GB
Llama 2 70B Guanaco QLoRA GGML	19	9	28 GB

Best Alternatives to Llama 2 70B Guanaco Qlora

Best Alternatives	Context / RAM	Downloads	Likes
Llama 3.1 70B Abliterated Lora	0K / 1.7 GB	854	4
...aiga Llama3 70b Sft M1 D5 Lora	0K / 5.9 GB	0	1
Llama 3 70B Instruct Spider	0K / 141.9 GB	6	0
Airoboros 70B 3.3 Peft	0K / 0.4 GB	0	2
Llama3v1	0K / 0.1 GB	5	0
Xwin LM 70B V0.1 LORA	0K / 1.7 GB	5	1
Euryale 1.3 L2 70B LORA	0K / 1.7 GB	6	1
Miqu 1 70B Hermes2.5 Qlora	0K / 4.8 GB	7	4
Limarp Miqu 1 70B Qlora	0K / 1.7 GB	5	4
Miqu Limarp 70B DPO Safefile	0K / 38.4 GB	5	1

Note: green Score (e.g. "73.2") means that the model is better than Mikael110/llama-2-70b-guanaco-qlora.

Rank the Llama 2 70B Guanaco Qlora Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 53999 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Check out Ag3ntum — our secure, self-hosted AI agent for server management.

Release v20260328a

Support LLM Explorer

Llama 2 70B Guanaco Qlora by Mikael110