LLM EXPLORER 63,407 MODELS INDEXED

Llama 2 13B 4bit Alpaca Gpt4 by TFLai

By TFLai · 1 downloads

Llama 2 13B 4bit Alpaca Gpt4 is an open-source language model by TFLai. Features: 13b LLM, Quantized, LLM Explorer Score: 0.08.

  4bit   Adapter   Dataset:vicgalle/alpaca-gpt4   Finetuned   Lora   Peft   Quantized   Region:us

Llama 2 13B 4bit Alpaca Gpt4 Parameters and Internals

Additional Notes 
The training procedure utilized `bitsandbytes` quantization configurations, specifically set to use 4-bit quantization with the `bnb_4bit_quant_type` as `nf4`, `bnb_4bit_use_double_quant` enabled, and bfloat16 as `bnb_4bit_compute_dtype`. The `PEFT` framework version used was 0.5.0.dev0.
Training Details 
Data Sources:
vicgalle/alpaca-gpt4
Methodology:
The model was trained using bitsandbytes quantization with specific configuration settings.
LLM NameLlama 2 13B 4bit Alpaca Gpt4
Repository πŸ€—https://huggingface.co/TFLai/llama-2-13b-4bit-alpaca-gpt4 
Model Size13b
Required VRAM0 GB
Updated2026-07-19
MaintainerTFLai
Model Files  0.0 GB
Quantization Type4bit
Model ArchitectureAdapter
Is Biasednone
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesq_proj|v_proj
LoRA Alpha32
LoRA Dropout0.05
R Param8

Best Alternatives to Llama 2 13B 4bit Alpaca Gpt4

Best Alternatives
Context / RAM
Downloads
Likes
Storytelling V2 13B Lora0K / 0.5 GB87
Lmg V3 Lora0K / 0.5 GB42
Storytelling V1 13B Lora0K / 0.5 GB77
Minotaur Llama2 13B Qlora0K / 1 GB124
Minotaur Llama2 13B Qlora0K / 1 GB34
Llama 13B 4bit Alpaca0K / 0.1 GB21
Alpaca Lora 13B 4bit0K / 0 GB01
Alpaca1337 13B 4bit0K / 0 GB04
Kimiko 13B0K / 0.1 GB030
Alpaca 13B Lora0K / 0.1 GB013
Note: green Score (e.g. "73.2") means that the model is better than TFLai/llama-2-13b-4bit-alpaca-gpt4.