LLM EXPLORER 58,297 MODELS INDEXED

Phi 1 5 Qlora Alpaca Instruction by nps798

By nps798 · 7 downloads

Phi 1 5 Qlora Alpaca Instruction is an open-source language model by nps798. Features: 1.4b LLM, VRAM: 5.7GB, License: other, Instruction-Based, LLM Explorer Score: 0.09.

  Custom code   Dataset:vicgalle/alpaca-gpt4   En   Instruct   Mixformer-sequential   Region:us   Safetensors   Sharded   Tensorflow

Phi 1 5 Qlora Alpaca Instruction Parameters and Internals

Model Type 
causal language model
Training Details 
Data Sources:
vicgalle/alpaca-gpt4
Methodology:
Fine-tuning using QLORA technology
Context Length:
2048
Training Time:
14 hours
Hardware Used:
NVIDIA 3090ti
LLM NamePhi 1 5 Qlora Alpaca Instruction
Repository πŸ€—https://huggingface.co/nps798/phi-1_5-qlora-alpaca-instruction 
Model Size1.4b
Required VRAM5.7 GB
Updated2026-08-07
Maintainernps798
Model Typemixformer-sequential
Instruction-BasedYes
Model Files  2.0 GB: 1-of-3   1.9 GB: 2-of-3   1.8 GB: 3-of-3
Supported Languagesen
Model ArchitectureMixFormerSequentialForCausalLM
Licenseother
Model Max Length2048
Transformers Version4.30.0
Tokenizer ClassCodeGenTokenizer
Vocabulary Size51200
Torch Data Typefloat32
Activation Functiongelu_new