The model uses Q-LoRA with a configuration of r: 16, alpha: 16, dropout: 0.05 on target modules [q_proj, v_proj, k_proj]. Uses datasets LaMini, Orca, Evol-Instruct for instruction tuning.
Supported Languages
en (full)
Input Output
Input Format:
Modified Alpaca prompt template
Accepted Modalities:
text
Output Format:
Text
Performance Tips:
Use the prescribed prompt template for optimal results