Guanaco 7B Leh V2 is an open-source language model by KBlueLeaf. Features: 7b LLM, VRAM: 13.6GB, License: gpl-3.0, Fine-Tuned, LLM Explorer Score: 0.09.
trained with lora, embed_tokens, lm_head on bf16, with batch size increased and longer context length. Training emphasized on output with loss masking and group of len enabled.
Context Length:
1024
Training Time:
2 epochs (~8400 steps)
Hardware Used:
2x3090 GPUs
Input Output
Input Format:
Instruction-based prompt format as detailed with specific sections for Instruction, Input, User, System, and Response.
Accepted Modalities:
text
Output Format:
Multilingual text output.
Performance Tips:
Remove the first line of the original prompt to reduce token consumption.
Note: green Score (e.g. "73.2") means that the model is better than KBlueLeaf/guanaco-7b-leh-v2.
Rank the Guanaco 7B Leh V2 Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
What open-source LLMs or SLMs are you in search of? 53089 in total.