Cria Llama2 7B V1.3 Peft is an open-source language model by davzoku. Features: 7b LLM, VRAM: 0.1GB, License: llama2, Code Generating, LLM Explorer Score: 0.11, Arc: 51.5, HellaSwag: 77.4, MMLU: 46.5, GSM8K: 6.8.
Cria Llama2 7B V1.3 Peft Parameters and Internals
| Model Type | |
| Additional Notes | | The model serves as the backbone for the CRIA chat platform, offering rapid prototyping of an intelligent app using open-source resources. |
|
| Training Details |
| Data Sources: | |
| Methodology: | | fine-tuned with QLoRA (4-bit precision) |
|
| Hardware Used: | | Google Colab T4 GPU, high RAM |
|
|
| Release Notes |
| Version: | |
| Notes: | | CRIA v1.3 comes with several variants. The model has been fine-tuned with QLoRA and uses the mlabonne/CodeLlama-2-20k dataset. |
|
|
|
Best Alternatives to Cria Llama2 7B V1.3 Peft
Note: green Score (e.g. "73.2") means that the model is better than davzoku/cria-llama2-7b-v1.3_peft.