BioMistral 7B DARE is an open-source language model by BioMistral. Features: 7b LLM, VRAM: 14.4GB, Context: 32K, License: apache-2.0, Instruction-Based, Merged, LLM Explorer Score: 0.14, Arc: 58.3, HellaSwag: 79.9, MMLU: 57.3, GSM8K: 15.
BioMistral 7B DARE Parameters and Internals
| Model Type | |
| Use Cases |
| Areas: | |
| Applications: | | biomedical research, text generation |
|
| Primary Use Cases: | | medical question-answering, multilingual evaluation |
|
| Limitations: | | Not suitable for professional medical advice, Potential biases and ethical issues |
|
| Considerations: | | Users need to be aware of biases and test extensively before use in critical scenarios. |
|
|
| Additional Notes | | The model and its evaluation benchmarks are freely available for research purposes. |
|
| Supported Languages | | en (English), fr (French), nl (Dutch), es (Spanish), it (Italian), pl (Polish), ro (Romanian), de (German) |
|
| Training Details |
| Data Sources: | |
| Methodology: | | DARE (using TIES merge method) on base model Mistral-7B-Instruct-v0.1 |
|
| Context Length: | |
| Hardware Used: | |
| Model Architecture: | | Mistral-based architecture |
|
|
| Responsible Ai Considerations |
| Fairness: | |
| Transparency: | | Requires user caution due to potential biases |
|
| Accountability: | | Developers emphasize research use over production use |
|
| Mitigation Strategies: | | Advised testing in random controlled trials for medical applications |
|
|
| Input Output |
| Input Format: | |
| Accepted Modalities: | |
| Output Format: | |
|
Quantized Models of the BioMistral 7B DARE
Best Alternatives to BioMistral 7B DARE
Note: green Score (e.g. "73.2") means that the model is better than BioMistral/BioMistral-7B-DARE.