Neural Mistral 7B is an open-source language model by Corianas. Features: 7b LLM, VRAM: 14.4GB, Context: 32K, License: apache-2.0, Instruction-Based, LLM Explorer Score: 0.18, Arc: 63.4, HellaSwag: 85.6, MMLU: 60.9, GSM8K: 37.5.
Neural Mistral 7B Parameters and Internals
| Model Type | |
| Use Cases |
| Areas: | |
| Applications: | |
| Primary Use Cases: | |
| Limitations: | |
| Considerations: | |
|
| Additional Notes | |
| Supported Languages | |
| Training Details |
| Data Sources: | |
| Methodology: | | Direct Preference Optimization (DPO) |
|
| Model Architecture: | | Grouped-Query Attention, Sliding-Window Attention, Byte-fallback BPE tokenizer |
|
|
| Input Output |
| Input Format: | | Prompts should be surrounded by [INST] and [/INST] tokens. |
|
|
Best Alternatives to Neural Mistral 7B
Note: green Score (e.g. "73.2") means that the model is better than Corianas/Neural-Mistral-7B.