OPT 6.7B Nerybus Mix is an open-source language model by KoboldAI. Features: 6.7b LLM, VRAM: 13.7GB, Context: 2K, License: other, LLM Explorer Score: 0.11, Arc: 39.2, HellaSwag: 68.6, MMLU: 24.5, GSM8K: 0.8.
| Additional Notes |
|
| LLM Name | OPT 6.7B Nerybus Mix |
| Repository 🤗 | https://huggingface.co/KoboldAI/OPT-6.7B-Nerybus-Mix |
| Model Size | 6.7b |
| Required VRAM | 13.7 GB |
| Updated | 2026-05-11 |
| Maintainer | KoboldAI |
| Model Type | opt |
| Model Files | |
| Supported Languages | en |
| Model Architecture | OPTForCausalLM |
| License | other |
| Context Length | 2048 |
| Model Max Length | 2048 |
| Transformers Version | 4.24.0 |
| Tokenizer Class | GPT2Tokenizer |
| Beginning of Sentence Token | </s> |
| End of Sentence Token | </s> |
| Unk Token | </s> |
| Vocabulary Size | 50265 |
| Torch Data Type | float16 |
| Activation Function | relu |
| Errors | replace |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| ....7B Qcqa Ub 16 Best For Q Loss | 2K / 27.4 GB | 851 | 0 |
| ...B Qcqa Ub 16 Best For KV Cache | 2K / 27.4 GB | 840 | 0 |
| ...7B Gqa Ub 16 Best For KV Cache | 2K / 27.4 GB | 865 | 0 |
| Galactica 6.7B ReFT GSM8k | 2K / 13.8 GB | 911 | 0 |
| Galactica 6.7B EssayWriter | 2K / 13.4 GB | 196 | 5 |
| Opt Flan Iml 6.7B | 2K / 26.6 GB | 1014 | 1 |
| ...lactica 6.7B Evol Instruct 70K | 2K / 27.4 GB | 959 | 19 |
| Galactica 6.7B Finetuned | 2K / 27.4 GB | 2734 | 34 |
| Opt 6.7B | 2K / 13.4 GB | 33215 | 119 |
| OPT 6.7B Erebus | 2K / 13.3 GB | 1759 | 99 |
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟