Facebook Opt 125M Qcqa Ub 6 Best For Q Loss is an open-source language model by xformAI. Features: 125m LLM, VRAM: 0.5GB, Context: 2K, License: mit, LLM Explorer Score: 0.15, Arc: 23.3, HellaSwag: 25.6, MMLU: 23.2.
| Model Type |
| |
| Additional Notes |
| |
| Supported Languages |
|
| LLM Name | Facebook Opt 125M Qcqa Ub 6 Best For Q Loss |
| Repository 🤗 | https://huggingface.co/xformAI/facebook-opt-125m-qcqa-ub-6-best-for-q-loss |
| Model Size | 125m |
| Required VRAM | 0.5 GB |
| Updated | 2026-08-01 |
| Maintainer | xformAI |
| Model Type | opt |
| Model Files | |
| Supported Languages | en |
| Model Architecture | OPTForCausalLM |
| License | mit |
| Context Length | 2048 |
| Model Max Length | 2048 |
| Transformers Version | 4.26.1 |
| Tokenizer Class | GPT2Tokenizer |
| Beginning of Sentence Token | </s> |
| End of Sentence Token | </s> |
| Unk Token | </s> |
| Vocabulary Size | 50272 |
| Torch Data Type | float32 |
| Activation Function | relu |
| Errors | replace |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Opt 125M | 2K / 0.3 GB | 9414291 | 252 |
| ...25M Gqa Ub 6 Best For KV Cache | 2K / 0.5 GB | 207 | 0 |
| ...5M Qcqa Ub 6 Best For KV Cache | 2K / 0.5 GB | 58 | 0 |
| Galactica 125M Cot | 2K / 0.5 GB | 5 | 0 |
| Galactica Ref | 2K / 0.5 GB | 5 | 0 |
| Galactica 125M DPO | 2K / 0.5 GB | 7 | 0 |
| Galactica 125M DPO Pos | 2K / 0.5 GB | 5 | 0 |
| BertQA | 2K / 0.5 GB | 5 | 0 |
| BertQA | 2K / 0.5 GB | 5 | 0 |
| Opt 125M Quantized Brevitas | 2K / GB | 6 | 0 |