LLM EXPLORER 59,516 MODELS INDEXED

Self Correct Mistral Small It MMQA DPO Iter3 by RyanYr

By RyanYr · 5 downloads

Self Correct Mistral Small It MMQA DPO Iter3 is an open-source language model by RyanYr. Features: 22.2b LLM, VRAM: 44.7GB, Context: 32K, LLM Explorer Score: 0.15.

  Arxiv:2305.18290   Autotrain compatible Base model:finetune:ryanyr/sel... Base model:ryanyr/self-correct...   Conversational   Dpo   Endpoints compatible   Generated from trainer   Mistral   Region:us   Safetensors   Sharded   Tensorflow   Trl

Self Correct Mistral Small It MMQA DPO Iter3 Parameters and Internals

LLM NameSelf Correct Mistral Small It MMQA DPO Iter3
Repository πŸ€—https://huggingface.co/RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter3 
Model Nameself-correct_mistral-small-it_mMQA_dpo_iter3
Base Model(s)  ...istral Small It MMQA DPO Iter2   RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter2
Model Size22.2b
Required VRAM44.7 GB
Updated2025-09-23
MaintainerRyanYr
Model Typemistral
Model Files  4.9 GB: 1-of-9   5.0 GB: 2-of-9   5.0 GB: 3-of-9   4.9 GB: 4-of-9   5.0 GB: 5-of-9   5.0 GB: 6-of-9   4.9 GB: 7-of-9   5.0 GB: 8-of-9   5.0 GB: 9-of-9   0.0 GB
Model ArchitectureMistralForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.45.2
Tokenizer ClassLlamaTokenizer
Padding Token[PAD]
Vocabulary Size32769
Torch Data Typebfloat16

Best Alternatives to Self Correct Mistral Small It MMQA DPO Iter3

Best Alternatives
Context / RAM
Downloads
Likes
Mistral Small Instruct 2409128K / 44.7 GB328
Mistral Small NovusKyver128K / 44.7 GB24
WizardLM 2 22B RP64K / 44.7 GB95
Dolphin 2.9.1 Mistral 22B64K / 44.7 GB22
...Iteration Kto 300sm 3ep Merged32K / 44.7 GB80
...ct MistralSmallit Mg DPO Iter232K / 44.7 GB520
...lect MistralSmallit MMQA Iter132K / 44.7 GB360
...ct MistralSmallit Mg DPO Iter132K / 60.8 GB380
...istral Small It MMQA DPO Iter532K / 44.7 GB560
...istral Small It MMQA DPO Iter432K / 44.7 GB450
Note: green Score (e.g. "73.2") means that the model is better than RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter3.