LLM EXPLORER 59,420 MODELS INDEXED

Self Reflect MistralSmallit Mg DPO Iter2 by RyanYr

By RyanYr · 52 downloads

Self Reflect MistralSmallit Mg DPO Iter2 is an open-source language model by RyanYr. Features: 22.2b LLM, VRAM: 44.7GB, Context: 32K, LLM Explorer Score: 0.15.

  Arxiv:2305.18290   Autotrain compatible Base model:finetune:ryanyr/sel... Base model:ryanyr/self-reflect...   Conversational   Dpo   Endpoints compatible   Generated from trainer   Mistral   Region:us   Safetensors   Sharded   Tensorflow   Trl

Self Reflect MistralSmallit Mg DPO Iter2 Parameters and Internals

LLM NameSelf Reflect MistralSmallit Mg DPO Iter2
Repository πŸ€—https://huggingface.co/RyanYr/self-reflect_mistralSmallit_mg_dpo_iter2 
Model Nameself-reflect_mistralSmallit_mg_dpo_iter2
Base Model(s)  ...ct MistralSmallit Mg DPO Iter1   RyanYr/self-reflect_mistralSmallit_mg_dpo_iter1
Model Size22.2b
Required VRAM44.7 GB
Updated2024-11-15
MaintainerRyanYr
Model Typemistral
Model Files  4.9 GB: 1-of-9   5.0 GB: 2-of-9   5.0 GB: 3-of-9   4.9 GB: 4-of-9   5.0 GB: 5-of-9   5.0 GB: 6-of-9   4.9 GB: 7-of-9   5.0 GB: 8-of-9   5.0 GB: 9-of-9   0.0 GB
Model ArchitectureMistralForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.45.2
Tokenizer ClassLlamaTokenizer
Padding Token[PAD]
Vocabulary Size32769
Torch Data Typebfloat16

Best Alternatives to Self Reflect MistralSmallit Mg DPO Iter2

Best Alternatives
Context / RAM
Downloads
Likes
Mistral Small Instruct 2409128K / 44.7 GB328
Mistral Small NovusKyver128K / 44.7 GB24
WizardLM 2 22B RP64K / 44.7 GB95
Dolphin 2.9.1 Mistral 22B64K / 44.7 GB22
...Iteration Kto 300sm 3ep Merged32K / 44.7 GB80
...lect MistralSmallit MMQA Iter132K / 44.7 GB360
...ct MistralSmallit Mg DPO Iter132K / 60.8 GB380
...istral Small It MMQA DPO Iter532K / 44.7 GB560
...istral Small It MMQA DPO Iter432K / 44.7 GB450
...istral Small It MMQA DPO Iter232K / 60.8 GB70
Note: green Score (e.g. "73.2") means that the model is better than RyanYr/self-reflect_mistralSmallit_mg_dpo_iter2.