LLM EXPLORER 60,645 MODELS INDEXED

Self Reflect MistralSmallit Mg DPO Iter1 by RyanYr

By RyanYr · 38 downloads

Self Reflect MistralSmallit Mg DPO Iter1 is an open-source language model by RyanYr. Features: 22.2b LLM, VRAM: 60.8GB, Context: 32K, Instruction-Based, LLM Explorer Score: 0.15.

  Arxiv:2305.18290   Autotrain compatible Base model:finetune:mistralai/... Base model:mistralai/mistral-s...   Conversational   Dpo   Endpoints compatible   Generated from trainer   Instruct   Mistral   Region:us   Safetensors   Sharded   Tensorflow   Trl

Self Reflect MistralSmallit Mg DPO Iter1 Parameters and Internals

LLM NameSelf Reflect MistralSmallit Mg DPO Iter1
Repository πŸ€—https://huggingface.co/RyanYr/self-reflect_mistralSmallit_mg_dpo_iter1 
Model NameMistral-Small-Instruct-2409_mg_dpo_iter1
Base Model(s)  Mistral Small Instruct 2409   mistralai/Mistral-Small-Instruct-2409
Model Size22.2b
Required VRAM60.8 GB
Updated2024-11-15
MaintainerRyanYr
Model Typemistral
Instruction-BasedYes
Model Files  5.0 GB: 1-of-4   4.9 GB: 1-of-9   5.0 GB: 2-of-4   5.0 GB: 2-of-9   5.0 GB: 3-of-4   5.0 GB: 3-of-9   1.1 GB: 4-of-4   4.9 GB: 4-of-9   5.0 GB: 5-of-9   5.0 GB: 6-of-9   4.9 GB: 7-of-9   5.0 GB: 8-of-9   5.0 GB: 9-of-9   0.0 GB
Model ArchitectureMistralForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.45.2
Tokenizer ClassLlamaTokenizer
Padding Token[PAD]
Vocabulary Size32769
Torch Data Typebfloat16

Best Alternatives to Self Reflect MistralSmallit Mg DPO Iter1

Best Alternatives
Context / RAM
Downloads
Likes
Mistral Small Instruct 2409128K / 44.7 GB328
...lect MistralSmallit MMQA Iter132K / 44.7 GB360
MS Sunfall V0.7.032K / 44.7 GB312
...istral Small It MMQA DPO Iter132K / 44.7 GB50
...mall Instruct 2409 Abliterated32K / 44.7 GB104
MistralSmall1500CTXDummy32K / 44.7 GB140
MistralSmall1500CTX32K / 44.7 GB130
Note: green Score (e.g. "73.2") means that the model is better than RyanYr/self-reflect_mistralSmallit_mg_dpo_iter1.