LLM EXPLORER 63,407 MODELS INDEXED

Barely Regal 10.7B by sydonayrex

By sydonayrex · 19 downloads

Barely Regal 10.7B is an open-source language model by sydonayrex. Features: 10.7b LLM, VRAM: 21.5GB, Context: 32K, License: apache-2.0, LLM Explorer Score: 0.12.

  Autotrain compatible Base model:finetune:sydonayrex... Base model:sydonayrex/ai-m3-10...   Conversational   En   Endpoints compatible   Mistral   Region:us   Safetensors   Sharded   Tensorflow   Trl   Unsloth

Barely Regal 10.7B Parameters and Internals

Model Type 
text generation
Training Details 
Methodology:
Layer merging and fine-tuning using SFT and further training with DPO or ORPO
Model Architecture:
Supersized using task arithmetic and fine-tuned with Unsloth
LLM NameBarely Regal 10.7B
Repository πŸ€—https://huggingface.co/sydonayrex/Barely-Regal-10.7B 
Base Model(s)  sydonayrex/AI-M3-10.7Bv2   sydonayrex/AI-M3-10.7Bv2
Model Size10.7b
Required VRAM21.5 GB
Updated2024-12-13
Maintainersydonayrex
Model Typemistral
Model Files  5.0 GB: 1-of-5   5.0 GB: 2-of-5   4.9 GB: 3-of-5   4.9 GB: 4-of-5   1.7 GB: 5-of-5
Supported Languagesen
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.41.2
Tokenizer ClassLlamaTokenizer
Padding Token[control_768]
Vocabulary Size32768
Torch Data Typebfloat16

Best Alternatives to Barely Regal 10.7B

Best Alternatives
Context / RAM
Downloads
Likes
Quintellect 10.7B32K / 21.4 GB223
Chikuma 10.7B32K / 21.4 GB1315
PiVoT 10.7B Mistral V0.232K / 21.4 GB765
Longcat 10.7B32K / 21.5 GB83
Multi Verse Model 10.7B32K / 21.5 GB21
PrimaSumika 10.7B 128K32K / 21.5 GB31
... Loyal Mistral Maid 32K V0.2 A32K / 21.5 GB31
Chikuma 10.7B V232K / 21.4 GB100
PiVoT 10.7B Mistral V0.2 RP32K / 21.4 GB677
Mark1 Revision 10.7B32K / 42.9 GB161