M8x7b Final Vision Adaptee by kloodia

 ยป  All LLMs  ยป  kloodia  ยป  M8x7b Final Vision Adaptee   URL Share it on

  Adapter Base model:adapter:mistralai/m... Base model:mistralai/mixtral-8...   Finetuned   Instruct   Lora   Mistral-lmm   Moe   Multimodal   Peft   Region:us   Safetensors   Vision

M8x7b Final Vision Adaptee Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
M8x7b Final Vision Adaptee (kloodia/m8x7b-final-vision-adaptee)
๐ŸŒŸ Advertise your project ๐Ÿš€

M8x7b Final Vision Adaptee Parameters and Internals

Model Type 
Causal Language Model, Multimodal
Use Cases 
Areas:
Research, Multimodal applications
Primary Use Cases:
Text and image processing
Training Details 
Data Volume:
558128 examples
Methodology:
LoRA technique used for finetuning
Hardware Used:
NVIDIA A100 80GB PCIe
Model Architecture:
PeftModelForCausalLM built on top of MistralLMMForCausalLM with LoRA layers
Input Output 
Input Format:
CLIPVisionModality (encoded as 576 tokens)
Accepted Modalities:
text, image
LLM NameM8x7b Final Vision Adaptee
Repository ๐Ÿค—https://huggingface.co/kloodia/m8x7b-final-vision-adaptee 
Base Model(s)  mistralai/Mixtral-8x7B-Instruct-v0.1   mistralai/Mixtral-8x7B-Instruct-v0.1
Required VRAM0.1 GB
Updated2025-09-13
Maintainerkloodia
Instruction-BasedYes
Model Files  0.3 GB   0.1 GB
Model ArchitectureAdapter
Licenseapache-2.0
Is Biasednone
PEFT TypeLORA
LoRA ModelYes
PEFT Target Moduleso_proj|up_proj|v_proj|q_proj|k_proj|gate_proj|down_proj
LoRA Alpha16
LoRA Dropout0.05
R Param64

Quantized Models of the M8x7b Final Vision Adaptee

Model
Likes
Downloads
VRAM
...ixtral 8x7B Instruct V0.1 GGUF23726 GB

Best Alternatives to M8x7b Final Vision Adaptee

Best Alternatives
Context / RAM
Downloads
Likes
Phi 3 Mini 4K Instruct Sa V0.10K / 0 GB50
...caaaf043da230d9a30d8e0ddcbe8790K / 0.4 GB110
...357cade9cc1096cecc35c34dba89920K / 1.3 GB100
...ini Instruct MedicalChat QLoRA0K / 0.1 GB02
...mall Physics Finetuned Adapter0K / 0.1 GB61
Mistral Small Dampf Qlora0K / 0.8 GB80
Mistral Small Fujin Qlora0K / 0.8 GB22
Test0K / 0 GB50
Vfgf0K / 0 GB50
Results0K / 0 GB50
Note: green Score (e.g. "73.2") means that the model is better than kloodia/m8x7b-final-vision-adaptee.

Rank the M8x7b Final Vision Adaptee Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51534 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124