LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

FusionNet 34Bx2 MoE GPTQ by TheBloke

 »  All LLMs  »  TheBloke  »  FusionNet 34Bx2 MoE GPTQ   URL Share it on

  12   
  4-bit Base model:quantized:tomgrc/fu... Base model:tomgrc/fusionnet 34...   Conversational   En   Gptq   Mixtral   Moe   Quantized   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/TheBloke/FusionNet_34Bx2_MoE-GPTQ 

FusionNet 34Bx2 MoE GPTQ Benchmarks

LLME Score: 0.13078
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
FusionNet 34Bx2 MoE GPTQ (TheBloke/FusionNet_34Bx2_MoE-GPTQ)
🌟 Advertise your project 🚀

FusionNet 34Bx2 MoE GPTQ Parameters and Internals

Model Type 
mixtral
Supported Languages 
en (fine-tuned)
Input Output 
Input Format:
[INST] <> {system_message} <> {prompt} [/INST]
LLM NameFusionNet 34Bx2 MoE GPTQ
Repository 🤗https://huggingface.co/TheBloke/FusionNet_34Bx2_MoE-GPTQ 
Model NameFusionNet 34Bx2 MoE
Model CreatorSuqin Zhang
Base Model(s)  FusionNet 34Bx2 MoE   TomGrc/FusionNet_34Bx2_MoE
Model Size60.8b
Required VRAM31.8 GB
Updated2026-01-04
MaintainerTheBloke
Model Typemixtral
Model Files  31.8 GB
Supported Languagesen
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureMixtralForCausalLM
Licensemit
Context Length32768
Model Max Length32768
Transformers Version4.37.0.dev0
Tokenizer ClassLlamaTokenizer
Padding Token<s>
Vocabulary Size64000
Torch Data Typebfloat16

Best Alternatives to FusionNet 34Bx2 MoE GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
Bagel Hermes 2x34b GPTQ195K / 31.8 GB62
...sionNet 34Bx2 MoE V0.1 DPO F16195K / 121.8 GB971415
60B MoE Coder V3195K / 121.8 GB53
Mixtral 34Bx2 MoE 60B195K / 121.9 GB8683111
Yi 34Bx2 MoE 60B DPO195K / 121.8 GB78523
Bagel Hermes 2x34B195K / 121.9 GB8916
Yi 34Bx2 MoE 200K195K / 121.9 GB78832
Yi 34Bx2 MoE 60B195K / 121.9 GB897964
...34Bx2 MoE V0.1 Full Linear DPO195K / 121.8 GB502
FusionNet 34Bx2 MoE V0.1195K / 121.2 GB598
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/FusionNet_34Bx2_MoE-GPTQ.

Rank the FusionNet 34Bx2 MoE GPTQ Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51611 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124
  Support LLM Explorer