LLM EXPLORER 59,420 MODELS INDEXED

L3 ChaoticSoliloquy V2 4x8B Test 8bpw H8 EXL2 by JayhC

By JayhC · 5 downloads
HF Repo ↗ Copy URL

L3 ChaoticSoliloquy V2 4x8B Test 8bpw H8 EXL2 is an open-source language model by JayhC. Features: 8b LLM, VRAM: 24.9GB, Context: 8K, License: llama3, MoE, Quantized, LLM Explorer Score: 0.12.

  8-bit   Conversational   En   Endpoints compatible   Exl2   Mixtral   Moe   Quantized   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/JayhC/L3-ChaoticSoliloquy-v2-4x8B-test-8bpw-h8-exl2 

L3 ChaoticSoliloquy V2 4x8B Test 8bpw H8 EXL2 Parameters and Internals

Model Type 
moe
Supported Languages 
en (unknown)
Input Output 
Input Format:
Prompt format: Llama 3
LLM NameL3 ChaoticSoliloquy V2 4x8B Test 8bpw H8 EXL2
Repository 🤗https://huggingface.co/JayhC/L3-ChaoticSoliloquy-v2-4x8B-test-8bpw-h8-exl2 
Model Size8b
Required VRAM24.9 GB
Updated2026-08-02
MaintainerJayhC
Model Typemixtral
Model Files  8.6 GB: 1-of-3   8.6 GB: 2-of-3   7.7 GB: 3-of-3
Supported Languagesen
Quantization Typeexl2
Model ArchitectureMixtralForCausalLM
Licensellama3
Context Length8192
Model Max Length8192
Transformers Version4.37.2
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|begin_of_text|>
Vocabulary Size128256
Torch Data Typebfloat16

Best Alternatives to L3 ChaoticSoliloquy V2 4x8B Test 8bpw H8 EXL2

Best Alternatives
Context / RAM
Downloads
Likes
...Storm V1.15 4x8B B 8 0bpw EXL28K / 25.2 GB60
... SnowStorm 4x8B 6.5bpw H8 EXL28K / 21 GB52
L3 SnowStorm 4x8B 8bpw H8 EXL28K / 25.2 GB61
...liloquy V1.5 4x8B 8bpw H8 EXL28K / 25.3 GB102
...loquy V1.5 4x8B 6.5bpw H8 EXL28K / 21 GB62
...oquy 4x8B Bpw600 H6 EXL2 Rpcal8K / 19.4 GB52
...oquy 4x8B Bpw500 H6 EXL2 Rpcal8K / 16.4 GB41
...ticSoliloquy 4x8B 8bpw H8 EXL28K / 25.3 GB63
...oquy 4x8B Bpw800 H8 EXL2 Rpcal8K / 25.3 GB01
...ticSoliloquy 4x8B 6bpw H6 EXL28K / 19.4 GB23
Note: green Score (e.g. "73.2") means that the model is better than JayhC/L3-ChaoticSoliloquy-v2-4x8B-test-8bpw-h8-exl2.