LLM EXPLORER 65,121 MODELS INDEXED

Boundary Solar Chat 2x10.7B MoE by NotAiLOL

By NotAiLOL · 123 downloads
HF Repo ↗ Copy URL

Boundary Solar Chat 2x10.7B MoE is an open-source language model by NotAiLOL. Features: 19.2b LLM, VRAM: 38GB, Context: 4K, License: apache-2.0, MoE, Instruction-Based, LLM Explorer Score: 0.12.

  Autotrain compatible Base model:merge:nousresearch/... Base model:merge:upstage/solar... Base model:nousresearch/nous-h... Base model:upstage/solar-10.7b...   Conversational   Endpoints compatible   Instruct   Llama   Merge   Mergekit   Mixtral   Moe Nousresearch/nous-hermes-2-sol...   Region:us   Safetensors   Sharded   Tensorflow Upstage/solar-10.7b-instruct-v...
Model Card on HF 🤗: https://huggingface.co/NotAiLOL/Boundary-Solar-Chat-2x10.7B-MoE 

Boundary Solar Chat 2x10.7B MoE Parameters and Internals

LLM NameBoundary Solar Chat 2x10.7B MoE
Repository 🤗https://huggingface.co/NotAiLOL/Boundary-Solar-Chat-2x10.7B-MoE 
Base Model(s)  NousResearch/Nous-Hermes-2-SOLAR-10.7B   upstage/SOLAR-10.7B-Instruct-v1.0   NousResearch/Nous-Hermes-2-SOLAR-10.7B   upstage/SOLAR-10.7B-Instruct-v1.0
Model Size19.2b
Required VRAM38 GB
Updated2024-08-10
MaintainerNotAiLOL
Model Typemixtral
Instruction-BasedYes
Model Files  4.0 GB: 1-of-10   3.9 GB: 2-of-10   3.9 GB: 3-of-10   3.9 GB: 4-of-10   3.9 GB: 5-of-10   3.9 GB: 6-of-10   3.9 GB: 7-of-10   3.9 GB: 8-of-10   3.9 GB: 9-of-10   2.8 GB: 10-of-10
Model ArchitectureMixtralForCausalLM
Licenseapache-2.0
Context Length4096
Model Max Length4096
Transformers Version4.39.3
Tokenizer ClassLlamaTokenizer
Padding Token<s>
Vocabulary Size32002
Torch Data Typefloat16

Best Alternatives to Boundary Solar Chat 2x10.7B MoE

Best Alternatives
Context / RAM
Downloads
Likes
Raccoon Small32K / 38.4 GB601
SOLAR Math 2x10.7B V0.24K / 38.4 GB2124