LLM EXPLORER 59,420 MODELS INDEXED

Merged 0.2 Expert 0.8 Stack 2x by ontocord

By ontocord · 8 downloads

Merged 0.2 Expert 0.8 Stack 2x is an open-source language model by ontocord. Features: 6.5b LLM, VRAM: 26.1GB, Context: 128K, Merged, LLM Explorer Score: 0.18.

  Merged Model   Arxiv:1910.09700   Conversational   Endpoints compatible   Qwen2   Region:us   Safetensors   Sharded   Tensorflow

Merged 0.2 Expert 0.8 Stack 2x Parameters and Internals

LLM NameMerged 0.2 Expert 0.8 Stack 2x
Repository πŸ€—https://huggingface.co/ontocord/merged_0.2_expert_0.8-stack_2x 
Merged ModelYes
Model Size6.5b
Required VRAM26.1 GB
Updated2026-08-01
Maintainerontocord
Model Typeqwen2
Model Files  4.8 GB: 1-of-6   5.0 GB: 2-of-6   4.9 GB: 3-of-6   5.0 GB: 4-of-6   3.3 GB: 5-of-6   3.1 GB: 6-of-6
Model ArchitectureQwen2ForCausalLM
Context Length131072
Model Max Length131072
Transformers Version4.49.0
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size152064
Torch Data Typefloat32
Errorsreplace