LLM EXPLORER 61,652 MODELS INDEXED

Deepseek Llama 8B Baseline Thin Init by hdong0

By hdong0 · 8 downloads

Deepseek Llama 8B Baseline Thin Init is an open-source language model by hdong0. Features: 8b LLM, VRAM: 33.3GB, Context: 128K, LLM Explorer Score: 0.33, ELO: 1439.

  Arxiv:1910.09700   Conversational   Custom code   Endpoints compatible   Llama   Region:us   Safetensors   Sharded   Tensorflow

Deepseek Llama 8B Baseline Thin Init Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Deepseek Llama 8B Baseline Thin Init Parameters and Internals

LLM NameDeepseek Llama 8B Baseline Thin Init
Repository 🤗https://huggingface.co/hdong0/deepseek-Llama-8B-baseline-thin-init 
Model Size8b
Required VRAM33.3 GB
Updated2026-08-04
Maintainerhdong0
Model Typellama
Model Files  5.0 GB: 1-of-7   5.0 GB: 2-of-7   5.0 GB: 3-of-7   5.0 GB: 4-of-7   5.0 GB: 5-of-7   5.0 GB: 6-of-7   3.3 GB: 7-of-7
Model ArchitectureLlamaSeqEndMaskBMForCausalLM
Context Length131072
Model Max Length131072
Transformers Version4.52.0.dev0
Tokenizer ClassLlamaTokenizerFast
Padding Token<|end▁of▁sentence|>
Vocabulary Size128256
Torch Data Typefloat32