LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

DeciLM 7B by Deci

 »  All LLMs  »  Deci  »  DeciLM 7B   URL Share it on

  5290   
  Autotrain compatible   Conversational   Custom code   Deci   En   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/Deci/DeciLM-7B 

DeciLM 7B Benchmarks

MMLU Pro: 18.8
GPQA: 6.04
MUSR: 13.05
BBH: 21.25
IFEval: 28.13 vs 88 (so35)-68%
ARC: 59.39 vs 96.7 (so35)-38.6%
HellaSwag: 82.51 vs 95.3 (gpt4)-13.4%
MMLU: 59.76 vs 88.3 (so35)-32.3%
TruthfulQA: 40.33 vs 59 (gpt4)-31.6%
WinoGrande: 79.95 vs 87.5 (gpt4)-8.6%
GSM8K: 47.38 vs 96.4 (so35)-50.9%
MATH Lvl 5: 2.87
LLME Score: 0.23205
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
DeciLM 7B (Deci/DeciLM-7B)
🌟 Advertise your project 🚀

DeciLM 7B Parameters and Internals

Model Type 
decoder-only, text generation
Use Cases 
Areas:
commercial, research
Limitations:
The model's testing has primarily been in English, and it may not work well in other languages., There's a risk of generating inaccurate, biased, or objectionable content.
Considerations:
Thorough safety testing and tuning are recommended before deployment.
Supported Languages 
en (high)
Training Details 
Methodology:
The model's architecture was generated using Deci's proprietary Neural Architecture Search technology, AutoNAC.
Context Length:
8192
Model Architecture:
Optimized transformer decoder architecture with variable Grouped-Query Attention.
Responsible Ai Considerations 
Transparency:
The outputs of DeciLM-7B are unpredictable and may be inaccurate, biased, or objectionable.
LLM NameDeciLM 7B
Repository 🤗https://huggingface.co/Deci/DeciLM-7B 
Model Size7b
Required VRAM14.1 GB
Updated2025-09-23
MaintainerDeci
Model Typedeci
Model Files  5.0 GB: 1-of-3   4.9 GB: 2-of-3   4.2 GB: 3-of-3
Supported Languagesen
Model ArchitectureDeciLMForCausalLM
Licenseapache-2.0
Context Length8192
Model Max Length8192
Transformers Version4.35.2
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typebfloat16

Quantized Models of the DeciLM 7B

Model
Likes
Downloads
VRAM
DeciLM 7B GPTQ144 GB

Best Alternatives to DeciLM 7B

Best Alternatives
Context / RAM
Downloads
Likes
DeciLM 7B Instruct 128K128K / 14.1 GB53
DeciLM 7B Instruct 32K32K / 14.1 GB63
DeciLM 7B Instruct8K / 14.1 GB262395
DeciLM Base ChatTuned Blogv0.28K / 14.1 GB91
M128K / 14.1 GB60
M118K / 14.1 GB50
M108K / 14.1 GB60
M98K / 14.1 GB90
M88K / 14.1 GB50
M78K / 14.1 GB50

Rank the DeciLM 7B Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51544 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124
  Support LLM Explorer