LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

H2o Danube2 1.8B Chat MLX 4bit by ucheog

 »  All LLMs  »  ucheog  »  H2o Danube2 1.8B Chat MLX 4bit   URL Share it on

  4   
  Arxiv:2401.16818   4bit   Autotrain compatible   Conversational   En   Endpoints compatible   Gpt   H2o-llmstudio   Mistral   Quantized   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/ucheog/h2o-danube2-1.8b-chat-MLX-4bit 

H2o Danube2 1.8B Chat MLX 4bit Benchmarks

LLME Score: 0.14801
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
H2o Danube2 1.8B Chat MLX 4bit (ucheog/h2o-danube2-1.8b-chat-MLX-4bit)
🌟 Advertise your project 🚀

H2o Danube2 1.8B Chat MLX 4bit Parameters and Internals

Model Type 
text generation, chatbot
Training Details 
Context Length:
8192
Model Architecture:
Llama 2 adjusted to around 1.8b parameters, using Mistral tokenizer, context length 8192, with 24 layers, each with 32 heads and 8 query groups. n_embd is 2560 with vocab size of 32000.
LLM NameH2o Danube2 1.8B Chat MLX 4bit
Repository 🤗https://huggingface.co/ucheog/h2o-danube2-1.8b-chat-MLX-4bit 
Model Size1.8b
Required VRAM1.1 GB
Updated2025-09-21
Maintainerucheog
Model Typemistral
Model Files  1.1 GB
Supported Languagesen
Quantization Type4bit
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length8192
Model Max Length8192
Transformers Version4.38.2
Padding Token<unk>
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to H2o Danube2 1.8B Chat MLX 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Velara GPTQ32K / 6.3 GB61
Velara AWQ32K / 6.3 GB60
H2o Danube 1.8B Chat16K / 3.7 GB10454
H2o Danube 1.8B Base16K / 3.7 GB10943
Cypher Mini 1.8B16K / 3.7 GB62
H2o Danube 1.8B Sft16K / 3.7 GB9211
PixieZehirNano16K / 3.7 GB100
Cypher CoT 1.8B16K / 3.7 GB61
...1.8B Chat Sft Merge Fourier V116K / 7.3 GB41
H2o Danube2 1.8B Chat8K / 3.7 GB51861
Note: green Score (e.g. "73.2") means that the model is better than ucheog/h2o-danube2-1.8b-chat-MLX-4bit.

Rank the H2o Danube2 1.8B Chat MLX 4bit Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51507 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124
  Support LLM Explorer