LLM EXPLORER 64,811 MODELS INDEXED

H2o Lightning 4B Mlx Q8 by netprojects

By netprojects · 158 downloads
HF Repo ↗ Copy URL

H2o Lightning 4B Mlx Q8 is an open-source language model by netprojects. Features: 4b LLM, VRAM: 5.1GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.31.

  8-bit   Apple-silicon Base model:h2oai/h2o-lightning... Base model:quantized:h2oai/h2o...   Calibration   Conversational   Decision-making   Decision-model   Image-text-to-text   Jevbench   Mlx   Q8   Quantized   Qwen3 5   Region:us   Safetensors
Model Card on HF 🤗: https://huggingface.co/netprojects/h2o-lightning-4b-mlx-q8 

H2o Lightning 4B Mlx Q8 Parameters and Internals

LLM NameH2o Lightning 4B Mlx Q8
Repository 🤗https://huggingface.co/netprojects/h2o-lightning-4b-mlx-q8 
Base Model(s)  H2o Lightning 4B   h2oai/h2o-lightning-4b
Model Size4b
Required VRAM5.1 GB
Updated2026-10-17
Maintainernetprojects
Model Typeqwen3_5
Model Files  5.1 GB
Quantization Typeq8
Model ArchitectureQwen3_5ForConditionalGeneration
Licenseapache-2.0
Model Max Length262144
Transformers Version4.57.0.dev0
Tokenizer ClassQwen3_5Tokenizer
Padding Token<|endoftext|>
Errorsreplace

Best Alternatives to H2o Lightning 4B Mlx Q8

Best Alternatives
Context / RAM
Downloads
Likes
Underdog Woof 4B 1.10K / 2.4 GB189223
H2o Lightning 4B Mlx Q40K / 3 GB951
Qwen3.5 4B MLX 4bit0K / 3 GB2802332
LightOnOCR 3 4B 4bit0K / 3 GB1191
Loopl 4B 4bit0K / 3 GB1701
Sbzhanzhang0K / 2.4 GB1331
Qwen3.5 4B OptiQ 4bit0K / 0.1 GB782323
Qwen3.5 4B 4bit Abliterated0K / 3 GB851
Fara1.5 4B OptiQ 4bit0K / 3.5 GB2152
Qwen3.5 4B OQ4e FP16 MTP MLX0K / 3.3 GB421
Note: green Score (e.g. "73.2") means that the model is better than netprojects/h2o-lightning-4b-mlx-q8.