LLM EXPLORER 56,604 MODELS INDEXED

Nomi 2 GGUF by JallyAI

By JallyAI · 755 downloads
HF Repo ↗ Copy URL

Nomi 2 GGUF is an open-source language model by JallyAI. Features: 4b LLM, VRAM: 0.7GB, License: apache-2.0, Quantized.

  Base model:jallyai/nomi-2 Base model:quantized:jallyai/n...   Conversational   Efficient   Endpoints compatible   Gguf   Image-text-to-text   Lazyloopstudio   Nomi   Nomi2   Quantized   Qwen   Qwen3.5   Qwen3 5   Region:us   Unsloth
Model Card on HF 🤗: https://huggingface.co/JallyAI/Nomi-2-GGUF 

Nomi 2 GGUF Parameters and Internals

LLM NameNomi 2 GGUF
Repository 🤗https://huggingface.co/JallyAI/Nomi-2-GGUF 
Model Nameunsloth/Qwen3.5-4B
Base Model(s)  Nomi 2   JallyAI/Nomi-2
Model Size4b
Required VRAM0.7 GB
Updated2026-08-09
MaintainerJallyAI
Model Typeqwen3_5
Model Files  0.7 GB   2.0 GB   2.3 GB   2.8 GB   3.6 GB   4.6 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureQwen3_5ForConditionalGeneration
Licenseapache-2.0
Torch Data Typefloat16

Best Alternatives to Nomi 2 GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Peacock Tiny 4B Gguf0K / 0.7 GB2611
Qwen3.5 4B MLX 4bit0K / 3 GB2802332
Qwen3.5 4B OptiQ 4bit0K / 0.1 GB782323
...aude 4.6 Opus Abliterated 4bit0K / 3 GB5165
...aude 4.6 Opus Abliterated 6bit0K / 4.1 GB1883
Qwen3.5 4B Mlx 4bit0K / 2.4 GB163
Qwopus3.5 4B V3 4bit0K / 3 GB351
NuExtract30K / 0.2 GB441570324
Qwen3.5 4B AWQ 4bit0K / 4 GB73891718
JOSIE 2 4B Preview0K / 9.3 GB73320
Note: green Score (e.g. "73.2") means that the model is better than JallyAI/Nomi-2-GGUF.