LLM EXPLORER 67,552 MODELS INDEXED

Nomi 2 GGUF by JallyAI

By JallyAI · 755 downloads

Nomi 2 GGUF is an open-source language model by JallyAI. Features: 4b LLM, VRAM: 0.7GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.27.

  Base model:jallyai/nomi-2 Base model:quantized:jallyai/n...   Conversational   Efficient   Endpoints compatible   Gguf   Image-text-to-text   Lazyloopstudio   Nomi   Nomi2   Quantized   Qwen   Qwen3.5   Qwen3 5   Region:us   Unsloth
Model Card on HF πŸ€—: https://huggingface.co/JallyAI/Nomi-2-GGUF 

Nomi 2 GGUF Parameters and Internals

LLM NameNomi 2 GGUF
Repository πŸ€—https://huggingface.co/JallyAI/Nomi-2-GGUF 
Model Nameunsloth/Qwen3.5-4B
Base Model(s)  Nomi 2   JallyAI/Nomi-2
Model Size4b
Required VRAM0.7 GB
Updated2026-08-09
MaintainerJallyAI
Model Typeqwen3_5
Model Files  0.7 GB   2.0 GB   2.3 GB   2.8 GB   3.6 GB   4.6 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureQwen3_5ForConditionalGeneration
Licenseapache-2.0
Torch Data Typefloat16

Best Alternatives to Nomi 2 GGUF

Best Alternatives
Context / RAM
Downloads
Likes
Qwen3.5 4B 3D Coder0K / 9.1 GB44825465
Qwen3.5 4B GLB 3D Coder0K / 17.4 GB12206177
Qwen3.5 4B Heretic0K / 9.1 GB389324
Mica V0.5 4B0K / 9.3 GB586843
....5 4B Weight Space Programming0K / 9.3 GB5042
... Opus Reasoning Distilled GGUF0K / 0.7 GB338962154
Wit Coder 4B0K / 0.9 GB7922
Cieslar Qwen V1 Test0K / 0.7 GB7392
Cieslar Qwen V2 Test0K / 0.7 GB4551
Qwen3.5 4B Salieri0K / 9.1 GB7191
Note: green Score (e.g. "73.2") means that the model is better than JallyAI/Nomi-2-GGUF.