LLM EXPLORER 59,358 MODELS INDEXED

Qwen2 1.5B Gguf F16 by inflaton

By inflaton · 16 downloads

Qwen2 1.5B Gguf F16 is an open-source language model by inflaton. Features: 1.5b LLM, VRAM: 3.1GB, Quantized, LLM Explorer Score: 0.13.

  Conversational   Endpoints compatible   Fp16   Gguf   Quantized   Qwen2   Region:us

Qwen2 1.5B Gguf F16 Parameters and Internals

LLM NameQwen2 1.5B Gguf F16
Repository πŸ€—https://huggingface.co/inflaton/Qwen2-1.5B-gguf-f16 
Model Size1.5b
Required VRAM3.1 GB
Updated2024-12-06
Maintainerinflaton
Model Typeqwen2
Model Files  3.1 GB
GGUF QuantizationYes
Quantization Typefp16|gguf
Model ArchitectureAutoModel

Best Alternatives to Qwen2 1.5B Gguf F16

Best Alternatives
Context / RAM
Downloads
Likes
MoeinGTS1.5 1.5B0K / 1 GB1131
MedScholar 1.5B F32 GGUF0K / 0.7 GB843
Qwen2 1.5B Instruct GGUF0K / 0.4 GB3468
Jenna V3 Qwen2 1.5 GGUF Q40K / 1 GB290
Jenna V3 Qwen2 1.5 GGUF0K / 3.1 GB241
Qwen2 1.5B Ita V20K / 0.1 GB160
Qwen2 1.5B0K / 1.1 GB130
Qwen2 1.5B MAC Gguf Q8 00K / 0.4 GB230
Qwen2 1.5B MAC Gguf Q4 K M0K / 0.3 GB220
Qwen2 1.5B MAC Gguf F160K / 3.1 GB170
Note: green Score (e.g. "73.2") means that the model is better than inflaton/Qwen2-1.5B-gguf-f16.