LLM EXPLORER 61,249 MODELS INDEXED

Qwen2 0.5B Gguf F16 by inflaton

By inflaton · 19 downloads

Qwen2 0.5B Gguf F16 is an open-source language model by inflaton. Features: 0.5b LLM, VRAM: 1GB, Quantized, LLM Explorer Score: 0.13.

  Conversational   Endpoints compatible   Fp16   Gguf   Quantized   Qwen2   Region:us

Qwen2 0.5B Gguf F16 Parameters and Internals

LLM NameQwen2 0.5B Gguf F16
Repository πŸ€—https://huggingface.co/inflaton/Qwen2-0.5B-gguf-f16 
Model Size0.5b
Required VRAM1 GB
Updated2024-12-06
Maintainerinflaton
Model Typeqwen2
Model Files  1.0 GB
GGUF QuantizationYes
Quantization Typefp16|gguf
Model ArchitectureAutoModel

Best Alternatives to Qwen2 0.5B Gguf F16

Best Alternatives
Context / RAM
Downloads
Likes
Qwen2 0.5B Fncl GGUF0K / 1 GB180
Qwen2 0.5B GGUF0K / 0.4 GB720
...0.5B Instruct Bnb 4bit Q4KM 1E0K / 0.4 GB270
Qwen Jenna V01 Gguf Q40K / 0.4 GB160
Qwen2 0.5B F160K / 1 GB160
Qwen2 0.5B Gguf Q4 K M0K / 0.4 GB100
Qwen2 0.5B Q5 K M0K / 0.4 GB100
Qwen2 0.5B Q4 K M0K / 0.4 GB80
Qwen2 0.5B Instruct Sorah GGUF0K / 0.4 GB340
Qwen2 0.5B Gguf Q5 K M0K / 0.4 GB31
Note: green Score (e.g. "73.2") means that the model is better than inflaton/Qwen2-0.5B-gguf-f16.