LLM EXPLORER 57,252 MODELS INDEXED

Rezoom Llama3.1 8B 4bit B16 Base by ninky0

By ninky0 · 6 downloads
HF Repo ↗ Copy URL

Rezoom Llama3.1 8B 4bit B16 Base is an open-source language model by ninky0. Features: 8b LLM, VRAM: 16.1GB, Context: 128K, License: apache-2.0, Quantized, LLM Explorer Score: 0.18.

  4bit   En   Endpoints compatible   Feature-extraction   Llama   Quantized   Region:us   Safetensors   Sharded   Tensorflow   Text-embeddings-inference   Unsloth
Model Card on HF 🤗: https://huggingface.co/ninky0/rezoom-llama3.1-8b-4bit-b16-base 

Rezoom Llama3.1 8B 4bit B16 Base Parameters and Internals

LLM NameRezoom Llama3.1 8B 4bit B16 Base
Repository 🤗https://huggingface.co/ninky0/rezoom-llama3.1-8b-4bit-b16-base 
Base Model(s)  unsloth/meta-llama-3.1-8b-bnb-4bit   unsloth/meta-llama-3.1-8b-bnb-4bit
Model Size8b
Required VRAM16.1 GB
Updated2026-06-11
Maintainerninky0
Model Typellama
Model Files  5.0 GB: 1-of-4   5.0 GB: 2-of-4   4.9 GB: 3-of-4   1.2 GB: 4-of-4
Supported Languagesen
Quantization Type4bit
Model ArchitectureLlamaModel
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.51.3
Tokenizer ClassPreTrainedTokenizer
Padding Token<|finetune_right_pad_id|>
Vocabulary Size128256
Torch Data Typebfloat16

Best Alternatives to Rezoom Llama3.1 8B 4bit B16 Base

Best Alternatives
Context / RAM
Downloads
Likes
...enut Llama 3.1 8B 0.8 Instruct128K / 15 GB80