LLM EXPLORER 59,516 MODELS INDEXED

Trained Quant 4bit by RyanJT

By RyanJT · 7 downloads

Trained Quant 4bit is an open-source language model by RyanJT. Features: 3b LLM, Quantized, Instruction-Based, LLM Explorer Score: 0.13.

  Arxiv:1910.09700   4-bit   4bit   Adapter Base model:adapter:ryanjt/quan... Base model:ryanjt/quantized-gr...   Bitsandbytes   Finetuned   Instruct   Llama   Lora   Peft   Quantized   Region:us   Safetensors

Trained Quant 4bit Parameters and Internals

LLM NameTrained Quant 4bit
Repository πŸ€—https://huggingface.co/RyanJT/trained-quant-4bit 
Base Model(s)  ... Granite 4bit 3B Code Instruct   RyanJT/quantized-granite-4bit-3b-code-instruct
Model Size3b
Required VRAM0 GB
Updated2025-09-13
MaintainerRyanJT
Instruction-BasedYes
Model Files  0.0 GB   2.0 GB   0.0 GB
Quantization Type4bit
Model ArchitectureAdapter
Model Max Length9223372036854775807
Is Biasednone
Tokenizer ClassGPT2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size49152
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesq_proj|v_proj
LoRA Alpha32
LoRA Dropout0.1
R Param8

Best Alternatives to Trained Quant 4bit

Best Alternatives
Context / RAM
Downloads
Likes
Cc Coder0K / 0.1 GB240
...Mental Support Qwen2.5 3B Lora0K / 0.1 GB210
Qwen25 3B Korean Pii Qlora20K / 0.1 GB120
Llama3 Code Lora0K / 0.1 GB132
Nomi 1.10K / 6.5 GB63
Xenith 3B0K / 7.6 GB22
OpenRP3B Llama3.20K / 0.1 GB61
Note: green Score (e.g. "73.2") means that the model is better than RyanJT/trained-quant-4bit.