LLM EXPLORER 66,845 MODELS INDEXED

Trained Quant 4bit by RyanJT

By RyanJT · 7 downloads

Trained Quant 4bit is an open-source language model by RyanJT. Features: 3b LLM, Quantized, Instruction-Based, LLM Explorer Score: 0.12.

  Arxiv:1910.09700   4-bit   4bit   Adapter Base model:adapter:ryanjt/quan... Base model:ryanjt/quantized-gr...   Bitsandbytes   Finetuned   Instruct   Llama   Lora   Peft   Quantized   Region:us   Safetensors

Trained Quant 4bit Parameters and Internals

LLM NameTrained Quant 4bit
Repository πŸ€—https://huggingface.co/RyanJT/trained-quant-4bit 
Base Model(s)  ... Granite 4bit 3B Code Instruct   RyanJT/quantized-granite-4bit-3b-code-instruct
Model Size3b
Required VRAM0 GB
Updated2025-09-13
MaintainerRyanJT
Instruction-BasedYes
Model Files  0.0 GB   2.0 GB   0.0 GB
Quantization Type4bit
Model ArchitectureAdapter
Model Max Length9223372036854775807
Is Biasednone
Tokenizer ClassGPT2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size49152
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesq_proj|v_proj
LoRA Alpha32
LoRA Dropout0.1
R Param8

Best Alternatives to Trained Quant 4bit

Best Alternatives
Context / RAM
Downloads
Likes
...nites Rhythmancer 3B Generator0K / 0.1 GB290
Cc Coder0K / 0.1 GB240
...wen2.5 VL 3B FakeBench LoRA V20K / 0.1 GB172
AIBio LoRA0K / 0.1 GB281
StandardOne 3B LoRA0K / 0.1 GB421
Qwen2.5 Coder 3B QLora0K / 0.1 GB151
Paperlens Qwen2.5 3B Qlora0K / 0.1 GB81
...Agreement Qwen2.5 3B Grpo Lora0K / 0 GB120
... Checking Qwen2.5 3B Grpo Lora0K / 0 GB90
Qwen2.5 VL 3B FakeBench LoRA0K / 0.1 GB191
Note: green Score (e.g. "73.2") means that the model is better than RyanJT/trained-quant-4bit.