LLM EXPLORER 59,420 MODELS INDEXED

Ruadapt Qwen2.5 3B Ext U48 Full Lr5e4 Peft Mlp 32 32 Bs256 by RefalMachine

By RefalMachine · 5 downloads

Ruadapt Qwen2.5 3B Ext U48 Full Lr5e4 Peft Mlp 32 32 Bs256 is an open-source language model by RefalMachine. Features: 3b LLM, VRAM: 0.7GB, LLM Explorer Score: 0.15.

  Adapter Base model:adapter:refalmachin... Base model:refalmachine/ruadap...   Finetuned   Generated from trainer   Lora   Peft   Region:us   Safetensors   Tensorboard

Ruadapt Qwen2.5 3B Ext U48 Full Lr5e4 Peft Mlp 32 32 Bs256 Parameters and Internals

LLM NameRuadapt Qwen2.5 3B Ext U48 Full Lr5e4 Peft Mlp 32 32 Bs256
Repository πŸ€—https://huggingface.co/RefalMachine/ruadapt_qwen2.5_3B_ext_u48_full_lr5e4_peft_mlp_32_32_bs256 
Base Model(s)  RefalMachine/ruadapt_qwen2.5_3B_ext_u48_mean_init   RefalMachine/ruadapt_qwen2.5_3B_ext_u48_mean_init
Model Size3b
Required VRAM0.7 GB
Updated2025-10-11
MaintainerRefalMachine
Model Files  0.7 GB   0.0 GB
Model ArchitectureAdapter
Model Max Length131072
Is Biasednone
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesgate_proj|down_proj|v_proj|o_proj|up_proj|k_proj|q_proj
LoRA Alpha32
LoRA Dropout0.05
R Param32
Errorsreplace

Best Alternatives to Ruadapt Qwen2.5 3B Ext U48 Full Lr5e4 Peft Mlp 32 32 Bs256

Best Alternatives
Context / RAM
Downloads
Likes
...Mental Support Qwen2.5 3B Lora0K / 0.1 GB210
Qwen25 3B Korean Pii Qlora20K / 0.1 GB120
Llama3 Code Lora0K / 0.1 GB132
...ma 3.2 3B Legal India Qlora V20K / 0.1 GB840
Nomi 1.10K / 6.5 GB63
Art Skynet 3B0K / 6.5 GB1115
Xenith 3B0K / 7.6 GB22
Results0K / 0.9 GB150
Accel20K / 6.8 GB60
Accel30K / 0 GB50
Note: green Score (e.g. "73.2") means that the model is better than RefalMachine/ruadapt_qwen2.5_3B_ext_u48_full_lr5e4_peft_mlp_32_32_bs256.