Shruti Soft 2.6B is an open-source language model by Umranz. Features: 2.6b LLM, VRAM: 5.4GB, License: apache-2.0, LLM Explorer Score: 0.32.
| LLM Name | Shruti Soft 2.6B |
| Repository 🤗 | https://huggingface.co/Umranz/Shruti-Soft-2.6b |
| Base Model(s) | |
| Model Size | 2.6b |
| Required VRAM | 5.4 GB |
| Updated | 2026-08-14 |
| Maintainer | Umranz |
| Model Files | |
| Supported Languages | en hi |
| Model Architecture | AutoModelForCausalLM |
| License | apache-2.0 |
| Is Biased | none |
| Tokenizer Class | PreTrainedTokenizerFast |
| Padding Token | <|pad|> |
| PEFT Type | LORA |
| LoRA Model | Yes |
| PEFT Target Modules | feed_forward.w1|self_attn.out_proj|feed_forward.w2|feed_forward.w3|conv.in_proj|conv.out_proj|self_attn.k_proj|self_attn.q_proj|self_attn.v_proj |
| LoRA Alpha | 64 |
| LoRA Dropout | 0.05 |
| R Param | 32 |