LLM EXPLORER 60,783 MODELS INDEXED

Anthro Rm 144K AWQ by Jennny

By Jennny · 5 downloads

Anthro Rm 144K AWQ is an open-source language model by Jennny. Features: 7b LLM, Quantized, Instruction-Based, LLM Explorer Score: 0.12.

  Arxiv:1910.09700   Adapter   Awq Base model:adapter:thebloke/mi... Base model:thebloke/mistral-7b...   Finetuned   Instruct   Lora   Peft   Quantized   Region:us   Safetensors

Anthro Rm 144K AWQ Parameters and Internals

LLM NameAnthro Rm 144k AWQ
Repository πŸ€—https://huggingface.co/Jennny/anthro_rm_144k_awq 
Base Model(s)  TheBloke/Mistral-7B-Instruct-v0.2-AWQ   TheBloke/Mistral-7B-Instruct-v0.2-AWQ
Model Size7b
Required VRAM0 GB
Updated2025-07-07
MaintainerJennny
Instruction-BasedYes
Model Files  0.1 GB   0.0 GB   0.0 GB   0.0 GB
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureAdapter
Model Max Length512
Is Biasednone
Tokenizer ClassLlamaTokenizer
Padding Token</s>
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesup_proj|down_proj|k_proj|q_proj|gate_proj|v_proj|lm_head|o_proj
LoRA Alpha16
LoRA Dropout0.05
R Param8

Best Alternatives to Anthro Rm 144K AWQ

Best Alternatives
Context / RAM
Downloads
Likes
...en2.5 Coder 7B Vietnamese LoRA0K / 0.3 GB450
Mistral Numericnlg FV0K / 0.3 GB60
Mistral Wikitable FV0K / 0.3 GB60
Mistral Charttotext FV0K / 0.3 GB50
Zephyr 7B Beta Agent Instruct0K / 0.3 GB111
Falcon 7B Instruct 4bit Lora0K / 0 GB01
Lemonilia ShoriRP V0.75d0K / 0.2 GB81
Zduhac Cyber 7B V20K / 0 GB81
Llama2 7B Qlora Guanaco0K / 0.1 GB111
Qwen Megumin0K / 0.1 GB111
Note: green Score (e.g. "73.2") means that the model is better than Jennny/anthro_rm_144k_awq.