LLM EXPLORER 63,069 MODELS INDEXED

Krx Q25 7B Base V2 by lsw0570168

By lsw0570168 · 88 downloads

Krx Q25 7B Base V2 is an open-source language model by lsw0570168. Features: 7b LLM, VRAM: 15.2GB, Context: 128K, License: apache-2.0, Quantized, LLM Explorer Score: 0.15.

  Autotrain compatible Base model:finetune:unsloth/qw...   Base model:unsloth/qwen2.5-7b   En   Endpoints compatible   Krx   Q25   Quantized   Qwen2   Region:us   Safetensors   Sharded   Tensorflow   Trl   Unsloth

Krx Q25 7B Base V2 Parameters and Internals

LLM NameKrx Q25 7B Base V2
Repository πŸ€—https://huggingface.co/lsw0570168/krx-q25-7b-base-v2 
Base Model(s)  unsloth/Qwen2.5-7B   unsloth/Qwen2.5-7B
Model Size7b
Required VRAM15.2 GB
Updated2024-11-08
Maintainerlsw0570168
Model Typeqwen2
Model Files  4.9 GB: 1-of-4   4.9 GB: 2-of-4   4.3 GB: 3-of-4   1.1 GB: 4-of-4
Supported Languagesen
Quantization Typeq25
Model ArchitectureQwen2ForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.46.1
Tokenizer ClassQwen2Tokenizer
Padding Token<|PAD_TOKEN|>
Vocabulary Size152064
Torch Data Typebfloat16
Errorsreplace

Quantized Models of the Krx Q25 7B Base V2

Model
Likes
Downloads
VRAM
Krx Q25 7B Base V2.1012315 GB

Best Alternatives to Krx Q25 7B Base V2

Best Alternatives
Context / RAM
Downloads
Likes
Qwen2.5 7B Instruct 1M 4bit986K / 4.3 GB44411
...wen2.5 7B Instruct 1M Bnb 4bit986K / 5.5 GB2671
Qwen2.5 7B Instruct 1M 8bit986K / 8.1 GB634
Qwen2.5 7B Instruct 1M 6bit986K / 6.2 GB522
...B Instruct 1M Unsloth Bnb 4bit986K / 7.5 GB373
Qwen 7B Kiberbase128K / 15.2 GB7880
A1 V002128K / 15.2 GB70
Mini Pathfinder128K / 15.2 GB160
A1 V0.0.1128K / 15.2 GB80
CogitoDistil128K / 15.2 GB140
Note: green Score (e.g. "73.2") means that the model is better than lsw0570168/krx-q25-7b-base-v2.