LLM EXPLORER 63,069 MODELS INDEXED

Krx Q25 7B Base V3.1 by lsw0570168

By lsw0570168 · 116 downloads
HF Repo ↗ Copy URL

Krx Q25 7B Base V3.1 is an open-source language model by lsw0570168. Features: 7b LLM, VRAM: 15.2GB, Context: 128K, License: apache-2.0, Quantized, LLM Explorer Score: 0.15.

  Autotrain compatible Base model:finetune:lsw0570168... Base model:lsw0570168/krx-q25-...   En   Endpoints compatible   Q25   Quantized   Qwen2   Region:us   Safetensors   Sharded   Tensorflow   Trl   Unsloth
Model Card on HF 🤗: https://huggingface.co/lsw0570168/krx-q25-7b-base-v3.1 

Krx Q25 7B Base V3.1 Parameters and Internals

LLM NameKrx Q25 7B Base V3.1
Repository 🤗https://huggingface.co/lsw0570168/krx-q25-7b-base-v3.1 
Base Model(s)  Krx Q25 7B Base V3   lsw0570168/krx-q25-7b-base-v3
Model Size7b
Required VRAM15.2 GB
Updated2024-11-08
Maintainerlsw0570168
Model Typeqwen2
Model Files  4.9 GB: 1-of-4   4.9 GB: 2-of-4   4.3 GB: 3-of-4   1.1 GB: 4-of-4
Supported Languagesen
Quantization Typeq25
Model ArchitectureQwen2ForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.46.2
Tokenizer ClassQwen2Tokenizer
Padding Token<|PAD_TOKEN|>
Vocabulary Size152064
Torch Data Typebfloat16
Errorsreplace

Best Alternatives to Krx Q25 7B Base V3.1

Best Alternatives
Context / RAM
Downloads
Likes
Qwen2.5 7B Instruct 1M 4bit986K / 4.3 GB44411
...wen2.5 7B Instruct 1M Bnb 4bit986K / 5.5 GB2671
Qwen2.5 7B Instruct 1M 8bit986K / 8.1 GB634
Qwen2.5 7B Instruct 1M 6bit986K / 6.2 GB522
...B Instruct 1M Unsloth Bnb 4bit986K / 7.5 GB373
Qwen 7B Kiberbase128K / 15.2 GB7880
A1 V002128K / 15.2 GB70
Mini Pathfinder128K / 15.2 GB160
A1 V0.0.1128K / 15.2 GB80
CogitoDistil128K / 15.2 GB140
Note: green Score (e.g. "73.2") means that the model is better than lsw0570168/krx-q25-7b-base-v3.1.