What are the hardware requirements for Li 0.4 Pre?

Li 0.4 Pre requires approximately 29.7 GB of VRAM and supports a context window of 32K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Li 0.4 Pre and how large is it?

Li 0.4 Pre is developed by hongbai12, a model with 14b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Li 0.4 Pre?

Li 0.4 Pre is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Li 0.4 Pre by hongbai12 — VRAM 29.7GB, 32K context

Name: Li 0.4 Pre
Author: hongbai12

Li 0.4 Pre is an open-source language model by hongbai12. Features: 14b LLM, VRAM: 29.7GB, Context: 32K, Instruction-Based, Code Generating, Merged, LLM Explorer Score: 0.27.

Merged Model Arxiv:2403.19522 Autotrain compatible Base model:deepseek-ai/deepsee... Base model:huihui-ai/deepseek-... Base model:qwen/qwen2.5-14b Base model:qwen/qwen2.5-14b-in... Base model:qwen/qwen2.5-coder-... Codegen Conversational Endpoints compatible Instruct Qwen2 Region:us Safetensors Sharded Tensorflow

Model Card on HF 🤗: https://huggingface.co/hongbai12/li-0.4-pre

Li 0.4 Pre Parameters and Internals

LLM Name	Li 0.4 Pre
Repository 🤗	https://huggingface.co/hongbai12/li-0.4-pre
Base Model(s)	...istill Qwen 14B Abliterated V2 Qwen/Qwen2.5-14B-Instruct DeepSeek R1 Distill Qwen 14B Qwen/Qwen2.5-14B Qwen/Qwen2.5-Coder-14B huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2 Qwen/Qwen2.5-14B-Instruct deepseek-ai/DeepSeek-R1-Distill-Qwen-14B Qwen/Qwen2.5-14B Qwen/Qwen2.5-Coder-14B
Merged Model	Yes
Model Size	14b
Required VRAM	29.7 GB
Updated	2025-03-18
Maintainer	hongbai12
Model Type	qwen2
Instruction-Based	Yes
Model Files	4.9 GB: 1-of-6 5.0 GB: 2-of-6 5.0 GB: 3-of-6 5.0 GB: 4-of-6 5.0 GB: 5-of-6 4.8 GB: 6-of-6
Generates Code	Yes
Model Architecture	Qwen2ForCausalLM
Context Length	32768
Model Max Length	32768
Transformers Version	4.48.2
Tokenizer Class	Qwen2Tokenizer
Padding Token	<\|endoftext\|>
Vocabulary Size	152064
Torch Data Type	bfloat16
Errors	replace

Rank the Li 0.4 Pre capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Li 0.4 Pre

Best Alternatives	Context / RAM	Downloads	Likes
...hts Qwen2.5 14B Coder Creative	986K / 29.3 GB	267	0
ZYH LLM Qwen2.5 14B V4	986K / 29.7 GB	27	8
Qwen2.5 14B YOYO V4	986K / 29.7 GB	20	5
ZYH LLM Qwen2.5 14B V2	986K / 29.7 GB	14	1
ZYH LLM Qwen2.5 14B V5	986K / 29.7 GB	12	8
Qwen2.5 14B YOYO V5	986K / 29.7 GB	10	4
Mergekit Model Stock Ggfjmyf	986K / 29.7 GB	14	0
Mergekit Model Stock Injkqri	986K / 29.7 GB	5	1
...1 DeepSeekR1 Coder 14B Preview	128K / 29.7 GB	9	3
Tessa T1 14B	117K / 29.7 GB	6	13

Note: green Score (e.g. "73.2") means that the model is better than hongbai12/li-0.4-pre.