Qwen2.5 3B Instruct Heretic by saidutta69

 »  All LLMs  »  saidutta69  »  Qwen2.5 3B Instruct Heretic   URL Share it on

Qwen2.5 3B Instruct Heretic is an open-source language model by saidutta69. Features: 3b LLM, VRAM: 6.2GB, Context: 32K, License: other, Quantized, Instruction-Based, LLM Explorer Score: 0.24.

  Arxiv:2407.10671   Abliterated Base model:quantized:qwen/qwen...   Base model:qwen/qwen2.5-3b   Chat   Conversational   Decensored   En   Endpoints compatible   Gguf   Heretic   Instruct   Q4   Quantized   Qwen2   Region:us   Safetensors   Sharded   Tensorflow   Uncensored

Qwen2.5 3B Instruct Heretic Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Qwen2.5 3B Instruct Heretic Parameters and Internals

LLM NameQwen2.5 3B Instruct Heretic
Repository 🤗https://huggingface.co/saidutta69/Qwen2.5-3B-Instruct-heretic 
Base Model(s)  Qwen/Qwen2.5-3B   Qwen/Qwen2.5-3B
Model Size3b
Required VRAM6.2 GB
Updated2026-07-02
Maintainersaidutta69
Model Typeqwen2
Instruction-BasedYes
Model Files  5.0 GB: 1-of-2   1.2 GB: 2-of-2   1.9 GB   2.2 GB
Supported Languagesen
GGUF QuantizationYes
Quantization Typegguf|q4|q4_k|q5_k
Model ArchitectureQwen2ForCausalLM
Licenseother
Context Length32768
Model Max Length32768
Transformers Version4.57.6
Tokenizer ClassQwen2Tokenizer
Padding Token<|endoftext|>
Vocabulary Size151936
Errorsreplace

Best Alternatives to Qwen2.5 3B Instruct Heretic

Best Alternatives
Context / RAM
Downloads
Likes
VibeThinker 3B Heretic128K / 6.2 GB10164
Zenith 3B32K / 6.3 GB1903
Coder GRPO 3B32K / 6.2 GB12097
OpenCogito32K / 6.2 GB7790
OpenCognito R132K / 6.1 GB6550
Nomi 1 Creative32K / 6.2 GB472
Tiny Agent A 3B32K / 6.2 GB70224
Esbieta Ec Qwen 2.5 3B32K / 6.2 GB163
...2.5 3B Instruct Abliterated V132K / 6.8 GB1383
VibeThinker 3B 8bit128K / 3.3 GB26913
Note: green Score (e.g. "73.2") means that the model is better than saidutta69/Qwen2.5-3B-Instruct-heretic.

Rank the Qwen2.5 3B Instruct Heretic Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 54702 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a