Merlyn Education Safety GPTQ by TheBloke

 ยป  All LLMs  ยป  TheBloke  ยป  Merlyn Education Safety GPTQ   URL Share it on

Merlyn Education Safety GPTQ is an open-source language model by TheBloke. Features: 12b LLM, VRAM: 6.9GB, Context: 2K, License: apache-2.0, Quantized, LLM Explorer Score: 0.1.

  4-bit Base model:merlynmind/merlyn-e... Base model:quantized:merlynmin...   Education   Gpt neox   Gptq   Merlynmind   Quantized   Region:us   Safetensors

Merlyn Education Safety GPTQ Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Merlyn Education Safety GPTQ (TheBloke/merlyn-education-safety-GPTQ)
๐ŸŒŸ Advertise your project ๐Ÿš€

Merlyn Education Safety GPTQ Parameters and Internals

Model Type 
gptneox
Additional Notes 
The model is designed for educational domains to classify queries as appropriate or inappropriate for classroom discussions.
Input Output 
Input Format:
Instruction:\t{system_message} Message:{prompt} Response:
LLM NameMerlyn Education Safety GPTQ
Repository ๐Ÿค—https://huggingface.co/TheBloke/merlyn-education-safety-GPTQ 
Model NameMerlyn Education Safety 12B
Model CreatorMerlyn Mind
Base Model(s)  Merlyn Education Safety   MerlynMind/merlyn-education-safety
Model Size12b
Required VRAM6.9 GB
Updated2026-03-07
MaintainerTheBloke
Model Typegpt_neox
Model Files  6.9 GB
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureGPTNeoXForCausalLM
Licenseapache-2.0
Context Length2048
Model Max Length2048
Transformers Version4.35.0
Tokenizer ClassGPTNeoXTokenizer
Vocabulary Size50688
Torch Data Typefloat16

Best Alternatives to Merlyn Education Safety GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
...Int4 Step107000 GPTQ Wikitext22K / 6.9 GB60
... Int3 Step71000 GPTQ Wikitext22K / 5.5 GB50
... Int4 Step36000 GPTQ Wikitext22K / 6.9 GB60
Dolly V2 12B Sharded 8bit2K / 12.4 GB14
Dolly V2 12B2K / 23.8 GB32831955
...sst Sft 4 Pythia 12B Epoch 3.52K / 23.8 GB1587368
Oasst Rl 1 Pythia 12B2K / 23.8 GB34
Pythia 12B2K / 23.8 GB36490144
Oasst Sft 1 Pythia 12B2K / 23.8 GB1396278
Pythia 12B Deduped2K / 23.8 GB476452
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/merlyn-education-safety-GPTQ.

Rank the Merlyn Education Safety GPTQ Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 52721 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum โ€” our secure, self-hosted AI agent for server management.
Release v20260328a