Model Type |
| ||||||
Use Cases |
| ||||||
Training Details |
|
LLM Name | Merlyn Education Safety AWQ |
Repository ๐ค | https://huggingface.co/TheBloke/merlyn-education-safety-AWQ |
Model Name | Merlyn Education Safety 12B |
Model Creator | Merlyn Mind |
Base Model(s) | |
Model Size | 12b |
Required VRAM | 6.9 GB |
Updated | 2025-09-22 |
Maintainer | TheBloke |
Model Type | gpt_neox |
Model Files | |
AWQ Quantization | Yes |
Quantization Type | awq |
Model Architecture | GPTNeoXForCausalLM |
License | apache-2.0 |
Context Length | 2048 |
Model Max Length | 2048 |
Transformers Version | 4.35.0 |
Tokenizer Class | GPTNeoXTokenizer |
Vocabulary Size | 50688 |
Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Dolly V2 12B Sharded 8bit | 2K / 12.4 GB | 15 | 4 |
Dolly V2 12B | 2K / 23.8 GB | 3255 | 1955 |
...sst Sft 4 Pythia 12B Epoch 3.5 | 2K / 23.8 GB | 2849 | 370 |
Pythia 12B | 2K / 23.8 GB | 9103 | 140 |
...Int4 Step107000 GPTQ Wikitext2 | 2K / 6.9 GB | 6 | 0 |
... Int3 Step71000 GPTQ Wikitext2 | 2K / 5.5 GB | 5 | 0 |
... Int4 Step36000 GPTQ Wikitext2 | 2K / 6.9 GB | 6 | 0 |
Oasst Sft 1 Pythia 12B | 2K / 23.8 GB | 1958 | 277 |
Pythia 12B Deduped | 2K / 23.8 GB | 7015 | 52 |
Pythia 12B Sft V8 7K Steps | 2K / 23.8 GB | 1928 | 21 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐