| LLM Name | Pythia 6.9B Deduped Int3 Step71000 GPTQ Wikitext2 |
| Repository ๐ค | https://huggingface.co/Xu-Ouyang/pythia-6.9b-deduped-int3-step71000-GPTQ-wikitext2 |
| Model Size | 6.9b |
| Required VRAM | 3.4 GB |
| Updated | 2025-09-23 |
| Maintainer | Xu-Ouyang |
| Model Type | gpt_neox |
| Model Files | |
| GPTQ Quantization | Yes |
| Quantization Type | gptq |
| Model Architecture | GPTNeoXForCausalLM |
| Context Length | 2048 |
| Model Max Length | 2048 |
| Transformers Version | 4.41.2 |
| Tokenizer Class | GPTNeoXTokenizer |
| Vocabulary Size | 50432 |
| Torch Data Type | float16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Cassandra 6.9B GPTQ | 4K / 4.7 GB | 19 | 2 |
| ... Int3 Step36000 GPTQ Wikitext2 | 2K / 3.4 GB | 5 | 0 |
| ...Int3 Step107000 GPTQ Wikitext2 | 2K / 3.4 GB | 5 | 0 |
| ...Int4 Step107000 GPTQ Wikitext2 | 2K / 4.2 GB | 5 | 0 |
| ...Int3 Step143000 GPTQ Wikitext2 | 2K / 3.4 GB | 5 | 0 |
| ...Int3 Step110000 GPTQ Wikitext2 | 2K / 3.4 GB | 5 | 0 |
| ... Int4 Step71000 GPTQ Wikitext2 | 2K / 4.2 GB | 6 | 0 |
| ...Int4 Step110000 GPTQ Wikitext2 | 2K / 4.2 GB | 6 | 0 |
| ...Int4 Step143000 GPTQ Wikitext2 | 2K / 4.2 GB | 6 | 0 |
| ...ythia 6.9B Int4 GPTQ Wikitext2 | 2K / 4.2 GB | 5 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐