PULI GPT 3SX GPTQ by TheBloke

 »  All LLMs  »  TheBloke  »  PULI GPT 3SX GPTQ   URL Share it on

PULI GPT 3SX GPTQ is an open-source language model by TheBloke. Features: 6.9b LLM, VRAM: 4.2GB, Context: 2K, License: cc-by-nc-4.0, Quantized, LLM Explorer Score: 0.09.

  4-bit   Base model:nytk/puli-gpt-3sx Base model:quantized:nytk/puli...   Gpt neox   Gptq   Hu   Puli   Quantized   Region:us   Safetensors

PULI GPT 3SX GPTQ Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

PULI GPT 3SX GPTQ Parameters and Internals

Model Type 
gptneox
Training Details 
Data Volume:
36.3 billion words
Methodology:
Trained with EleutherAI's GPT-NeoX
Context Length:
2048
LLM NamePULI GPT 3SX GPTQ
Repository 🤗https://huggingface.co/TheBloke/PULI-GPT-3SX-GPTQ 
Model NamePULI GPT 3SX
Model CreatorNYTK
Base Model(s)  PULI GPT 3SX   NYTK/PULI-GPT-3SX
Model Size6.9b
Required VRAM4.2 GB
Updated2026-04-12
MaintainerTheBloke
Model Typegpt_neox
Model Files  4.2 GB
Supported Languageshu
GPTQ QuantizationYes
Quantization Typegptq
Model ArchitectureGPTNeoXForCausalLM
Licensecc-by-nc-4.0
Context Length2048
Model Max Length2048
Transformers Version4.24.0
Tokenizer ClassGPT2Tokenizer
Beginning of Sentence Token<|endoftext|>
End of Sentence Token<|endoftext|>
Unk Token<|endoftext|>
Vocabulary Size50048
Torch Data Typefloat16
Errorsreplace

Best Alternatives to PULI GPT 3SX GPTQ

Best Alternatives
Context / RAM
Downloads
Likes
Cassandra 6.9B GPTQ4K / 4.7 GB82
...Int4 Step107000 GPTQ Wikitext22K / 4.2 GB70
... Int3 Step36000 GPTQ Wikitext22K / 3.4 GB50
...Int3 Step107000 GPTQ Wikitext22K / 3.4 GB50
... Int3 Step71000 GPTQ Wikitext22K / 3.4 GB50
...Int3 Step143000 GPTQ Wikitext22K / 3.4 GB50
...Int3 Step110000 GPTQ Wikitext22K / 3.4 GB50
...Int4 Step110000 GPTQ Wikitext22K / 4.2 GB60
... Int4 Step71000 GPTQ Wikitext22K / 4.2 GB50
...Int4 Step143000 GPTQ Wikitext22K / 4.2 GB50
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/PULI-GPT-3SX-GPTQ.

Rank the PULI GPT 3SX GPTQ Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 53972 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a