Internlm Chat 7B 4bit Gptq Safetensor by cczhong

 ยป  All LLMs  ยป  cczhong  ยป  Internlm Chat 7B 4bit Gptq Safetensor   URL Share it on

  4bit   Custom code   Feature-extraction   Gptq   Internlm   Quantized   Region:us

Internlm Chat 7B 4bit Gptq Safetensor Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
๐ŸŒŸ Advertise your project ๐Ÿš€

Internlm Chat 7B 4bit Gptq Safetensor Parameters and Internals

Model Type 
quantized_model, causal_lm
Additional Notes 
Intended for use with the 'cczhong/internlm-chat-7b-4bit-gptq-safetensor' model files.
Input Output 
Input Format:
text prompts for chat
Accepted Modalities:
text
Output Format:
text response
Performance Tips:
Ensure GPU usage for optimal performance.
LLM NameInternlm Chat 7B 4bit Gptq Safetensor
Repository ๐Ÿค—https://huggingface.co/cczhong/internlm-chat-7b-4bit-gptq-safetensor 
Model Size7b
Required VRAM8.2 GB
Updated2025-06-09
Maintainercczhong
Model Typeinternlm
Model Files  8.2 GB
GPTQ QuantizationYes
Quantization Typegptq|4bit
Model ArchitectureInternLMForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.31.0.dev0
Is Biased1
Tokenizer ClassInternLMTokenizer
Padding Token</s>
Vocabulary Size103168
Torch Data Typefloat16
Internlm Chat 7B 4bit Gptq Safetensor (cczhong/internlm-chat-7b-4bit-gptq-safetensor)

Best Alternatives to Internlm Chat 7B 4bit Gptq Safetensor

Best Alternatives
Context / RAM
Downloads
Likes
Internlm Chat 7B 4bit Gptq2K / 5.1 GB174
Agent FLAN 7B8K / 13.5 GB2918
Internlm Chat 7B2K / 14.6 GB12507101
CFGPT1 Pt 7B2K / 14.8 GB332
CFGPT1 Sft 7B Full2K / 14.8 GB311
Internlm 7B2K / 14.6 GB101994
Firefly Internlm 7B2K / 14.7 GB113
Internlm Chat 7B W42K / 5.1 GB243
Note: green Score (e.g. "73.2") means that the model is better than cczhong/internlm-chat-7b-4bit-gptq-safetensor.

Rank the Internlm Chat 7B 4bit Gptq Safetensor Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 48046 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124