InternLM2 Math Plus 7B 4bit is an open-source language model by lee-ite. Features: 7b LLM, VRAM: 5.2GB, Context: 8K, License: apache-2.0, Quantized.
Arxiv:2402.06332 4-bit 4bit Awq Conversational Custom code En Feature-extraction Internlm2 License:apache-2.0 Math Pytorch Quantized Region:us Sharded Zh
Model Card on HF 🤗: https://huggingface.co/lee-ite/InternLM2-Math-Plus-7B-4bit
InternLM2 Math Plus 7B 4bit Parameters and Internals
| LLM Name | InternLM2 Math Plus 7B 4bit |
| Repository 🤗 | https://huggingface.co/lee-ite/InternLM2-Math-Plus-7B-4bit |
| Base Model(s) | |
| Model Size | 7b |
| Required VRAM | 5.2 GB |
| Updated | 2024-07-04 |
| Maintainer | lee-ite |
| Model Type | internlm2 |
| Model Files | |
| Supported Languages | en zh |
| Quantization Type | 4bit |
| Model Architecture | InternLM2ForCausalLM |
| License | apache-2.0 |
| Context Length | 8192 |
| Model Max Length | 8192 |
| Transformers Version | 4.41.1 |
| Is Biased | 0 |
| Tokenizer Class | InternLM2Tokenizer |
| Padding Token | </s> |
| Vocabulary Size | 92544 |
| Torch Data Type | float16 |
Best Alternatives to InternLM2 Math Plus 7B 4bit
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| Internlm2 5 7B Chat 8bit | 32K / 8.2 GB | 68 | 3 |
| Internlm2 5 7B Chat 4bit | 32K / 5.2 GB | 63 | 5 |
| Internlm2 5 7B Chat 4bit | 32K / 4.3 GB | 32 | 2 |
| Internlm2 5 7B | 256K / 15.5 GB | 2968 | 18 |
| Internlm2 5 7B Chat 1M | 256K / 15.4 GB | 1148 | 72 |
| Internlm2 5 7B Chat | 32K / 15.4 GB | 43794 | 200 |
| Internlm2 7B | 32K / 15.5 GB | 25545 | 43 |
| Internlm2 Chat 7B | 32K / 15.4 GB | 46960 | 83 |
| ChemLLM 7B Chat 1 5 DPO | 32K / 15.4 GB | 10775 | 27 |
| Internlm2 Base 7B | 32K / 15.5 GB | 20705 | 10 |
Note: green Score (e.g. "73.2") means that the model is better than lee-ite/InternLM2-Math-Plus-7B-4bit .
Rank the InternLM2 Math Plus 7B 4bit Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
What open-source LLMs or SLMs are you in search of? 52721 in total.
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a