Llama 2 13B by GrazittiInteractive

 ยป  All LLMs  ยป  GrazittiInteractive  ยป  Llama 2 13B   URL Share it on

  Autotrain compatible   Dataset:meta-llama/llama-2-13b   En   Facebook   Ggml   Llama   Llama2   Meta   Pytorch   Q4   Quantized   Region:us

Llama 2 13B Benchmarks

Llama 2 13B (GrazittiInteractive/llama-2-13b)
๐ŸŒŸ Advertise your project ๐Ÿš€

Llama 2 13B Parameters and Internals

Model Type 
text generation
Use Cases 
Areas:
Research, Commercial applications
Primary Use Cases:
Assistant-like chat, Natural language generation tasks
Additional Notes 
The provided files are for a quantized version in 4-bit GGML format.
Training Details 
Data Sources:
publicly available online data
Data Volume:
2 trillion tokens (pretraining)
Methodology:
Supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF)
Context Length:
4000
Hardware Used:
Meta's Research Super Cluster, A100-80GB GPUs
Model Architecture:
Auto-regressive transformer architecture
Safety Evaluation 
Ethical Considerations:
Requires safety testing and tuning before deployment
Input Output 
Input Format:
Text input
Accepted Modalities:
text
Output Format:
Text output
LLM NameLlama 2 13B
Repository ๐Ÿค—https://huggingface.co/GrazittiInteractive/llama-2-13b 
Base Model(s)  Ligma L2 13B   kubernetes-bad/Ligma-L2-13b
Model Size13b
Required VRAM7.4 GB
Updated2025-09-18
MaintainerGrazittiInteractive
Model Typellama
Model Files  7.4 GB
Supported Languagesen
GGML QuantizationYes
Quantization Typeggml|q4
Model ArchitectureAutoModelForCausalLM
Licenseother
Context Length4096
Model Max Length4096
Transformers Version4.31.0
Vocabulary Size-1
Torch Data Typefloat16

Best Alternatives to Llama 2 13B

Best Alternatives
Context / RAM
Downloads
Likes
...paca 13B Native 4bit 128g Cuda0K / 7.9 GB109
ALMA 13B R0K / 26 GB1258082
Small Tiny V10K / 0.1 GB70
...ama2 13B No Robots Alpaca Lora0K / 4 GB179010
Llava V1.5 13B S2 Lora0K / 0.1 GB62
Llama 2 13B Chat Hf GPT 4 80K0K / 26 GB80
Llava Chart 13b Lora0K / 0.1 GB52
ChartLlama 13B0K / 0.1 GB3020
Llama 2 13B Longlora 64K0K / 0.1 GB170710
Leyley 13B Lora0K / 4 GB94
Note: green Score (e.g. "73.2") means that the model is better than GrazittiInteractive/llama-2-13b.

Rank the Llama 2 13B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51435 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124