Vicuna 33B AWQ is an open-source language model by TheBloke. Features: 33b LLM, VRAM: 17.6GB, Context: 2K, License: other, Quantized, LLM Explorer Score: 0.1.
An auto-regressive language model based on the transformer architecture
Use Cases
Areas:
research
Applications:
large language models, chatbots
Additional Notes
AWQ is an efficient, accurate and blazing-fast low-bit weight quantization method, currently supporting 4-bit quantization. Compared to GPTQ, it offers faster Transformers-based inference.
Training Details
Data Sources:
ShareGPT
Data Volume:
125K conversations
Methodology:
Supervised instruction fine-tuning
Model Architecture:
Transformer
Input Output
Input Format:
A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: {prompt} ASSISTANT:
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/vicuna-33B-AWQ.
Rank the Vicuna 33B AWQ Capabilities
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
What open-source LLMs or SLMs are you in search of? 52721 in total.