V Alpha Tross is an open-source language model by gradientai. Features: 69b LLM, VRAM: 138.7GB, Context: 4K, License: llama2, LLM Explorer Score: 0.12, Arc: 71.8, HellaSwag: 86.8, MMLU: 70.4, GSM8K: 61.5.
Model not specifically aligned for safety and may produce problematic outputs. Designed to overcome general-purpose models' deficiencies in finance domain by extended pre-training with finance data.
Supported Languages
en (English)
Training Details
Data Sources:
Red Pajamas, https://github.com
Methodology:
Crawling public text repositories, programmatic filtering, human review. Fine-tuned with Supervised Fine-Tuning (SFT) and Direct Preference Optimization (DPO).
Model Architecture:
Based on meta-llama/Llama-2-70b-hf with finance-specific pre-training and instruction tuning.
Input Output
Input Format:
Follow formatting requirements of Llama-2 chat, including `INST` and `<>` tags, and `~~` tokens.
Note: green Score (e.g. "73.2") means that the model is better than gradientai/v-alpha-tross.
Rank the V Alpha Tross Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
What open-source LLMs or SLMs are you in search of? 53972 in total.