Fireball Alpaca Llama3.1.06 8B Philos is an open-source language model by EpistemeAI2. Features: 8b LLM, VRAM: 16.1GB, Context: 128K, License: apache-2.0, LLM Explorer Score: 0.15.
Fireball Alpaca Llama3.1.06 8B Philos Parameters and Internals
Model Type
text-generation-inference, question-answering
Use Cases
Areas:
Commercial use, Research
Applications:
Natural language generation tasks
Primary Use Cases:
Assistant-like chat, Natural language generation tasks
Limitations:
Use in languages beyond those explicitly referenced as supported
Considerations:
Additional languages support requires fine-tuning and compliance with the license terms.
Additional Notes
Model training was sped up using Unsloth and Huggingface's TRL library.
Supported Languages
English (High proficiency), German (High proficiency), French (High proficiency), Italian (High proficiency), Portuguese (High proficiency), Hindi (High proficiency), Spanish (High proficiency), Thai (High proficiency)
Training Details
Data Sources:
A new mix of publicly available online data
Data Volume:
15T+ tokens
Methodology:
Supervised Fine tuning (SFT) and Reinforcement Learning with Human Feedback (RLHF)
Context Length:
128000
Model Architecture:
Llama 3.1 - auto-regressive language model with transformer architecture
Safety Evaluation
Methodologies:
red-teaming, adversarial tests
Findings:
Potential outputs cannot be predicted in advance and may include inaccurate or biased responses.
Risk Categories:
misinformation, bias
Ethical Considerations:
Developers should perform safety testing and tuning tailored to their specific model applications.
Responsible Ai Considerations
Fairness:
Efforts to avoid biases through diverse language support.
Transparency:
Details on data sources and training methods provided.
Accountability:
Developers encouraged to implement system safeguards before deploying.
Mitigation Strategies:
Includes safety fine-tuning and synthesis of quality data.
Input Output
Input Format:
ChatML prompt template
Accepted Modalities:
text
Output Format:
Multilingual Text and code
Performance Tips:
Usage with the 'transformers' library as specified in instructions.
Release Notes
Version:
3.1
Date:
July 23, 2024
Notes:
New capabilities include a longer context window, multilingual inputs and outputs.
Note: green Score (e.g. "73.2") means that the model is better than EpistemeAI2/Fireball-Alpaca-Llama3.1.06-8B-Philos.
Rank the Fireball Alpaca Llama3.1.06 8B Philos Capabilities
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
What open-source LLMs or SLMs are you in search of? 52721 in total.