Falcon2 5.5B Portuguese is an open-source language model by ssmits. Features: 11b LLM, VRAM: 10.9GB, Context: 8K, License: apache-2.0, Merged, LLM Explorer Score: 0.13.
generalization issues to unsupported languages, biases from web-corpora
Considerations:
Tailor to specific tasks and assessments.
Additional Notes
This model was part of a merge using mergekit with specific layer configurations.
Supported Languages
Portuguese (native), English (proficient), German (proficient), Spanish (proficient), French (proficient), Italian (proficient), Polish (proficient), Dutch (proficient), Romanian (proficient), Czech (proficient), Swedish (proficient)
Training Details
Data Sources:
wikimedia/wikipedia Portuguese subset
Methodology:
continued pre-training and pruning using layer similarity to maintain performance while reducing model size
Safety Evaluation
Methodologies:
PruneMe layer similarity analysis
Risk Categories:
bias, generalization issues
Responsible Ai Considerations
Mitigation Strategies:
Fine-tuning and guardrails recommended for production use.
Input Output
Input Format:
Text
Accepted Modalities:
text
Output Format:
Text
Performance Tips:
Use PyTorch 2.0 for optimal inference with Falcon models
Release Notes
Notes:
Merged using passthrough method and pruned with PruneMe for optimized performance.
Note: green Score (e.g. "73.2") means that the model is better than ssmits/Falcon2-5.5B-Portuguese.
Rank the Falcon2 5.5B Portuguese Capabilities
🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
What open-source LLMs or SLMs are you in search of? 53999 in total.