Falcon2 5.5B Multilingual Parameters and Internals
Model Type
text generation
Use Cases
Areas:
research, specialization, fine-tuning
Applications:
summarization, text generation, chatbot
Primary Use Cases:
text generation across supported languages
Limitations:
Limited generalization to languages outside the trained set.
Considerations:
Appropriate precautions for production uses.
Additional Notes
Ensure evaluation of harm and biases for any production deployments.
Supported Languages
es (fluent), fr (fluent), de (fluent), no (fluent), sv (fluent), da (fluent), nl (fluent), pt (fluent), pl (fluent), ro (fluent), it (fluent), cs (fluent)
Training Details
Data Sources:
wikimedia/wikipedia subsets of 11 languages
Data Volume:
5 trillion tokens
Methodology:
Pruning using PruneMe with analysis across multiple languages
Model Architecture:
Transformed from Falcon-11B using passthrough merge method
Safety Evaluation
Methodologies:
layer similarity analysis
Findings:
model carries typical online stereotypes and biases
Risk Categories:
bias, generalization
Ethical Considerations:
Model trained on large-scale, web-representative corpora; potential presence of biases.
Responsible Ai Considerations
Fairness:
Ensure model deployment evaluates fairness and bias.
Transparency:
Pruning methodolgy is documented, but not easy to reverse.
Accountability:
Deploying organization should be accountable for harm from outputs.
Mitigation Strategies:
Finetuning and guardrails recommended.
Input Output
Input Format:
text input in any of the supported languages.
Accepted Modalities:
text
Output Format:
generated text based on input prompt.
Performance Tips:
Fine-tuning recommended for specific domain applications.
Note: green Score (e.g. "73.2") means that the model is better than ssmits/Falcon2-5.5B-multilingual.
Rank the Falcon2 5.5B Multilingual Capabilities
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
What open-source LLMs or SLMs are you in search of? 52721 in total.