Orion 14B LongChat 6.0bpw Exl is an open-source language model by KnutJaegersberg. Features: 14b LLM, VRAM: 11.5GB, Context: 195K, License: other, LLM Explorer Score: 0.12.
Orion 14B LongChat 6.0bpw Exl Parameters and Internals
Model Type
text generation
Use Cases
Areas:
Research, Commercial applications
Applications:
Multilingual text generation, Chat applications
Primary Use Cases:
Interactive chat, Multilingual understanding
Limitations:
Not suitable for tasks requiring legal compliance or national security without proper review
Considerations:
Ensure safe and compliant use
Additional Notes
The Orion-14B-LongChat model excels in handling extremely long contexts, with robust multilingual understanding and state-of-the-art performance in token length handling.
Supported Languages
English (Full), Japanese (High), Korean (High), Chinese (High)
Training Details
Data Sources:
Diverse dataset of 2.5 trillion tokens
Data Volume:
2.5 trillion tokens
Methodology:
Pretrained on a diverse dataset, fine-tuned for specific tasks
Context Length:
320000
Model Architecture:
Large Language Model optimized for long-context text generation
Responsible Ai Considerations
Accountability:
OrionStarAI
Mitigation Strategies:
Compliance efforts during data preparation
Input Output
Input Format:
Text input
Accepted Modalities:
text
Output Format:
Text generation
Release Notes
Version:
3.0
Date:
2023-10-05
Notes:
Optimized for long-text processing, supporting up to 320K tokens
Note: green Score (e.g. "73.2") means that the model is better than KnutJaegersberg/Orion-14B-LongChat-6.0bpw-exl.
Rank the Orion 14B LongChat 6.0bpw Exl Capabilities
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
What open-source LLMs or SLMs are you in search of? 52473 in total.