The model consists of 28 layers, each consisting of one feedforward block and one self-attention block. The model dimension is 4096, feedforward dimension is 16384, using Rotary position encodings (RoPE).
Input Output
Input Format:
Tokenized text input.
Accepted Modalities:
text
Output Format:
Generated text
Performance Tips:
Ensure correct tokenization and appropriate model parameters like temperature, top_p, etc.
Note: green Score (e.g. "73.2") means that the model is better than NovelAI/genji-jp.
Rank the Genji Jp Capabilities
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
What open-source LLMs or SLMs are you in search of? 52509 in total.