Cypher Mini 1.8B is an open-source language model by aloobun. Features: 1.8b LLM, VRAM: 3.7GB, Context: 16K, License: apache-2.0, LLM Explorer Score: 0.14, Arc: 39.6, HellaSwag: 67.5, MMLU: 31.1, GSM8K: 14.5.
Cypher Mini 1.8B Parameters and Internals
Model Type
Additional Notes This is an experimental model finetuned on a combination of Hercules v3 dataset and a private dataset.
Training Details
Data Sources: Locutusque/Hercules-v3.0, Private dataset
Methodology: Mixture of experts approach
Input Output
Input Format: <|system|>~~<|prompt|>~~<|answer|>
Accepted Modalities:
Performance Tips: Hyperparameters include adamw optimizer with eps of 1e-8, cosine decay with 20% warmup, and learning rate of 2e-5.
Rank the Cypher Mini 1.8B capabilities
Have you tried this model? Rate its performance β this feedback helps the ML community find the right model for their needs.
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
Best Alternatives to Cypher Mini 1.8B
Note: green Score (e.g. "73.2 ") means that the model is better than aloobun/Cypher-Mini-1.8B .
Expand