TeenyTinyLlama 160M is an open-source language model by nicholasKluge. Features: 160m LLM, VRAM: 0.7GB, Context: 2K, License: apache-2.0, Instruction-Based, LLM Explorer Score: 0.1.
TeenyTinyLlama 160M Parameters and Internals
Model Type Use Cases
Areas: Primary Use Cases: Researching language models for low-resource languages
Limitations: Not suitable for translation or generating text in other languages, Not fine-tuned for downstream contexts
Considerations: Perform risk and bias assessment before use in real-world applications.
Supported Languages Training Details
Data Sources: Pt-Corpus Instruct (6.2B tokens)
Data Volume: Methodology: Transformer-based model pre-trained via causal language modeling
Context Length: Training Time: Hardware Used: Model Architecture:
Responsible Ai Considerations
Fairness: The model may produce biased or toxic content due to inherited stereotypes from the training data.
Input Output
Accepted Modalities: Performance Tips: Ensure proper configuration of repetition penalty and generation parameters like temperature, top-k, and top-p to optimize outputs.
Rank the TeenyTinyLlama 160M capabilities
Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
Expand