Llama 2 70B Instruct V0.1 is an open-source language model by dfurman. Features: 70b LLM, VRAM: 1.1GB, License: llama2, Instruction-Based, LLM Explorer Score: 0.09.
Llama 2 70B Instruct V0.1 Parameters and Internals
Model Type
text generation
Use Cases
Areas:
research
Limitations:
Model can produce factually incorrect output that may include offensive material.
Considerations:
Should not be relied upon for factually accurate information.
Additional Notes
Example prompts and specific usage scenarios are provided in the documentation.
Training Details
Data Sources:
ehartford/dolphin
Methodology:
parameter-efficient QLoRA finetuning
Context Length:
4096
Training Time:
roughly 17 hours
Hardware Used:
single H100 (80 GB PCIe)
Model Architecture:
Standard decoder-only transformer modified with SwiGLU activation, rotary positional embeddings (RoPE), grouped-query attention (GQA), and other specifications.
Responsible Ai Considerations
Fairness:
The model may produce biased outputs.
Transparency:
The evaluation results are made transparent through the open LLM leaderboard.
Accountability:
Model was fine-tuned by Daniel Furman.
Input Output
Input Format:
Standard decoder-only transformer input format, processed using tokenization.
Accepted Modalities:
text
Output Format:
Text-based generation appropriate for instructed tasks.
Release Notes
Version:
v0.1
Date:
2023-07-23
Notes:
This model, fine-tuned by Daniel Furman, is intended primarily for research purposes and ranks 6th on the Open LLM Leaderboard.
Note: green Score (e.g. "73.2") means that the model is better than dfurman/Llama-2-70B-Instruct-v0.1.
Rank the Llama 2 70B Instruct V0.1 Capabilities
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
What open-source LLMs or SLMs are you in search of? 52721 in total.