H2o Danube 1.8B Sft is an open-source language model by h2oai. Features: 1.8b LLM, VRAM: 3.7GB, Context: 16K, License: apache-2.0, LLM Explorer Score: 0.14, Arc: 40.2, HellaSwag: 67.3, MMLU: 33.8, GSM8K: 15.1.
H2o Danube 1.8B Sft Parameters and Internals
| Model Type | |
| Use Cases |
| Areas: | | Research, Commercial applications |
|
| Limitations: | | Incorrect, nonsensical or irrelevant responses |
|
| Considerations: | | Users should ensure ethical use and be aware of potential biases in the generated outputs. |
|
|
| Additional Notes | | The model architecture details and usage guidelines are provided in the model card and technical report. |
|
| Training Details |
| Data Sources: | | Open-Orca/OpenOrca, OpenAssistant/oasst2, HuggingFaceH4/ultrachat_200k, meta-math/MetaMathQA |
|
| Methodology: | | The model was trained using H2O LLM Studio with sliding window attention from mistral. |
|
| Context Length: | |
| Model Architecture: | | MistralForCausalLM incorporating Llama 2 architecture with sliding window attention. |
|
|
| Input Output |
| Performance Tips: | | Quantization and sharding are supported in the transformers library for efficient usage. |
|
|
Best Alternatives to H2o Danube 1.8B Sft
Note: green Score (e.g. "73.2") means that the model is better than h2oai/h2o-danube-1.8b-sft.