| Model Type | | text generation, function calling, structured outputs |
|
| Use Cases |
| Areas: | | general task, conversation, function calling |
|
|
| Additional Notes | | Developed in collaboration with Fireworks.AI and @interstellarninja. |
|
| Training Details |
| Data Sources: | | OpenHermes 2.5 Dataset, Function Calling and JSON Mode dataset developed in-house |
|
| Methodology: | | Special system prompt and multi-turn function calling structure with ChatML. |
|
|
| Input Output |
| Input Format: | | ChatML - special tokens for beginning and end of turns, roles. |
|
| Accepted Modalities: | |
| Output Format: | | text, JSON structured outputs. |
|
| Performance Tips: | | Set 'add_generation_prompt=True' when tokenizing messages for generation using 'apply_chat_template()'. |
|
|
| Release Notes |
| Version: | |
| Notes: | | Enhanced with function calling capabilities and JSON mode responses. |
|
|
|