| LLM Name | Nemo Erebus | 
| Repository ๐ค | https://huggingface.co/NewEden/nemo-erebus | 
| Model Size | 12.2b | 
| Required VRAM | 24.5 GB | 
| Updated | 2025-01-05 | 
| Maintainer | NewEden | 
| Model Files | |
| Model Architecture | Adapter | 
| Model Max Length | 1024000 | 
| Is Biased | none | 
| Tokenizer Class | PreTrainedTokenizerFast | 
| Padding Token | <pad> | 
| PEFT Type | LORA | 
| LoRA Model | Yes | 
| PEFT Target Modules | k_proj|q_proj|o_proj|v_proj|up_proj|gate_proj|down_proj | 
| LoRA Alpha | 32 | 
| LoRA Dropout | 0.1 | 
| R Param | 64 | 
| Best Alternatives | Context / RAM | Downloads | Likes | 
|---|---|---|---|
| Madness Erebus | 0K / 24.5 GB | 55 | 0 | 
| Madness Erebus | 0K / 24.5 GB | 10 | 1 | 
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐