Manticore 13B Chat Pyg Guanaco by Monero

 ยป  All LLMs  ยป  Monero  ยป  Manticore 13B Chat Pyg Guanaco   URL Share it on

  Autotrain compatible   Endpoints compatible   Llama   Manticore   Pytorch   Region:us   Sharded

Manticore 13B Chat Pyg Guanaco Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Manticore 13B Chat Pyg Guanaco (Monero/Manticore-13b-Chat-Pyg-Guanaco)
๐ŸŒŸ Advertise your project ๐Ÿš€

Manticore 13B Chat Pyg Guanaco Parameters and Internals

Model Type 
Chat, Language Model
Additional Notes 
This model has the qLoRa (quantized Low Rank Adaptation) applied, which is a technique for optimizing large models.
LLM NameManticore 13B Chat Pyg Guanaco
Repository ๐Ÿค—https://huggingface.co/Monero/Manticore-13b-Chat-Pyg-Guanaco 
Model Size13b
Required VRAM26.3 GB
Updated2025-09-23
MaintainerMonero
Model Typellama
Model Files  4.0 GB: 1-of-7   4.0 GB: 2-of-7   4.0 GB: 3-of-7   3.9 GB: 4-of-7   4.0 GB: 5-of-7   4.0 GB: 6-of-7   2.4 GB: 7-of-7
Model ArchitectureLlamaForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.28.0
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
Torch Data Typefloat16

Quantized Models of the Manticore 13B Chat Pyg Guanaco

Model
Likes
Downloads
VRAM
...core 13B Chat Pyg Guanaco GGML3695 GB
...13B Chat Pyg Guanaco Gptq 4bit167 GB

Best Alternatives to Manticore 13B Chat Pyg Guanaco

Best Alternatives
Context / RAM
Downloads
Likes
Luminaura RP 13B128K / 26 GB60
Yarn Llama 2 13B 128K128K / 26 GB34112
Agent Llama2 13B 80K80K / 26.4 GB50
Chat Llama2 13B 80K80K / 52.8 GB50
LongAlign 13B 64K64K / 26 GB11513
LongAlign 13B 64K Base64K / 26 GB923
LongAlign 13B 64K64K / 26 GB1113
LongAlign 13B 64K Base64K / 26 GB63
Openbuddy Llama2 13B V15p1 64K64K / 26.1 GB64
Openbuddy Llama2 13b64k V1564K / 26.1 GB52
Note: green Score (e.g. "73.2") means that the model is better than Monero/Manticore-13b-Chat-Pyg-Guanaco.

Rank the Manticore 13B Chat Pyg Guanaco Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51544 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124