OrcaMaidXL 17B 32K GGUF by TheBloke

 ยป  All LLMs  ยป  TheBloke  ยป  OrcaMaidXL 17B 32K GGUF   URL Share it on

Base model:ddh0/orcamaidxl-17b... Base model:quantized:ddh0/orca...   Gguf   Llama   Quantized   Region:us

OrcaMaidXL 17B 32K GGUF Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
OrcaMaidXL 17B 32K GGUF (TheBloke/OrcaMaidXL-17B-32k-GGUF)
๐ŸŒŸ Advertise your project ๐Ÿš€

OrcaMaidXL 17B 32K GGUF Parameters and Internals

Model Type 
llama
Additional Notes 
This model is a slightly experimental frankenmerge of Microsoft's Orca-2-13b and Undi and IkariDev's Noromaid-v0.2-13b. The native context length is extended to 32768 via YaRN (original context length was 4096), and the base model is Llama 2.
Training Details 
Methodology:
Frankenmerge of Microsoft's Orca-2-13b (10 layers) and Noromaid-v0.2-13b (12 layers).
Context Length:
32768
Input Output 
Input Format:
Below is an instruction that describes a task. Write a response that appropriately completes the request. ### Instruction: {prompt} ### Response:
LLM NameOrcaMaidXL 17B 32K GGUF
Repository ๐Ÿค—https://huggingface.co/TheBloke/OrcaMaidXL-17B-32k-GGUF 
Model NameOrcaMaidXL 17B 32K
Model Creatorddh0
Base Model(s)  OrcaMaidXL 17B 32K   ddh0/OrcaMaidXL-17B-32k
Model Size17b
Required VRAM7.3 GB
Updated2025-09-23
MaintainerTheBloke
Model Typellama
Model Files  7.3 GB   9.3 GB   8.5 GB   7.6 GB   9.9 GB   10.5 GB   9.9 GB   12.0 GB   12.4 GB   12.0 GB   14.3 GB   18.6 GB
GGUF QuantizationYes
Quantization Typegguf
Model ArchitectureAutoModel
Licenseother

Rank the OrcaMaidXL 17B 32K GGUF Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51534 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124