LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

Dromedary 65B Lora HF by TheBloke

 »  All LLMs  »  TheBloke  »  Dromedary 65B Lora HF   URL Share it on

  1803   
  Autotrain compatible   Llama   Lora   Pytorch   Region:us   Sharded
Model Card on HF 🤗: https://huggingface.co/TheBloke/dromedary-65b-lora-HF 

Dromedary 65B Lora HF Benchmarks

ARC: 61.6 vs 96.7 (so35)-36.3%
HellaSwag: 82.53 vs 95.3 (gpt4)-13.4%
MMLU: 63.08 vs 88.3 (so35)-28.6%
TruthfulQA: 38.82 vs 59 (gpt4)-34.2%
WinoGrande: 78.93 vs 87.5 (gpt4)-9.8%
GSM8K: 27.45 vs 96.4 (so35)-71.5%
LLME Score: 0.12117
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Dromedary 65B Lora HF (TheBloke/dromedary-65b-lora-HF)
🌟 Advertise your project 🚀

Dromedary 65B Lora HF Parameters and Internals

Model Type 
self-aligned language model
Use Cases 
Areas:
Research
Primary Use Cases:
Research on the alignment of large language models
Additional Notes 
The model's knowledge is up until September 2021, and it was trained with minimal human supervision.
Training Details 
Data Sources:
< 200 seed prompts, 16 generic principles, 5 exemplars for in-context learning
Data Volume:
Fewer than 300 lines of human annotations
Methodology:
LoRA configuration targeting 'q_proj,k_proj,v_proj,o_proj' with lora_r=16
Training Time:
April 2023 to May 2023
Model Architecture:
Transformer architecture
LLM NameDromedary 65B Lora HF
Repository 🤗https://huggingface.co/TheBloke/dromedary-65b-lora-HF 
Model Size65b
Required VRAM130.4 GB
Updated2025-09-15
MaintainerTheBloke
Model Typellama
Model Files  9.9 GB: 1-of-14   9.7 GB: 2-of-14   9.7 GB: 3-of-14   9.7 GB: 4-of-14   9.7 GB: 5-of-14   9.7 GB: 6-of-14   9.7 GB: 7-of-14   9.7 GB: 8-of-14   9.7 GB: 9-of-14   9.7 GB: 10-of-14   9.7 GB: 11-of-14   9.7 GB: 12-of-14   9.7 GB: 13-of-14   4.1 GB: 14-of-14
Model ArchitectureLlamaForCausalLM
Licenseother
Context Length2048
Model Max Length2048
Transformers Version4.28.1
Tokenizer ClassLlamaTokenizer
Beginning of Sentence Token<s>
End of Sentence Token</s>
Unk Token<unk>
Vocabulary Size32000
LoRA ModelYes
Torch Data Typefloat16

Quantized Models of the Dromedary 65B Lora HF

Model
Likes
Downloads
VRAM
Dromedary 65B Lora GPTQ6433 GB

Best Alternatives to Dromedary 65B Lora HF

Best Alternatives
Context / RAM
Downloads
Likes
Lite Oute 1 65M2K / 0.3 GB419
Lite Oute 1 65M Instruct2K / 0.3 GB712
StableBeluga1 Delta2K / 130.4 GB183457
Airoboros 65B Gpt4 M2.02K / 130.4 GB17250
Airoboros 65B Gpt4 2.02K / 130.4 GB17360
Openbuddy Llama 65B V8 Bf162K / 130.6 GB17969
UltraLM 65B2K / 130.4 GB18258
Airoboros 65B Gpt4 1.42K / 130.4 GB172717
Llama 65B Instruct2K / 130.4 GB174514
Airoboros 65B Gpt4 1.32K / 130.4 GB17111
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/dromedary-65b-lora-HF.

Rank the Dromedary 65B Lora HF Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51387 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124
  Support LLM Explorer