LLM Name | Falcon 180B WizardLM Orca LoRA |
Repository ๐ค | https://huggingface.co/quantumaikr/falcon-180B-WizardLM_Orca-LoRA |
Model Size | 180b |
Required VRAM | 0.2 GB |
Updated | 2025-08-21 |
Maintainer | quantumaikr |
Model Files | |
Model Architecture | Adapter |
Model Max Length | 2048 |
Is Biased | none |
Tokenizer Class | PreTrainedTokenizerFast |
PEFT Type | LORA |
LoRA Model | Yes |
PEFT Target Modules | query_key_value |
LoRA Alpha | 8 |
LoRA Dropout | 0.05 |
R Param | 16 |
Model |
Likes |
Downloads |
VRAM |
---|---|---|---|
Falcon 180B Chat AWQ | 8 | 8 | 96 GB |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
---|---|---|---|
Vulture 180B | 0K / 1.1 GB | 0 | 16 |
Falcon 180B Chat Asst Ds Lora | 0K / 0.5 GB | 3 | 1 |
Falcon 180B Instruct V0.1 | 0K / 4.3 GB | 3 | 4 |
LIMA 180B | 0K / 0.3 GB | 2 | 3 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐