Medfalcon 40B Lora by nmitchko

 ยป  All LLMs  ยป  nmitchko  ยป  Medfalcon 40B Lora   URL Share it on

  Arxiv:2106.09685   Adapter   En   Finetuned   Lora   Medical   Peft   Region:us

Medfalcon 40B Lora Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Medfalcon 40B Lora (nmitchko/medfalcon-40b-lora)
๐ŸŒŸ Advertise your project ๐Ÿš€

Medfalcon 40B Lora Parameters and Internals

Model Type 
LoRA, text-generation
Use Cases 
Areas:
medical domain
Applications:
question-answering and medical dialogue tasks
Additional Notes 
This Lora supports 4-bit and 8-bit modes.
Training Details 
Methodology:
LoRA, specifically QLora
Model Architecture:
Based on Falcon-40b-instruct
LLM NameMedfalcon 40B Lora
Repository ๐Ÿค—https://huggingface.co/nmitchko/medfalcon-40b-lora 
Model Size40b
Required VRAM0.9 GB
Updated2025-08-21
Maintainernmitchko
Model Files  0.9 GB
Supported Languagesen
Model ArchitectureAdapter
Licensecc-by-nc-3.0
Is Biasednone
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesdense|query_key_value|dense_4h_to_h|dense_h_to_4h
LoRA Alpha16
LoRA Dropout0.05
R Param64

Quantized Models of the Medfalcon 40B Lora

Model
Likes
Downloads
VRAM
Falcon 40B Instruct GPTQ19732322 GB
Falcon 40B Instruct GGML58913 GB
Falcon 40B Instruct GPTQ11422 GB
Falcon 40B Instruct 8bit61341 GB

Best Alternatives to Medfalcon 40B Lora

Best Alternatives
Context / RAM
Downloads
Likes
Medfalcon V2 40B Lora0K / 0.9 GB33
Falcon 40B Code Alpaca Lora0K / 0 GB02
Falcon 40B Chat V0.10K / 0 GB738
... 40B Int4 Peft Lora Sfttrainer0K / 1.8 GB012
Falcon 40B Guanaco Lora0K / 0.2 GB04
Falcon 40B Qlora Oasst De0K / 1.8 GB02
...lcon Lora 40b Ckpt 500 Oasst 10K / 1.8 GB01
...e WizardLM Uncensored 40B Lora0K / 0.1 GB01
Note: green Score (e.g. "73.2") means that the model is better than nmitchko/medfalcon-40b-lora.

Rank the Medfalcon 40B Lora Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 50804 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124