Medicine LLM GPTQ is an open-source language model by TheBloke. Features: 6.7b LLM, VRAM: 3.9GB, Context: 2K, License: other, Quantized, Instruction-Based, LLM Explorer Score: 0.11.
Medicine LLM GPTQ Parameters and Internals
Model Type Additional Notes This repo contains GPTQ model files for AdaptLLM's Medicine LLM with various quantisation parameter permutations for different hardware and requirements.
Supported Languages Training Details
Data Sources: Open-Orca/OpenOrca, GAIR/lima, WizardLM/WizardLM_evol_instruct_V2_196k, EleutherAI/pile
Methodology: continued pre-training on domain-specific corpora transforming into reading comprehension texts
Context Length:
Input Output
Input Format: ### User Input: {prompt} ### Assistant Output:
Accepted Modalities:
Release Notes
Version: Notes: 4-bit, with Act Order and group size 128g. Uses even less VRAM than 64g, but with slightly lower accuracy.
Version: gptq-4bit-32g-actorder_True
Notes: 4-bit, with Act Order and group size 32g. Gives highest possible inference quality, with maximum VRAM usage.
Version: gptq-8bit--1g-actorder_True
Notes: 8-bit, with Act Order. No group size, to lower VRAM requirements.
Version: gptq-8bit-128g-actorder_True
Notes: 8-bit, with group size 128g for higher inference quality and with Act Order for even higher accuracy.
Version: gptq-8bit-32g-actorder_True
Notes: 8-bit, with group size 32g and Act Order for maximum inference quality.
Version: gptq-4bit-64g-actorder_True
Notes: 4-bit, with Act Order and group size 64g. Uses less VRAM than 32g, but with slightly lower accuracy.
LLM Name Medicine LLM GPTQ Repository 🤗 https://huggingface.co/TheBloke/medicine-LLM-GPTQ Model Name Medicine LLM Model Creator AdaptLLM Base Model(s) Medicine LLM AdaptLLM/medicine-LLM Model Size 6.7b Required VRAM 3.9 GB Updated 2026-07-26 Maintainer TheBloke Model Type llama Instruction-Based Yes Model Files 3.9 GB Supported Languages en GPTQ Quantization Yes Quantization Type gptq Model Architecture LLaMAForCausalLM License other Context Length 2048 Model Max Length 2048 Transformers Version 4.37.0.dev0 Tokenizer Class LlamaTokenizer Padding Token <pad> Vocabulary Size 32001 Torch Data Type float16
Rank the Medicine LLM GPTQ capabilities
Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
Best Alternatives to Medicine LLM GPTQ
Expand