Finance LLM GPTQ is an open-source language model by TheBloke. Features: 6.7b LLM, VRAM: 3.9GB, Context: 2K, License: other, Quantized, Instruction-Based, LLM Explorer Score: 0.1.
Finance LLM GPTQ Parameters and Internals
Model Type Use Cases
Areas: Considerations: While enriching LLMs with domain knowledge, prompting ability for question answering is significantly affected.
Additional Notes Explores enhancement of large language models with domain-specific knowledge through continued pre-training on domain-specific corpora.
Supported Languages Training Details
Data Sources: Open-Orca/OpenOrca, GAIR/lima, WizardLM/WizardLM_evol_instruct_V2_196k
Methodology: Continued pre-training on domain-specific corpora, transforming corpora into reading comprehension texts.
Context Length: Hardware Used: Model Architecture: Based on LLaMA-1 architecture.
Input Output
Input Format: [INST] <> {system_message} <> {prompt} [/INST]
Accepted Modalities:
LLM Name Finance LLM GPTQ Repository 🤗 https://huggingface.co/TheBloke/finance-LLM-GPTQ Model Name Finance LLM Model Creator AdaptLLM Base Model(s) Finance LLM AdaptLLM/finance-LLM Model Size 6.7b Required VRAM 3.9 GB Updated 2026-07-21 Maintainer TheBloke Model Type llama Instruction-Based Yes Model Files 3.9 GB Supported Languages en GPTQ Quantization Yes Quantization Type gptq Model Architecture LLaMAForCausalLM License other Context Length 2048 Model Max Length 2048 Transformers Version 4.36.2 Tokenizer Class LlamaTokenizer Padding Token <pad> Vocabulary Size 32001 Torch Data Type float16
Rank the Finance LLM GPTQ capabilities
Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
Best Alternatives to Finance LLM GPTQ
Note: green Score (e.g. "73.2 ") means that the model is better than TheBloke/finance-LLM-GPTQ .
Expand