Speechless Codellama 34B V2.0 AWQ is an open-source language model by TheBloke. Features: 34b LLM, VRAM: 18.3GB, Context: 16K, License: llama2, Quantized, Instruction-Based, Code Generating, LLM Explorer Score: 0.09.
Speechless Codellama 34B V2.0 AWQ Parameters and Internals
Model Type
Use Cases
Areas:
Applications: code synthesis, code understanding
Limitations: Testing conducted has been in English, potential outputs cannot be predicted in advance, may produce inaccurate or objectionable responses.
Considerations: Perform safety testing and tuning tailored to specific applications of the model.
Additional Notes Utilizes AWQ, a low-bit weight quantization method to reduce hardware requirements.
Training Details
Data Sources: jondurbin/airoboros-2.2, Open-Orca/OpenOrca, garage-bAInd/Open-Platypus, WizardLM/WizardLM_evol_instruct_V2_196k
Context Length:
Training Time:
Hardware Used:
Safety Evaluation
Ethical Considerations: Use in any manner that violates applicable laws or regulations (including trade compliance laws) is prohibited. Use in languages other than English. Use in any other way that is prohibited by the Acceptable Use Policy and Licensing Agreement for Code Llama and its variants.
Input Output
Accepted Modalities:
Output Format:
Performance Tips: Utilizes AWQ for efficient 4-bit quantization, allowing smaller GPUs.
LLM Name Speechless Codellama 34B V2.0 AWQ Repository π€ https://huggingface.co/TheBloke/speechless-codellama-34b-v2.0-AWQ Model Name Speechless Codellama 34B v2.0 Model Creator Jiangwen Su Base Model(s) uukuguy/speechless-codellama-34b-v2.0 uukuguy/speechless-codellama-34b-v2.0 Model Size 34b Required VRAM 18.3 GB Updated 2026-08-08 Maintainer TheBloke Model Type llama Instruction-Based Yes Model Files 9.9 GB: 1-of-2 8.4 GB: 2-of-2 Supported Languages en AWQ Quantization Yes Quantization Type awq Generates Code Yes Model Architecture LlamaForCausalLM License llama2 Context Length 16384 Model Max Length 16384 Transformers Version 4.34.0 Tokenizer Class LlamaTokenizer Beginning of Sentence Token <s> End of Sentence Token </s> Unk Token <unk> Vocabulary Size 32000 Torch Data Type float16
Rank the Speechless Codellama 34B V2.0 AWQ capabilities
Have you tried this model? Rate its performance β this feedback helps the ML community find the right model for their needs.
Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation
Best Alternatives to Speechless Codellama 34B V2.0 AWQ
Note: green Score (e.g. "73.2 ") means that the model is better than TheBloke/speechless-codellama-34b-v2.0-AWQ .
Expand