CodeGemma 7B AWQ is an open-source language model by TechxGenus. Features: 7b LLM, VRAM: 7.2GB, Context: 8K, License: other, Quantized, LLM Explorer Score: 0.14, Arc: 53.9, HellaSwag: 76.7, MMLU: 56.6, GSM8K: 45.5, HumanEval: 40.1.
CodeGemma 7B AWQ Parameters and Internals
| Model Type | | text-generation, code generation |
|
| Use Cases |
| Areas: | | text generation, code generation |
|
| Primary Use Cases: | | code generation, coding-related tasks |
|
| Limitations: | | Model may produce errors, misleading contents, or struggle with non-coding tasks., Limited testing, requires additional safety evaluation. |
|
| Considerations: | | Additional safety testing required for real-world deployment. |
|
|
| Supported Languages | | programming languages (Python) |
|
| Training Details |
| Data Sources: | | Gemma-7b base model , additional 0.7 billion high-quality, code-related tokens |
|
| Data Volume: | | 0.7 billion high-quality tokens |
|
| Methodology: | | Fine-tuned with DeepSpeed ZeRO 3 and Flash Attention 2 |
|
| Training Time: | |
|
| Safety Evaluation |
| Ethical Considerations: | | Limited testing, additional safety testing recommended before real-world deployment. |
|
|
| Input Output |
| Input Format: | | Instruction format, Alpaca instruction format (excluding system prompt) |
|
| Accepted Modalities: | |
| Output Format: | |
|
Best Alternatives to CodeGemma 7B AWQ
Note: green Score (e.g. "73.2") means that the model is better than TechxGenus/CodeGemma-7b-AWQ.