CodeLlama 70B Hf GGUF is an open-source language model by TheBloke. Features: 70b LLM, VRAM: 25.5GB, License: llama2, Quantized, Code Generating, LLM Explorer Score: 0.12.
Testing conducted in English, may not cover all scenarios
Additional Notes
Code Llama is an auto-regressive language model that uses an optimized transformer architecture. It was fine-tuned with up to 16k tokens and supports up to 100k tokens at inference time.
Training Details
Context Length:
100000
Hardware Used:
Meta’s Research Super Cluster
Model Architecture:
optimized transformer architecture
Responsible Ai Considerations
Transparency:
Please see the Responsible Use Guide available at https://ai.meta.com/llama/responsible-use-guide.
Accountability:
The developer is accountable for ensuring model outputs are in compliance with laws and regulations.
Mitigation Strategies:
Perform safety testing and tuning tailored to specific applications.