LLM EXPLORER 65,444 MODELS INDEXED

Alpaca Cerebras 6.7B by bjoernp

By bjoernp · 0 downloads
HF Repo ↗ Copy URL

Alpaca Cerebras 6.7B is an open-source language model by bjoernp. Features: 6.7b LLM, License: apache-2.0, LLM Explorer Score: 0.06.

  Arxiv:1910.09700   Dataset:tatsu-lab/alpaca   Dataset:yahma/alpaca-cleaned   En   Endpoints compatible   Lora   Region:us
Model Card on HF 🤗: https://huggingface.co/bjoernp/alpaca-cerebras-6.7B 

Alpaca Cerebras 6.7B Parameters and Internals

Model Type 
Transformer-based Language Model
Additional Notes 
Experiments used a private infrastructure with estimated total emissions of 0.97 kgCO2eq.
Supported Languages 
English (proficient)
Training Details 
Data Sources:
yhama/alpaca-cleaned, tatsu-lab/alpaca
Data Volume:
20 tokens per model parameter (Chinchilla scaling laws)
Methodology:
Pre-training and fine-tuning on Cerebras systems with LoRA adapter
Context Length:
2048
Hardware Used:
Andromeda AI supercomputer with 16 CS-2 wafer scale systems
Model Architecture:
GPT-3 style architecture with LoRA adapter
Input Output 
Input Format:
Byte Pair Encoding
Accepted Modalities:
text
Output Format:
Generated text
LLM NameAlpaca Cerebras 6.7B
Repository 🤗https://huggingface.co/bjoernp/alpaca-cerebras-6.7B 
Model Size6.7b
Required VRAM0 GB
Updated2026-08-06
Maintainerbjoernp
Model Files  0.0 GB
Supported Languagesen
Model ArchitectureAutoModel
Licenseapache-2.0
Is Biasednone
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesc_attn
LoRA Alpha16
LoRA Dropout0.05
R Param8

Best Alternatives to Alpaca Cerebras 6.7B

Best Alternatives
Context / RAM
Downloads
Likes
Cerebras GPT 6.7B0K / 26.8 GB25165
Vigogne Opt 6.7B Instruct0K / 0 GB02
...pseek Coder 6.7B Instruct GGUF0K / 2.8 GB29540249
Deepseek Coder 6.7B Base GGUF0K / 2.8 GB1946023
...ydecompiler 3.7 6.7B V0.9 GGUF0K / 2.5 GB4260
...enCodeInterpreter DS 6.7B GGUF0K / 2.5 GB5012
Magicoder S DS 6.7B GGUF0K / 2.8 GB151676
Note: green Score (e.g. "73.2") means that the model is better than bjoernp/alpaca-cerebras-6.7B.