LLM EXPLORER 62,323 MODELS INDEXED

Galactica Ref by mariatager

By mariatager · 5 downloads

Galactica Ref is an open-source language model by mariatager. Features: 125m LLM, VRAM: 0.5GB, Context: 2K, LLM Explorer Score: 0.12.

  Arxiv:1910.09700   Endpoints compatible   Opt   Region:us   Safetensors

Galactica Ref Parameters and Internals

LLM NameGalactica Ref
Repository πŸ€—https://huggingface.co/mariatager/galactica_ref 
Model Size125m
Required VRAM0.5 GB
Updated2026-07-20
Maintainermariatager
Model Typeopt
Model Files  0.5 GB
Model ArchitectureOPTForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.41.2
Tokenizer ClassPreTrainedTokenizerFast
Padding Token[PAD]
Vocabulary Size50003
Torch Data Typefloat32
Activation Functiongelu

Best Alternatives to Galactica Ref

Best Alternatives
Context / RAM
Downloads
Likes
Opt 125M2K / 0.3 GB9414291252
...25M Gqa Ub 6 Best For KV Cache2K / 0.5 GB2070
...125M Qcqa Ub 6 Best For Q Loss2K / 0.5 GB570
...5M Qcqa Ub 6 Best For KV Cache2K / 0.5 GB580
Galactica 125M Cot2K / 0.5 GB50
Galactica 125M DPO2K / 0.5 GB70
Galactica 125M DPO Pos2K / 0.5 GB50
BertQA2K / 0.5 GB50
BertQA2K / 0.5 GB50
Opt 125M Quantized Brevitas2K /  GB60
Note: green Score (e.g. "73.2") means that the model is better than mariatager/galactica_ref.