LLM EXPLORER 61,249 MODELS INDEXED

Pythia 1.4B Helpful Sft by lomahony

By lomahony · 9 downloads

Pythia 1.4B Helpful Sft is an open-source language model by lomahony. Features: 1.4b LLM, VRAM: 2.8GB, Context: 2K, License: apache-2.0, LLM Explorer Score: 0.09.

  Arxiv:2101.00027   Dataset:anthropic/hh-rlhf   En   Endpoints compatible   Gpt neox   Pythia   Pytorch   Region:us   Safetensors

Pythia 1.4B Helpful Sft Parameters and Internals

Model Type 
causal-lm
Additional Notes 
Fully reproducible finetuning code is available on GitHub.
Training Details 
Data Sources:
Anthropic/hh-rlhf
Methodology:
Supervised fine-tuning using TRLx library
Training Time:
1 epoch
LLM NamePythia 1.4B Helpful Sft
Repository πŸ€—https://huggingface.co/lomahony/pythia-1.4b-helpful-sft 
Model Size1.4b
Required VRAM2.8 GB
Updated2026-06-04
Maintainerlomahony
Model Typegpt_neox
Model Files  2.8 GB   2.8 GB
Supported Languagesen
Model ArchitectureGPTNeoXForCausalLM
Licenseapache-2.0
Context Length2048
Model Max Length2048
Transformers Version4.34.1
Tokenizer ClassGPTNeoXTokenizer
Padding Token<|padding|>
Vocabulary Size50304
Torch Data Typebfloat16

Best Alternatives to Pythia 1.4B Helpful Sft

Best Alternatives
Context / RAM
Downloads
Likes
Pythia 1.4B Deduped 8K Base8K / 7.3 GB41
Violet 1b4 Chat4K / 2.8 GB137
Pythia 1.4B Deduped 4K Base4K / 6.1 GB82
Statichh Pythia 1.4B Sft Bf162K / 5.7 GB50
Pythia 1.4B2K / 2.9 GB9524727
Pythia 1.4B Sft Full2K / 2.8 GB291
Pythia 1.4B Deduped2K / 5.7 GB1473722
Pythia Delphi Suboptimal2K / 5.7 GB50
RCC Ins Reconstruction2K / 6.1 GB131
Pythia 1.4B Deduped Sharegpt2K / 2.8 GB1292
Note: green Score (e.g. "73.2") means that the model is better than lomahony/pythia-1.4b-helpful-sft.