LLM EXPLORER 59,420 MODELS INDEXED

Pythia 160M C2s by vandijklab

By vandijklab · 251 downloads

Pythia 160M C2s is an open-source language model by vandijklab. Features: 160m LLM, VRAM: 0.6GB, Context: 8K, License: cc-by-4.0, LLM Explorer Score: 0.11.

  Arxiv:2304.01373   Dataset:vandijklab/immune-c2s   Deploy:azure   En   Endpoints compatible   Gpt neox   Pytorch   Region:us   Safetensors   Scrna-seq

Pythia 160M C2s Parameters and Internals

Model Type 
causal-lm
Use Cases 
Areas:
Research, Single-cell transcriptomics
Applications:
Single-cell RNA sequencing analyses, Cell type prediction
Primary Use Cases:
Conditional cell generation, Unconditional cell generation
Considerations:
Best used with adequate hardware for full cell generation.
Additional Notes 
Cell2Sentence provides a novel approach for single-cell RNA sequencing data analysis by transforming it into cell sentences.
Supported Languages 
en (proficient)
Training Details 
Data Sources:
immune tissue dataset from Domínguez et al.
Methodology:
Cell2Sentence method for adapting large language models to single-cell transcriptomics.
Training Time:
20 hours
Hardware Used:
8 A100 40GB GPUs
Model Architecture:
Transform single-cell RNA sequencing data into sequences of gene names ordered by expression level, termed "cell sentences".
Input Output 
Input Format:
Gene names ordered by expression level
Accepted Modalities:
text
Output Format:
Cell sentences with gene expressions
Performance Tips:
Use an A100 GPU for better inference speed and memory capacity.
LLM NamePythia 160M C2s
Repository 🤗https://huggingface.co/vandijklab/pythia-160m-c2s 
Model Size160m
Required VRAM0.6 GB
Updated2026-07-20
Maintainervandijklab
Model Typegpt_neox
Model Files  0.6 GB
Supported Languagesen
Model ArchitectureGPTNeoXForCausalLM
Licensecc-by-4.0
Context Length9200
Model Max Length9200
Transformers Version4.37.1
Tokenizer ClassGPTNeoXTokenizer
Vocabulary Size50304
Torch Data Typefloat32

Best Alternatives to Pythia 160M C2s

Best Alternatives
Context / RAM
Downloads
Likes
Violet 160M Chat4K / 0.3 GB130
Pythia 160M2K / 0.4 GB229417444
Pythia 160M Deduped2K / 0.4 GB1334373
Pythia 160M Xsum Roya2K / 0.6 GB60
Pythia 160m Sft2K / 0 GB80
Sheared Pythia 160M2K / 0.7 GB534
Pythia160m Sft Tldr2K / 0.6 GB1750
Pythia 160M Dolphin Extended2K / 0.3 GB930
Pythia 160M Storytelling2K / 0.3 GB70
...hia 160M Deduped Step92k 193bt2K / 0.4 GB1200
Note: green Score (e.g. "73.2") means that the model is better than vandijklab/pythia-160m-c2s.