LLM EXPLORER 59,420 MODELS INDEXED

Pythia Chinese 70M UDN by zhaorui-nb

By zhaorui-nb · 18 downloads

Pythia Chinese 70M UDN is an open-source language model by zhaorui-nb. Features: 70m LLM, VRAM: 0.2GB, Context: 2K, LLM Explorer Score: 0.15.

  Arxiv:1910.09700   Autotrain compatible Base model:finetune:islabresea... Base model:islabresearch/opend... Dataset:zhaorui-nb/uniteddaily...   Endpoints compatible   Gpt neox   Region:us   Safetensors

Pythia Chinese 70M UDN Parameters and Internals

LLM NamePythia Chinese 70M UDN
Repository πŸ€—https://huggingface.co/zhaorui-nb/pythia-chinese-70m-UDN 
Base Model(s)  ISLabResearch/opendeid-70m-ft-full   ISLabResearch/opendeid-70m-ft-full
Model Size70m
Required VRAM0.2 GB
Updated2024-11-29
Maintainerzhaorui-nb
Model Typegpt_neox
Model Files  0.2 GB
Model ArchitectureGPTNeoXForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.45.2
Tokenizer ClassGPTNeoXTokenizer
Padding Token<|pad|>
Vocabulary Size69586
Torch Data Typebfloat16

Best Alternatives to Pythia Chinese 70M UDN

Best Alternatives
Context / RAM
Downloads
Likes
Pythia 70M Deduped2K / 0.2 GB67708029
Pythia 70M2K / 0.2 GB51961685
Pythia 70m Sft Hh2K / 0.1 GB90
Pythia 70M Multi2K / 0.3 GB60
Pythia 70m Sft2K / 0.3 GB70
...ythia 70M Wikipedia Paragraphs2K / 0.3 GB43
...a 70M Deduped Cleansharegpt En2K / 0.3 GB520
...thia 70M Deduped Cleansharegpt2K / 0.3 GB1381
Chessdevilai2K / 0.3 GB50
...ythia 70M Deduped Step44k 92bt2K / 0.2 GB1130
Note: green Score (e.g. "73.2") means that the model is better than zhaorui-nb/pythia-chinese-70m-UDN.