PolyCoder 0.4B by NinedayWang

 ยป  All LLMs  ยป  NinedayWang  ยป  PolyCoder 0.4B   URL Share it on

  Arxiv:2202.13169   Autotrain compatible   Endpoints compatible   Gpt neox   Pytorch   Region:us

PolyCoder 0.4B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
PolyCoder 0.4B (NinedayWang/PolyCoder-0.4B)
๐ŸŒŸ Advertise your project ๐Ÿš€

PolyCoder 0.4B Parameters and Internals

Additional Notes 
The model was presented at MAPS'2022 and ICLR'2022 Workshop Deep Learning 4 Code.
Supported Languages 
programming_languages_supported (:{)
Training Details 
Data Volume:
249 GB
LLM NamePolyCoder 0.4B
Repository ๐Ÿค—https://huggingface.co/NinedayWang/PolyCoder-0.4B 
Model Size0.4b
Required VRAM1.7 GB
Updated2025-09-22
MaintainerNinedayWang
Model Typegpt_neox
Model Files  1.7 GB
Model ArchitectureGPTNeoXForCausalLM
Context Length2048
Model Max Length2048
Transformers Version4.23.1
Tokenizer ClassGPT2Tokenizer
Beginning of Sentence Token<|endoftext|>
End of Sentence Token<|endoftext|>
Unk Token<|endoftext|>
Vocabulary Size50304
Torch Data Typefloat32
Errorsreplace

Rank the PolyCoder 0.4B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51534 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124