LLM EXPLORER 59,420 MODELS INDEXED

Fine Tuned Codegen 16B Verilog by shailja

By shailja · 33 downloads

Fine Tuned Codegen 16B Verilog is an open-source language model by shailja. Features: 16b LLM, VRAM: 32.2GB, License: bigcode-openrail-m, Code Generating, LLM Explorer Score: 0.05.

  Arxiv:2212.11140   Code   Codegen   Dataset:shailja/verilog github   Endpoints compatible   Model-index   Pytorch   Region:us

Fine Tuned Codegen 16B Verilog Parameters and Internals

Model Type 
text-generation
Use Cases 
Primary Use Cases:
Teaching Assistant for Verilog HDL, Generating Verilog code snippets
Limitations:
Not an instruction model, Generated code is not guaranteed to work as intended
Considerations:
Pretrained dataset not filtered for permissive licenses
Additional Notes 
The model generates Verilog code snippets; generated content might require attribution due to the license of original datasets.
Supported Languages 
Verilog (High)
Training Details 
Data Sources:
shailja/Verilog_GitHub
Data Volume:
~72B
Methodology:
Fine-tuning
Training Time:
15 days
Hardware Used:
4 Tesla A100 GPUs
Model Architecture:
GPT-2 model with multi-query attention
Input Output 
Input Format:
Code prompt in Verilog
Accepted Modalities:
text
Output Format:
Generated Verilog code
Performance Tips:
Adding partial line of module header like 'module mux' improves output
LLM NameFine Tuned Codegen 16B Verilog
Repository πŸ€—https://huggingface.co/shailja/fine-tuned-codegen-16B-Verilog 
Model Size16b
Required VRAM32.2 GB
Updated2026-07-10
Maintainershailja
Model Typecodegen
Model Files  32.2 GB   0.0 GB
Generates CodeYes
Model ArchitectureCodeGenForCausalLM
Licensebigcode-openrail-m
Transformers Version4.22.0.dev0
Tokenizer ClassGPT2Tokenizer
Vocabulary Size50295
Torch Data Typefloat16
Activation Functiongelu_new

Best Alternatives to Fine Tuned Codegen 16B Verilog

Best Alternatives
Context / RAM
Downloads
Likes
Codegen2 16B P0K / 64.3 GB129045
Instruct Codegen 16B0K / 32.2 GB821
Codegen 16B Mono Toolbench0K / 128.4 GB75
Codegen 16B Multi 6 Parts0K / 32.2 GB120
Codegen 16B Nl Sharded0K / 32.1 GB247
Codegen 16B Nl0K / 32.2 GB68918
Codegen 16B Multi0K / 32.2 GB148119
Codegen 16B Mono0K / 32.2 GB89126
Note: green Score (e.g. "73.2") means that the model is better than shailja/fine-tuned-codegen-16B-Verilog.