LLM EXPLORER 61,755 MODELS INDEXED

Replit V2 CodeInstruct 3B GGML by abacaj

By abacaj · 2 downloads

Replit V2 CodeInstruct 3B GGML is an open-source language model by abacaj. Features: 3b LLM, VRAM: 1.5GB, License: other, Quantized, LLM Explorer Score: 0.07.

  Custom code   Ggml   Mpt   Quantized   Region:us

Replit V2 CodeInstruct 3B GGML Parameters and Internals

Model Type 
code instruction
Additional Notes 
This is a ggml quantized version (q4_1). Inference can be run using ggml directly or ctransformers.
LLM NameReplit V2 CodeInstruct 3B GGML
Repository πŸ€—https://huggingface.co/abacaj/Replit-v2-CodeInstruct-3B-ggml 
Base Model(s)  Replit V2 CodeInstruct 3B   teknium/Replit-v2-CodeInstruct-3B
Model Size3b
Required VRAM1.5 GB
Updated2026-05-01
Maintainerabacaj
Model Typempt
Model Files  1.5 GB
GGML QuantizationYes
Quantization Typeggml
Model ArchitectureMPTForCausalLM
Licenseother
Transformers Version4.29.2
Vocabulary Size32768
Torch Data Typefloat16

Best Alternatives to Replit V2 CodeInstruct 3B GGML

Best Alternatives
Context / RAM
Downloads
Likes
Replit V1 CodeInstruct 3B Fp160K / 5.2 GB1414
Replit Code V1.5 3B0K / 6.6 GB544316
Sea Lion 3B0K / 6.4 GB77817
Code Millenials 3B0K / 5.2 GB51
SEA LION V1 3B0K / 6.4 GB18619
Mpt 3B 8K Instruct0K / 6.9 GB53
Replit Code V1 3B0K / 10.4 GB111744
Glaive Function Calling V10K / 10.4 GB875
...aive Function Calling V2 Small0K / 10.4 GB815
Evol Replit V10K / 10.4 GB98
Note: green Score (e.g. "73.2") means that the model is better than abacaj/Replit-v2-CodeInstruct-3B-ggml.