LLM EXPLORER 59,420 MODELS INDEXED

Kto5k1 by stojchet

By stojchet · 16 downloads

Kto5k1 is an open-source language model by stojchet. Features: 1.3b LLM, VRAM: 5.4GB, Context: 16K, License: other, Code Generating, LLM Explorer Score: 0.13.

Base model:deepseek-ai/deepsee... Base model:finetune:deepseek-a...   Codegen   Endpoints compatible   Generated from trainer   Kto   Llama   Lora   Region:us   Safetensors   Sharded   Tensorflow   Trl

Kto5k1 Parameters and Internals

Model Type 
trl, kto
Additional Notes 
Training used hyperparameters such as a learning_rate of 1e-05, train_batch_size of 8, gradient accumulation steps of 16, and optimizer Adam.
Training Details 
Methodology:
fine-tuning
LLM NameKto5k1
Repository 🤗https://huggingface.co/stojchet/kto5k1 
Base Model(s)  deepseek-ai/deepseek-coder-1.3b-base   deepseek-ai/deepseek-coder-1.3b-base
Model Size1.3b
Required VRAM5.4 GB
Updated2026-08-08
Maintainerstojchet
Model Typellama
Model Files  5.0 GB: 1-of-2   0.4 GB: 2-of-2   0.0 GB
Supported Languagespython
Generates CodeYes
Model ArchitectureAutoModelForCausalLM
Licenseother
Context Length16384
Model Max Length16384
Transformers Version4.43.0.dev0
Tokenizer ClassLlamaTokenizer
Padding Token<|end▁of▁sentence|>
Vocabulary Size32256
LoRA ModelYes
LoRA Alpha16
LoRA Dropout0.05
Torch Data Typefloat32

Best Alternatives to Kto5k1

Best Alternatives
Context / RAM
Downloads
Likes
Dpo70K / 5.4 GB110
Dpo60K / 5.4 GB100
Dpo10K / 5.4 GB90
Dpo50K / 5.4 GB80
Jd20K / 5.4 GB70
K60K / 5.4 GB70
K50K / 5.4 GB50
Jd30K / 5.4 GB50
D70K / 5.4 GB50
Nkto40K / 5.4 GB100
Note: green Score (e.g. "73.2") means that the model is better than stojchet/kto5k1.