LLM EXPLORER 60,783 MODELS INDEXED

Pythia 70M Instruct Orca Chkpt 64000 by w601sxs

By w601sxs · 8 downloads

Pythia 70M Instruct Orca Chkpt 64000 is an open-source language model by w601sxs. Features: 70m LLM, VRAM: 0.2GB, Instruction-Based, LLM Explorer Score: 0.08.

  Dataset:open-orca/openorca   Endpoints compatible   Gpt neox   Instruct   Lora   Pytorch   Region:us

Pythia 70M Instruct Orca Chkpt 64000 Parameters and Internals

Model Type 
text generation
Training Details 
Data Sources:
Open-Orca/OpenOrca
Methodology:
PEFT (Parameter Efficient Fine-Tuning)
Input Output 
Input Format:
context: < ... > question: < ... > answer: < ... >
Accepted Modalities:
text
Output Format:
text
LLM NamePythia 70M Instruct Orca Chkpt 64000
Repository πŸ€—https://huggingface.co/w601sxs/pythia-70m-instruct-orca-chkpt-64000 
Model Size70m
Required VRAM0.2 GB
Updated2026-08-07
Maintainerw601sxs
Instruction-BasedYes
Model Files  0.0 GB   0.2 GB
Model ArchitectureAutoModelForCausalLM
Is Biasednone
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesquery_key_value
LoRA Alpha32
LoRA Dropout0.05
R Param8

Best Alternatives to Pythia 70M Instruct Orca Chkpt 64000

Best Alternatives
Context / RAM
Downloads
Likes
Llama 3.1 Tango 70B0K / 3 GB68
...3 70B Instruct Uncensored Lora0K / 0.8 GB83
Note: green Score (e.g. "73.2") means that the model is better than w601sxs/pythia-70m-instruct-orca-chkpt-64000.