LLM EXPLORER 61,561 MODELS INDEXED

Qovaryx 50M Scratch Base by tjarvis91

By tjarvis91 · 17 downloads
HF Repo ↗ Copy URL

Qovaryx 50M Scratch Base is an open-source language model by tjarvis91. Features: 50m LLM, VRAM: 0.1GB, Context: 1K, License: apache-2.0, LLM Explorer Score: 0.23.

  16gb-vram   Bitnet   Blackwell   Causal-language-model   Compact-ai   Compact-llm   Consumer-gpu   Custom code   Decoder   Edge-ai   En   Flash-attention-2   From-scratch   Gqa   Grouped-query-attention   Local-ai   Low-rank   Mixture-of-experts   Moe   Mtp   Multi-token-prediction   Nanogpt   On-device   Own-base   Pretraining-template   Pytorch   Qovaryx   Random-init   Region:us   Rtx-4090   Rtx-5070-ti   Rtx-5090   Scratch-base   Sm120   Small-language-model   Sovereign-ai   Sparse-moe   Swiglu   Ternary-swiglu   Tiny-llm
Model Card on HF 🤗: https://huggingface.co/tjarvis91/qovaryx-50m-scratch-base 

Qovaryx 50M Scratch Base Parameters and Internals

LLM NameQovaryx 50M Scratch Base
Repository 🤗https://huggingface.co/tjarvis91/qovaryx-50m-scratch-base 
Model Size50m
Required VRAM0.1 GB
Updated2026-08-03
Maintainertjarvis91
Model Typeqovaryx
Model Files  0.1 GB
Supported Languagesen
Model ArchitectureQovaryxForCausalLM
Licenseapache-2.0
Context Length1024
Model Max Length1024
Transformers Version5.2.0
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<pad>
Vocabulary Size20242
Torch Data Typebfloat16