LLM EXPLORER 55,709 MODELS INDEXED

Deva1 Pretrain by SaurabhJ20

By SaurabhJ20 · 9 downloads

Deva1 Pretrain is an open-source language model by SaurabhJ20. Features: 7b LLM, VRAM: 14.4GB, Context: 32K, License: apache-2.0, LLM Explorer Score: 0.2.

  Axolotl Base model:finetune:mistral-co... Base model:mistral-community/m...   Conversational Dataset:inferred facts storefl... Dataset:representation variati... Dataset:text chunks storeflow....   Endpoints compatible   Generated from trainer   Mistral   Region:us   Safetensors   Sharded   Tensorflow

Deva1 Pretrain Parameters and Internals

LLM NameDeva1 Pretrain
Repository πŸ€—https://huggingface.co/SaurabhJ20/deva1-pretrain 
Base Model(s)  alpindale/Mistral-7B-v0.2-hf   alpindale/Mistral-7B-v0.2-hf
Model Size7b
Required VRAM14.4 GB
Updated2026-08-05
MaintainerSaurabhJ20
Model Typemistral
Model Files  4.9 GB: 1-of-3   5.0 GB: 2-of-3   4.5 GB: 3-of-3   0.0 GB
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.55.0
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to Deva1 Pretrain

Best Alternatives
Context / RAM
Downloads
Likes
...Nemo Instruct 2407 Abliterated1000K / 24.5 GB22020
MegaBeam Mistral 7B 512K512K / 14.4 GB847054
SpydazWeb AI HumanAI RP512K / 14.4 GB161
SpydazWeb AI HumanAI 002512K / 14.4 GB181
...daz Web AI ChatML 512K Project512K / 14.5 GB120
MegaBeam Mistral 7B 300K282K / 14.4 GB377916
MegaBeam Mistral 7B 300K282K / 14.4 GB801817
Hebrew Mistral 7B 200K256K / 30 GB2315
Astral 256K 7B250K / 14.4 GB90
Astral 256K 7B V2250K / 14.4 GB80
Note: green Score (e.g. "73.2") means that the model is better than SaurabhJ20/deva1-pretrain.