LLM EXPLORER 58,297 MODELS INDEXED

Jamba H1024 L12 V0.07 Fineweb 1M Med by pszemraj

By pszemraj · 9 downloads

Jamba H1024 L12 V0.07 Fineweb 1M Med is an open-source language model by pszemraj. Features: 1m LLM, VRAM: 1.8GB, Context: 16K, License: apache-2.0, LLM Explorer Score: 0.12.

  Claude3 tokenizer Dataset:bee-spoke-data/fineweb...   En   Endpoints compatible   Jamba   Region:us   Safetensors

Jamba H1024 L12 V0.07 Fineweb 1M Med Parameters and Internals

Model Type 
text generation
Additional Notes 
This model version is a mid-training checkpoint.
Supported Languages 
en (high)
Training Details 
Data Sources:
BEE-spoke-data/fineweb-1M_en-med
Context Length:
2048
Model Architecture:
Jamba
Input Output 
Accepted Modalities:
text
Output Format:
text
LLM NameJamba H1024 L12 V0.07 Fineweb 1M Med
Repository πŸ€—https://huggingface.co/pszemraj/jamba-H1024_L12-v0.07-fineweb-1M-med 
Model Size1m
Required VRAM1.8 GB
Updated2026-08-07
Maintainerpszemraj
Model Typejamba
Model Files  1.8 GB   0.0 GB
Supported Languagesen
Model ArchitectureJambaForCausalLM
Licenseapache-2.0
Context Length16384
Model Max Length16384
Transformers Version4.40.1
Tokenizer ClassGPT2Tokenizer
Vocabulary Size65024
Torch Data Typebfloat16

Best Alternatives to Jamba H1024 L12 V0.07 Fineweb 1M Med

Best Alternatives
Context / RAM
Downloads
Likes
...amba UltraInteract Instruct 1B0K / 4.1 GB120
PyJamba1B0K / 2 GB91