Almo OLMoE 1B 7B 0924 Wglobalcopy B3 Layerbalancing by nlp-projects

 »  All LLMs  »  nlp-projects  »  Almo OLMoE 1B 7B 0924 Wglobalcopy B3 Layerbalancing   URL Share it on

Almo OLMoE 1B 7B 0924 Wglobalcopy B3 Layerbalancing is an open-source language model by nlp-projects. Features: 1b LLM, VRAM: 0.2GB, LLM Explorer Score: 0.28.

  Axolotl Base model:adapter:nlp-project... Base model:nlp-projects/almo-o...   Custom code   Dataset:emozilla/dolma-v1 7-3b   Lora   Olmoe   Peft   Region:us   Safetensors

Almo OLMoE 1B 7B 0924 Wglobalcopy B3 Layerbalancing Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

Almo OLMoE 1B 7B 0924 Wglobalcopy B3 Layerbalancing Parameters and Internals

LLM NameAlmo OLMoE 1B 7B 0924 Wglobalcopy B3 Layerbalancing
Repository 🤗https://huggingface.co/nlp-projects/almo-OLMoE-1B-7B-0924-wglobalcopy-b3-layerbalancing 
Base Model(s)  ... Wglobalcopy B3 Layerbalancing   nlp-projects/almo-OLMoE-1B-7B-0924-wglobalcopy-b3-layerbalancing
Model Size1b
Required VRAM0.2 GB
Updated2026-06-02
Maintainernlp-projects
Model Files  0.2 GB   13.9 GB   0.0 GB
Model ArchitectureAutoModelForCausalLM
Is Biasednone
Tokenizer ClassGPTNeoXTokenizer
Padding Token<|padding|>
PEFT TypeLORA
LoRA ModelYes
PEFT Target Moduleso_proj
LoRA Alpha64
LoRA Dropout0.05
R Param64
Errorsreplace

Best Alternatives to Almo OLMoE 1B 7B 0924 Wglobalcopy B3 Layerbalancing

Best Alternatives
Context / RAM
Downloads
Likes
OpenElla StoryWriter TypeB0K / 2.5 GB142
Gemma3 Gender Qlora0K / 4 GB70
Lambda 1v 1B0K / 0 GB4661
Llama 3.2 1B Distill0K / 2.5 GB60
Llama 3.2 1B Extremist40K / 2.5 GB80
Dhenu2 In Climate Llama3.2 1B0K / 2.5 GB100
... 1B Qlora Chat Support Bot Faq0K / 2.6 GB50
...a3.2 1B HeartDiseasePrediction0K / 2.5 GB141
...glish Dataset Fine Tuned 29 090K / 0.4 GB130

Rank the Almo OLMoE 1B 7B 0924 Wglobalcopy B3 Layerbalancing Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 54215 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Check out Ag3ntum — our secure, self-hosted AI agent for server management.
Release v20260328a