LLM EXPLORER 59,420 MODELS INDEXED

Palmer Merge Test 5 by appvoid

By appvoid · 5 downloads

Palmer Merge Test 5 is an open-source language model by appvoid. Features: 1.1b LLM, VRAM: 2.2GB, Context: 32K, Merged, LLM Explorer Score: 0.13.

  Merged Model   Arxiv:2306.01708 Base model:appvoid/palmer-002-...   Base model:appvoid/palmer-003 Base model:raidhon/coven tiny ...   Endpoints compatible   Llama   Region:us   Safetensors   Sharded   Tensorflow

Palmer Merge Test 5 Parameters and Internals

Additional Notes 
This model is a result of merging pre-trained language models using the TIES merge method with appvoid/palmer-002-32k as a base. It includes raidhon/coven_tiny_1.1b_32k_orpo_alpha and appvoid/palmer-003, configured with specified parameters for density and weight in YAML configuration.
LLM NamePalmer Merge Test 5
Repository πŸ€—https://huggingface.co/appvoid/palmer-merge-test-5 
Base Model(s)  Palmer 002 32K   raidhon/coven_tiny_1.1b_32k_orpo_alpha   Palmer 003   appvoid/palmer-002-32k   raidhon/coven_tiny_1.1b_32k_orpo_alpha   appvoid/palmer-003
Merged ModelYes
Model Size1.1b
Required VRAM2.2 GB
Updated2026-08-06
Maintainerappvoid
Model Typellama
Model Files  2.2 GB: 1-of-1
Model ArchitectureLlamaForCausalLM
Context Length32768
Model Max Length32768
Transformers Version4.41.0
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Palmer Merge Test 5

Best Alternatives
Context / RAM
Downloads
Likes
TinyKiller NSFW DPO 1.1B32K / 2.2 GB120
Coven Tiny 1.1b 32k Orpo Alpha32K / 2.2 GB92
Test Mix 0132K / 2.2 GB50
TinyLlama 1.1B 32K Instruct32K / 2.2 GB280613
...llama 1.1B 16K Instructions V432K / 2.2 GB80
TinyJ.O.S.I.E. 1.1B 32K Base32K / 2.2 GB301
Palmer 002 32K32K / 2.2 GB90
TinyJ.O.S.I.E. 1.1B 32K Base32K / 2.2 GB51
...lama 1.1B 16K Instructions Rag32K / 2.2 GB250
TinyLlama 1.1B 32K32K / 2.2 GB9830
Note: green Score (e.g. "73.2") means that the model is better than appvoid/palmer-merge-test-5.