LLM EXPLORER 60,587 MODELS INDEXED

Test001 by MrRobotoAI

By MrRobotoAI · 9 downloads

Test001 is an open-source language model by MrRobotoAI. Features: 7b LLM, VRAM: 14.5GB, Context: 128K, Merged, LLM Explorer Score: 0.14.

  Merged Model   Arxiv:2306.01708   Arxiv:2311.03099   Autotrain compatible Base model:callcomply/zephyr-7... Base model:nitral-archive/herc... Base model:nousresearch/yarn-m...   Conversational   Endpoints compatible   Mistral   Region:us   Safetensors   Sharded   Tensorflow   Yarn
Model Card on HF πŸ€—: https://huggingface.co/MrRobotoAI/test001 

Test001 Parameters and Internals

Additional Notes 
This model is a merge of pre-trained language models using mergekit.
Training Details 
Methodology:
DARE TIES merge method
LLM NameTest001
Repository πŸ€—https://huggingface.co/MrRobotoAI/test001 
Base Model(s)  Yarn Mistral 7B 128K   Zephyr 7B Beta 128K   HerculeanSea 7B 128K   NousResearch/Yarn-Mistral-7b-128k   CallComply/zephyr-7b-beta-128k   Nitral-Archive/HerculeanSea-7b-128k
Merged ModelYes
Model Size7b
Required VRAM14.5 GB
Updated2024-11-11
MaintainerMrRobotoAI
Model Typemistral
Model Files  4.9 GB: 1-of-3   4.9 GB: 2-of-3   4.7 GB: 3-of-3
Model ArchitectureMistralForCausalLM
Context Length131072
Model Max Length131072
Transformers Version4.42.4
Tokenizer ClassLlamaTokenizer
Padding Token</s>
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Test001

Best Alternatives
Context / RAM
Downloads
Likes
...Nemo Instruct 2407 Abliterated1000K / 24.5 GB22020
MegaBeam Mistral 7B 512K512K / 14.4 GB847054
SpydazWeb AI HumanAI RP512K / 14.4 GB161
SpydazWeb AI HumanAI 002512K / 14.4 GB181
...daz Web AI ChatML 512K Project512K / 14.5 GB120
MegaBeam Mistral 7B 300K282K / 14.4 GB377916
MegaBeam Mistral 7B 300K282K / 14.4 GB801817
Hebrew Mistral 7B 200K256K / 30 GB2315
Astral 256K 7B250K / 14.4 GB90
Astral 256K 7B V2250K / 14.4 GB80
Note: green Score (e.g. "73.2") means that the model is better than MrRobotoAI/test001.