LLM EXPLORER 59,516 MODELS INDEXED

Zephyr Tuning V1 by Dongwookss

By Dongwookss · 1747 downloads

Zephyr Tuning V1 is an open-source language model by Dongwookss. Features: 7.2b LLM, VRAM: 14.4GB, License: apache-2.0, LLM Explorer Score: 0.14.

  Arxiv:1910.09700   Autotrain compatible   Conversational   Endpoints compatible   Lora   Mistral   Region:us   Safetensors   Sft   Sharded   Tensorflow   Trl   Unsloth

Zephyr Tuning V1 Parameters and Internals

LLM NameZephyr Tuning V1
Repository πŸ€—https://huggingface.co/Dongwookss/zephyr_tuning_v1 
Model Size7.2b
Required VRAM14.4 GB
Updated2024-09-23
MaintainerDongwookss
Model Files  0.3 GB   4.9 GB: 1-of-3   5.0 GB: 2-of-3   4.5 GB: 3-of-3
Model ArchitectureAutoModelForCausalLM
Licenseapache-2.0
Model Max Length32768
Is Biasednone
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesup_proj|k_proj|v_proj|o_proj|down_proj|q_proj|gate_proj
LoRA Alpha64
LoRA Dropout0.05
R Param32

Best Alternatives to Zephyr Tuning V1

Best Alternatives
Context / RAM
Downloads
Likes
Spydaz Web AI 0250K / 14.4 GB440
Small Fut Final0K / 14.4 GB91
Last Model Too Long Time0K / 14.4 GB81
Big Fut Final0K / 14.4 GB81
DummySFT0K / 28.9 GB80
Ethicalsft0K / 28.9 GB80
Tweet Sentiment Analyzer0K / 7.7 GB50
MistralRAG0K / 14.4 GB31
GAMA Code Generator V1.00K / 14.4 GB70
G8 Mistral7b Qlora 1211 V09feb0K / 14.4 GB31