LLM EXPLORER 60,958 MODELS INDEXED

FineZephir Sft Instruct Ead 16bit by Geraldine

By Geraldine · 56 downloads

FineZephir Sft Instruct Ead 16bit is an open-source language model by Geraldine. Features: LLM, VRAM: 14.4GB, Context: 32K, License: apache-2.0, Quantized, Instruction-Based, LLM Explorer Score: 0.16.

  4bit   Autotrain compatible Base model:finetune:unsloth/ze... Base model:unsloth/zephyr-sft-...   Conversational   En   Endpoints compatible   Instruct   Mistral   Pytorch   Quantized   Region:us   Sft   Sharded   Trl   Unsloth

FineZephir Sft Instruct Ead 16bit Parameters and Internals

LLM NameFineZephir Sft Instruct Ead 16bit
Repository πŸ€—https://huggingface.co/Geraldine/FineZephir-sft-instruct-ead-16bit 
Base Model(s)  Zephyr Sft Bnb 4bit   unsloth/zephyr-sft-bnb-4bit
Required VRAM14.4 GB
Updated2024-12-23
MaintainerGeraldine
Model Typemistral
Instruction-BasedYes
Model Files  4.9 GB: 1-of-3   5.0 GB: 2-of-3   4.5 GB: 3-of-3
Supported Languagesen
Quantization Type4bit
Model ArchitectureMistralForCausalLM
Licenseapache-2.0
Context Length32768
Model Max Length32768
Transformers Version4.47.0
Tokenizer ClassLlamaTokenizer
Padding Token<unk>
Vocabulary Size32000
Torch Data Typebfloat16

Best Alternatives to FineZephir Sft Instruct Ead 16bit

Best Alternatives
Context / RAM
Downloads
Likes
... Instruct Unsloth Merged 16bit4K / 7.6 GB61
... Mini 4K Instruct Bnb 4bit Ita4K / 7.6 GB11810
... Mini 4K Instruct Bnb 4bit Ita4K / 7.6 GB15270
...ini New Model With Lora Merged4K / 7.6 GB160
Phired4K / 7.6 GB120
Phi 3 Mini Hospital Topic 504K / 7.6 GB340
Phi3 History V24K / 7.6 GB230
Model4K / 7.6 GB50
MainPHI34K / 7.6 GB100
Model4K / 7.6 GB70
Note: green Score (e.g. "73.2") means that the model is better than Geraldine/FineZephir-sft-instruct-ead-16bit.