LLM EXPLORER 61,491 MODELS INDEXED

Unhinged Llama3 8B 524K by FiditeNemini

By FiditeNemini · 25 downloads

Unhinged Llama3 8B 524K is an open-source language model by FiditeNemini. Features: 8b LLM, VRAM: 26.5GB, Context: 512K, Quantized, Merged, LLM Explorer Score: 0.12.

  Merged Model   Autotrain compatible Base model:cognitivecomputatio... Base model:quantized:cognitive...   Conversational   Endpoints compatible   Gguf   Llama   Q8   Quantized   Region:us   Safetensors   Sharded   Tensorflow

Unhinged Llama3 8B 524K Parameters and Internals

LLM NameUnhinged Llama3 8B 524K
Repository πŸ€—https://huggingface.co/FiditeNemini/Unhinged-Llama3-8B-524K 
Base Model(s)  cognitivecomputations/dolphin-2.9-llama3-8b-256k   cognitivecomputations/dolphin-2.9-llama3-8b-256k
Merged ModelYes
Model Size8b
Required VRAM26.5 GB
Updated2024-07-24
MaintainerFiditeNemini
Model Typellama
Model Files  14.1 GB   0.6 GB   9.9 GB: 1-of-3   10.0 GB: 2-of-3   6.6 GB: 3-of-3
GGUF QuantizationYes
Quantization Typeq8|gguf
Model ArchitectureLlamaForCausalLM
Context Length524288
Model Max Length524288
Transformers Version4.40.2
Tokenizer ClassPreTrainedTokenizerFast
Padding Token<|end_of_text|>
Vocabulary Size128258
Torch Data Typefloat16

Best Alternatives to Unhinged Llama3 8B 524K

Best Alternatives
Context / RAM
Downloads
Likes
10K V61024K / 16.1 GB50
...truct Gradient 1048K IMat GGUF1024K / 2 GB6506
...B Instruct Gradient 1048K GGUF1024K / 3.2 GB4453
Llama 3 8B Instruct 262K GGUF256K / 3.2 GB2082
Dolphin3 Cyber 8B GGUF128K / 3.2 GB59950150
...s Abliterated V2 Base And GGUF128K / 16.1 GB3012
Grok Oss Apollyon 8B128K / 16.1 GB34498
Dolphin3 Cyber 8B GGUF128K / 3.2 GB4561
Delentia Slm Jitna V0.4128K / 16.1 GB3231
Grok Oss Revenant 8B128K / 16.1 GB3240
Note: green Score (e.g. "73.2") means that the model is better than FiditeNemini/Unhinged-Llama3-8B-524K.