LLM EXPLORER 59,516 MODELS INDEXED

RunpodV1 Merged 16bit by Gragroo

By Gragroo · 287 downloads
HF Repo ↗ Copy URL

RunpodV1 Merged 16bit is an open-source language model by Gragroo. Features: 3b LLM, Context: 128K, License: apache-2.0, Quantized, Instruction-Based, Merged, LLM Explorer Score: 0.15.

  Merged Model   4bit   Autotrain compatible   Conversational   En   Endpoints compatible   Instruct   Llama   Quantized   Region:us   Safetensors   Trl   Unsloth
Model Card on HF 🤗: https://huggingface.co/Gragroo/runpodV1-merged_16bit 

RunpodV1 Merged 16bit Parameters and Internals

LLM NameRunpodV1 Merged 16bit
Repository 🤗https://huggingface.co/Gragroo/runpodV1-merged_16bit 
Base Model(s)  unsloth/llama-3.2-3b-instruct-bnb-4bit   unsloth/llama-3.2-3b-instruct-bnb-4bit
Merged ModelYes
Model Size3b
Updated2024-11-02
MaintainerGragroo
Model Typellama
Instruction-BasedYes
Quantization Type4bit
Model ArchitectureLlamaForCausalLM
Licenseapache-2.0
Context Length131072
Model Max Length131072
Transformers Version4.44.2
Vocabulary Size128256
Torch Data Typebfloat16

Quantized Models of the RunpodV1 Merged 16bit

Model
Likes
Downloads
VRAM
TaraV2 M16B056 GB

Best Alternatives to RunpodV1 Merged 16bit

Best Alternatives
Context / RAM
Downloads
Likes
Cheese 3B128K / 1.8 GB2491
...Llama 3.2 3B Legal Chatbot Sft128K / 6.5 GB8170
Legal Llama3.2 3B Sft Id128K / 6.5 GB6800
...gabl Legal Chatbot Llama3.2 3B128K / 6.5 GB5280
Llama 3.2 3B Legal Id Sft128K / 6.5 GB2360
Llama3 Legal Id Ft128K / 6.5 GB520
Llama 3.2 3B Legal Id Instruct128K / 6.5 GB1090
Legal Chatbot Llama3.2 3B Id128K / 6.5 GB690
Legal Chatbot Llama3.2 3B Id128K / 6.5 GB680
Llama3.2 3B Legal Asisten Sft128K / 6.5 GB730
Note: green Score (e.g. "73.2") means that the model is better than Gragroo/runpodV1-merged_16bit.