What are the hardware requirements for Sheared LLaMA 1.3B ShareGPT GGUF?

Sheared LLaMA 1.3B ShareGPT GGUF requires approximately 0.6 GB of VRAM. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Sheared LLaMA 1.3B ShareGPT GGUF and how large is it?

Sheared LLaMA 1.3B ShareGPT GGUF is developed by LakoMoor, a model with 1.3b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Sheared LLaMA 1.3B ShareGPT GGUF?

Sheared LLaMA 1.3B ShareGPT GGUF is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Sheared LLaMA 1.3B ShareGPT GGUF by LakoMoor — VRAM 0.6GB

Name: Sheared LLaMA 1.3B ShareGPT GGUF
Author: LakoMoor

Sheared LLaMA 1.3B ShareGPT GGUF is an open-source language model by LakoMoor. Features: 1.3b LLM, VRAM: 0.6GB, License: apache-2.0, Quantized, LLM Explorer Score: 0.1.

Arxiv:2310.06694 Base model:princeton-nlp/shear... Base model:quantized:princeton... En Gguf Llama Quantized Region:us Sheared Sheared llm

Model Card on HF 🤗: https://huggingface.co/LakoMoor/Sheared-LLaMA-1.3B-ShareGPT-GGUF

Sheared LLaMA 1.3B ShareGPT GGUF Parameters and Internals

LLM Name	Sheared LLaMA 1.3B ShareGPT GGUF
Repository 🤗	https://huggingface.co/LakoMoor/Sheared-LLaMA-1.3B-ShareGPT-GGUF
Model Name	Sheared LLaMA-1.3B ShareGPT
Model Creator	Berkeley-Nest
Base Model(s)	princeton-nlp/Sheared-LLaMA-1.3B-ShareGPT princeton-nlp/Sheared-LLaMA-1.3B-ShareGPT
Model Size	1.3b
Required VRAM	0.6 GB
Updated	2024-10-18
Maintainer	LakoMoor
Model Type	llama
Model Files	0.6 GB 0.7 GB 0.7 GB 0.7 GB 0.8 GB 0.9 GB 0.8 GB 0.9 GB 1.0 GB 1.0 GB 1.2 GB 1.4 GB
Supported Languages	en
GGUF Quantization	Yes
Quantization Type	gguf
Model Architecture	AutoModel
License	apache-2.0

Rank the Sheared LLaMA 1.3B ShareGPT GGUF capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Sheared LLaMA 1.3B ShareGPT GGUF

Best Alternatives	Context / RAM	Downloads	Likes
...pseek Coder 1.3B Instruct GGUF	0K / 0.6 GB	12038	54
Deepseek Coder 1.3B Base GGUF	0K / 0.6 GB	3249	9
Argonne 2.5 Ctx13568	13K / 2.4 GB	14	0
Diablo Italian Base 1.3B	2K / 2.6 GB	8	0
Diablo Italian Chatbot 1.3B	2K / 2.6 GB	6	0
GPT Neo X 1.3B Qlora Test	0K / 0 GB	0	1
Cerebras GPT 1.3B	0K / 5.4 GB	1876	50
...lb 200 Distilled 1.3B Ct2 Int8	0K / 1.4 GB	177	6

Note: green Score (e.g. "73.2") means that the model is better than LakoMoor/Sheared-LLaMA-1.3B-ShareGPT-GGUF.