What are the hardware requirements for StableGPT4 Micro 1.6B?

StableGPT4 Micro 1.6B requires approximately 6.6 GB of VRAM and supports a context window of 4K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed StableGPT4 Micro 1.6B and how large is it?

StableGPT4 Micro 1.6B is developed by ifmain, a model with 6b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate StableGPT4 Micro 1.6B?

StableGPT4 Micro 1.6B is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

StableGPT4 Micro 1.6B by ifmain — VRAM 6.6GB, 4K context

Name: StableGPT4 Micro 1.6B
Author: ifmain

StableGPT4 Micro 1.6B is an open-source language model by ifmain. Features: 6b LLM, VRAM: 6.6GB, Context: 4K, LLM Explorer Score: 0.12.

Autotrain compatible Base model:finetune:stabilitya... Base model:stabilityai/stablel... Conversational Dataset:ifmain/gpt4myself Dataset:openchat/openchat shar... Endpoints compatible Region:us Safetensors Sharded Stablelm Tensorflow

Model Card on HF 🤗: https://huggingface.co/ifmain/StableGPT4-Micro-1.6B

StableGPT4 Micro 1.6B Parameters and Internals

Model Type

conversational AI

Use Cases

Primary Use Cases:

generating text-based responses for various conversational scenarios

Additional Notes

The model is optimized for stability and coherence but may produce unexpected responses.

Training Details

Data Sources:

openchat/openchat_sharegpt4_dataset, ifmain/gpt4myself

Methodology:

Fine-tuned on ChatGPT chats for conversational scenarios.

Input Output

Input Format:

Prompts in JSON format with speaker role ('user' or 'assistant') and message text

Accepted Modalities:

text

Output Format:

text-based responses

LLM Name	StableGPT4 Micro 1.6B
Repository 🤗	https://huggingface.co/ifmain/StableGPT4-Micro-1.6B
Base Model(s)	Stablelm 2 Zephyr 1 6b stabilityai/stablelm-2-zephyr-1_6b
Model Size	6b
Required VRAM	6.6 GB
Updated	2025-02-24
Maintainer	ifmain
Model Type	stablelm
Model Files	5.0 GB: 1-of-2 1.6 GB: 2-of-2
Model Architecture	StableLmForCausalLM
Context Length	4096
Model Max Length	4096
Transformers Version	4.39.0.dev0
Tokenizer Class	GPT2Tokenizer
Padding Token	<\|endoftext\|>
Vocabulary Size	100352
Torch Data Type	float32

Rank the StableGPT4 Micro 1.6B capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to StableGPT4 Micro 1.6B

Best Alternatives	Context / RAM	Downloads	Likes
Stablelm 2 1 6b	4K / 3.3 GB	6627	196
Stablelm 2 1 6b Chat	4K / 6.6 GB	1945	34
Stablelm 2 1 6b Sft Full	4K / 3.3 GB	5	0
Cot 5k	4K / 3.3 GB	1313	0
StableLM FineTune GPT4	4K / 6.6 GB	5	1
Parrot 1 6B	4K / 3.3 GB	1	1
Stablelm 2 1 6b	4K / GB	18	2
Stablelm 2 Zephyr 1 6b	4K / GB	11	1
Stablelm 2 Zephyr 1 6b	4K / 3.3 GB	14	1
Stablelm 2 Zephyr 1 6b Q4	4K / GB	14	1

Note: green Score (e.g. "73.2") means that the model is better than ifmain/StableGPT4-Micro-1.6B.