What are the hardware requirements for Deepseek Coder 1.3B Chat And Function Calling?

Deepseek Coder 1.3B Chat And Function Calling requires approximately 2.7 GB of VRAM and supports a context window of 16K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Deepseek Coder 1.3B Chat And Function Calling and how large is it?

Deepseek Coder 1.3B Chat And Function Calling is developed by AIGym, a model with 1.3b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

How does Deepseek Coder 1.3B Chat And Function Calling perform on standard benchmarks?

Deepseek Coder 1.3B Chat And Function Calling has the following published scores: MMLU 26.92. Compare against reference models on this page or on the LLM Explorer leaderboards.

Deepseek Coder 1.3B Chat And Function Calling by AIGym — VRAM 2.7GB, 16K context

Name: Deepseek Coder 1.3B Chat And Function Calling
Author: AIGym

Deepseek Coder 1.3B Chat And Function Calling is an open-source language model by AIGym. Features: 1.3b LLM, VRAM: 2.7GB, Context: 16K, License: apache-2.0, Fine-Tuned, Code Generating, LLM Explorer Score: 0.15, Arc: 26.3, HellaSwag: 39.3, MMLU: 26.9, GSM8K: 3.4.

Autotrain compatible Codegen Conversational Endpoints compatible Finetuned Llama Model-index Region:us Safetensors

Model Card on HF 🤗: https://huggingface.co/AIGym/deepseek-coder-1.3b-chat-and-function-calling

Deepseek Coder 1.3B Chat And Function Calling Parameters and Internals

Model Type

text-generation

Use Cases

Considerations:

Use the specified template when interacting with the fine-tuned model.

Additional Notes

The model was fine-tuned to work with OpenAI syntask and will return function when appropriate.

Training Details

Methodology:

Fine-tuned on the open assistant dataset and function calling

LLM Name	Deepseek Coder 1.3B Chat And Function Calling
Repository 🤗	https://huggingface.co/AIGym/deepseek-coder-1.3b-chat-and-function-calling
Model Size	1.3b
Required VRAM	2.7 GB
Updated	2024-12-12
Maintainer	AIGym
Model Type	llama
Model Files	2.7 GB
Generates Code	Yes
Model Architecture	LlamaForCausalLM
License	apache-2.0
Context Length	16384
Model Max Length	16384
Transformers Version	4.36.2
Tokenizer Class	LlamaTokenizer
Padding Token	<｜end▁of▁sentence｜>
Vocabulary Size	32256
Torch Data Type	bfloat16

Rank the Deepseek Coder 1.3B Chat And Function Calling capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Quantized Models of the Deepseek Coder 1.3B Chat And Function Calling

Model	Likes	Downloads	VRAM
...Coder 1.3B Function Calling V1	2	457	2 GB

Best Alternatives to Deepseek Coder 1.3B Chat And Function Calling

Best Alternatives	Context / RAM	Downloads	Likes
Imagine V8	16K / 2.7 GB	702	1
Deepseek Coder 1.3B Instruct	16K / 2.7 GB	92255	176
Llm4decompile 1.3B V2	16K / 2.7 GB	1272	11
Speechless Coder Ds 1.3B	16K / 2.7 GB	180	0
Deepseek Coder 1.3B Chat	16K / 2.7 GB	98	1
...c Deepseek Coder 1.3B Instruct	16K / 5.4 GB	5	0
CursorCore DS 1.3B SR	16K / 2.7 GB	29	2
CursorCore DS 1.3B LC	16K / 2.7 GB	27	0
CursorCore DS 1.3B	16K / 2.7 GB	9	0
Deepseek Coder 1.3B Base	16K / 2.7 GB	16806	111

Note: green Score (e.g. "73.2") means that the model is better than AIGym/deepseek-coder-1.3b-chat-and-function-calling.