What are the hardware requirements for Songcomposer Pretrain?

Songcomposer Pretrain requires approximately 16.7 GB of VRAM and supports a context window of 32K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Songcomposer Pretrain and how large is it?

Songcomposer Pretrain is developed by Mar2Ding. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Songcomposer Pretrain?

Songcomposer Pretrain is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Songcomposer Pretrain by Mar2Ding — VRAM 16.7GB, 32K context

Name: Songcomposer Pretrain
Author: Mar2Ding

Songcomposer Pretrain is an open-source language model by Mar2Ding. Features: LLM, VRAM: 16.7GB, Context: 32K, License: apache-2.0, LLM Explorer Score: 0.11.

Arxiv:2402.17645 Custom code Feature-extraction Internlm Pytorch Region:us Sharded

Model Card on HF 🤗: https://huggingface.co/Mar2Ding/songcomposer_pretrain

Songcomposer Pretrain Parameters and Internals

Model Type

lyric composition, melody composition, text generation

LLM Name	Songcomposer Pretrain
Repository 🤗	https://huggingface.co/Mar2Ding/songcomposer_pretrain
Required VRAM	16.7 GB
Updated	2026-07-31
Maintainer	Mar2Ding
Model Type	internlm
Model Files	10.0 GB: 1-of-2 6.7 GB: 2-of-2
Model Architecture	InternLM2ForCausalLM
License	apache-2.0
Context Length	32768
Model Max Length	32768
Transformers Version	4.31.0
Is Biased	0
Tokenizer Class	InternLMTokenizer
Padding Token	</s>
Vocabulary Size	93194
Torch Data Type	float16

Rank the Songcomposer Pretrain capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Songcomposer Pretrain

Best Alternatives	Context / RAM	Downloads	Likes
ShareCaptioner Video	32K / 17.2 GB	95	19
Songcomposer Sft	32K / 16.7 GB	68	16
MMedLM2	32K / 30.9 GB	12	12
Internlm2 5 Step Prover	8K / 15.4 GB	488	5
Internlm2 Step Prover	8K / 15.4 GB	36	23

Note: green Score (e.g. "73.2") means that the model is better than Mar2Ding/songcomposer_pretrain.