What are the hardware requirements for Phoenix?

Phoenix requires approximately 14.4 GB of VRAM and supports a context window of 32K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Phoenix and how large is it?

Phoenix is developed by DRXD1000, a model with 7.2b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Phoenix?

Phoenix is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Phoenix by DRXD1000 — VRAM 14.4GB, 32K context

Name: Phoenix
Author: DRXD1000

Phoenix is an open-source language model by DRXD1000. Features: 7.2b LLM, VRAM: 14.4GB, Context: 32K, License: apache-2.0, LLM Explorer Score: 0.1.

Arxiv:2401.10580 Alignment-handbook Autotrain compatible Conversational De Dpo Endpoints compatible Mistral Region:us Safetensors Sharded Tensorflow

Model Card on HF 🤗: https://huggingface.co/DRXD1000/Phoenix

Phoenix Parameters and Internals

Model Type

GPT-like 7B model DPO fine-tuned

Additional Notes

Phoenix does not react well on system prompts.

Supported Languages

German (Proficient)

Training Details

Data Sources:

HuggingFaceH4/ultrachat_200k, argilla/ultrafeedback-binarized-preferences

Methodology:

Direct Preference Optimization (DPO)

Hardware Used:

VM with 8 x A100 80GB hosted in Runpods.io

Input Output

Input Format:

Prompt template as HuggingFaceH4/zephyr-7b-beta

LLM Name	Phoenix
Repository 🤗	https://huggingface.co/DRXD1000/Phoenix
Model Size	7.2b
Required VRAM	14.4 GB
Updated	2024-12-10
Maintainer	DRXD1000
Model Type	mistral
Model Files	4.9 GB: 1-of-3 5.0 GB: 2-of-3 4.5 GB: 3-of-3
Supported Languages	de
Model Architecture	MistralForCausalLM
License	apache-2.0
Context Length	32768
Model Max Length	32768
Transformers Version	4.35.2
Tokenizer Class	LlamaTokenizer
Padding Token	</s>
Vocabulary Size	32000
Torch Data Type	bfloat16

Rank the Phoenix capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Phoenix

Best Alternatives	Context / RAM	Downloads	Likes
...Web AI HumanAI 012 INSTRUCT XA	512K / 14.4 GB	9	0
...Web AI HumanAI 012 INSTRUCT IA	512K / 14.4 GB	8	0
...Web AI HumanAI 011 INSTRUCT ML	512K / 14.4 GB	7	0
14	512K / 14.5 GB	319	0
SpydazWeb HumanAI M2	512K / GB	38	0
...dazWeb AI HumanAI 011 INSTRUCT	512K / 14.4 GB	14	1
SpydazWeb AI HumanAI 009 CHAT	512K / 14.4 GB	6	0
SpydazWeb AI HumanAI 007	512K / 14.4 GB	5	0
SpydazWebAI Human AGI 001	512K / 14.4 GB	6	1
...Web AI HumanAI 012 INSTRUCT MX	512K / 14.4 GB	8	0

Note: green Score (e.g. "73.2") means that the model is better than DRXD1000/Phoenix.