LLM EXPLORER 59,358 MODELS INDEXED

Deberta Xxlarge Fixed by ltg

By ltg · 9 downloads
HF Repo ↗ Copy URL

Deberta Xxlarge Fixed is an open-source language model by ltg. Features: LLM, VRAM: 3.1GB, Context: 0.5K, License: mit, LLM Explorer Score: 0.12.

  Arxiv:2406.04823   Custom code   Deberta   En   Fill-mask   Pytorch   Region:us
Model Card on HF 🤗: https://huggingface.co/ltg/deberta-xxlarge-fixed 

Deberta Xxlarge Fixed Parameters and Internals

Model Type 
text-generation
Additional Notes 
DeBERTa has fixed the incorrect name of output embedding weights, implementation of EMD, and clamped positional embeddings for long sequences.
Supported Languages 
English (High)
Input Output 
Input Format:
Pre-tokenized input IDs
Accepted Modalities:
text
Output Format:
Text
Performance Tips:
Ensure GPU has CUDA support for optimal performance
LLM NameDeberta Xxlarge Fixed
Repository 🤗https://huggingface.co/ltg/deberta-xxlarge-fixed 
Required VRAM3.1 GB
Updated2026-08-04
Maintainerltg
Model Files  3.1 GB
Supported Languagesen
Model ArchitectureDebertaV2ForCausalLM
Licensemit
Context Length512
Model Max Length512
Vocabulary Size128100