LLM EXPLORER 58,297 MODELS INDEXED

Saily 220B AWQ by TheBloke

By TheBloke · 5 downloads
HF Repo ↗ Copy URL

Saily 220B AWQ is an open-source language model by TheBloke. Features: 220b LLM, VRAM: 109.1GB, Context: 4K, License: llama2, Quantized, LLM Explorer Score: 0.1.

  4-bit   Awq Base model:deepnight-research/... Base model:quantized:deepnight...   Dataset:eleutherai/pile   Dataset:meta-math/metamathqa Dataset:tiiuae/falcon-refinedw...   En   Llama   Quantized   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/TheBloke/Saily_220B-AWQ 

Saily 220B AWQ Parameters and Internals

Model Type 
llama
Use Cases 
Limitations:
Saily 220B may generate incorrect or biased content.
Additional Notes 
Please don't refer to the config.json in the files, it isn't accurate.
Supported Languages 
en (English)
Training Details 
Data Sources:
tiiuae/falcon-refinedweb, EleutherAI/pile, meta-math/MetaMathQA, Unnatural Code (Javascript, Python, C++)
Hardware Used:
4 x A100 80GB, 2 x A100 80GB
Model Architecture:
Llama2-70B merges
Input Output 
Input Format:
Below is an instruction that describes a task. Write a response that appropriately completes the request. ### Instruction: {prompt} ### Response:
Accepted Modalities:
text
Output Format:
text
Release Notes 
Version:
v1
Date:
17th December, 2023
Notes:
Releasing Saily_220B, built on top of Llama2-70B merges with various fine-tuning datasets.
LLM NameSaily 220B AWQ
Repository 🤗https://huggingface.co/TheBloke/Saily_220B-AWQ 
Model NameSaily 220B
Model CreatorDEEPNIGHT
Base Model(s)  Saily 220B   deepnight-research/Saily_220B
Model Size220b
Required VRAM109.1 GB
Updated2026-07-22
MaintainerTheBloke
Model Typellama
Model Files  9.9 GB: 1-of-11   9.9 GB: 2-of-11   9.9 GB: 3-of-11   10.0 GB: 4-of-11   9.9 GB: 5-of-11   9.9 GB: 6-of-11   10.0 GB: 7-of-11   9.9 GB: 8-of-11   9.9 GB: 9-of-11   10.0 GB: 10-of-11   9.8 GB: 11-of-11
Supported Languagesen
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureLlamaForCausalLM
Licensellama2
Context Length4096
Model Max Length4096
Transformers Version4.37.0.dev0
Tokenizer ClassLlamaTokenizer
Vocabulary Size32000
Torch Data Typefloat16

Best Alternatives to Saily 220B AWQ

Best Alternatives
Context / RAM
Downloads
Likes
...l Llama 220M GQA 32K Theta Sft32K / 0.4 GB62
Smol Llama 220M GQA 32K Theta32K / 0.4 GB81
Nuevamol 220M Base8K / 0.4 GB60
Saily 220B GPTQ4K / 105.2 GB41
Saily 220B4K / 417 GB9620
Smol Llama 220M GQA2K / 0.4 GB32613
Smol Llama 220M Openhermes2K / 0.4 GB1135
Smol Llama 220M Open Instruct2K / 0.4 GB62
...mol Llama 220M GQA Fineweb Edu2K / 0.4 GB141
Smol Llama 220M Bees Internal2K / 0.4 GB61
Note: green Score (e.g. "73.2") means that the model is better than TheBloke/Saily_220B-AWQ.