LLM EXPLORER 59,420 MODELS INDEXED

Ext Meta Llama 3 70B Instruct AWQ GEMM by erickbp

By erickbp · 6 downloads
HF Repo ↗ Copy URL

Ext Meta Llama 3 70B Instruct AWQ GEMM is an open-source language model by erickbp. Features: 70b LLM, VRAM: 39.9GB, Context: 8K, Quantized, Instruction-Based, LLM Explorer Score: 0.13.

  4-bit   Autotrain compatible   Awq   Conversational   Endpoints compatible   Instruct   Llama   Quantized   Region:us   Safetensors   Sharded   Tensorflow
Model Card on HF 🤗: https://huggingface.co/erickbp/Ext-Meta-Llama-3-70B-Instruct-AWQ-GEMM 

Ext Meta Llama 3 70B Instruct AWQ GEMM Parameters and Internals

LLM NameExt Meta Llama 3 70B Instruct AWQ GEMM
Repository 🤗https://huggingface.co/erickbp/Ext-Meta-Llama-3-70B-Instruct-AWQ-GEMM 
Model Size70b
Required VRAM39.9 GB
Updated2025-09-28
Maintainererickbp
Model Typellama
Instruction-BasedYes
Model Files  5.0 GB: 1-of-9   4.9 GB: 2-of-9   4.9 GB: 3-of-9   4.9 GB: 4-of-9   4.9 GB: 5-of-9   4.9 GB: 6-of-9   4.9 GB: 7-of-9   3.4 GB: 8-of-9   2.1 GB: 9-of-9
AWQ QuantizationYes
Quantization Typeawq
Model ArchitectureLlamaForCausalLM
Context Length8192
Model Max Length8192
Transformers Version4.40.0
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size128256
Torch Data Typefloat16

Best Alternatives to Ext Meta Llama 3 70B Instruct AWQ GEMM

Best Alternatives
Context / RAM
Downloads
Likes
...0B Instruct Gradient 1048K AWQ1024K / 39.9 GB51
...70B Instruct Gradient 262K AWQ256K / 39.9 GB50
Llama 3.3 70B Instruct AWQ128K / 39.9 GB26200246
...lama 3.3 70B Instruct AWQ INT4128K / 39.9 GB8274430
Llama 3.3 70B Instruct AWQ128K / 39.9 GB1609012
... SauerkrautLM 70B Instruct AWQ128K / 39.9 GB55
Llama 3 70B Instruct AWQ8K / 39.9 GB12217571
Meta Llama 3 70B Instruct AWQ8K / 39.9 GB81
Llama 3 70B Instruct AWQ8K / 39.9 GB171
... Llama 3 70B Instruct AWQ GEMM8K / 39.9 GB50
Note: green Score (e.g. "73.2") means that the model is better than erickbp/Ext-Meta-Llama-3-70B-Instruct-AWQ-GEMM.