Meta Llama 3 8B Instruct OpenVINO INT4 By rajatkrishna: Benchmarks, Features and Detailed Analysis. Insights on Meta Llama 3 8B Instruct OpenVINO INT4.

Autotrain compatible Base model:finetune:meta-llama... Base model:meta-llama/meta-lla... Conversational En Endpoints compatible Facebook Instruct Llama Llama-3 Meta Openvino Region:us

Model Card on HF 🤗: https://huggingface.co/rajatkrishna/Meta-Llama-3-8B-Instruct-OpenVINO-INT4

Meta Llama 3 8B Instruct OpenVINO INT4 Benchmarks

LLME Score: 0.14976

^nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").

What is the LLM Explorer Rank (Score)

Meta Llama 3 8B Instruct OpenVINO INT4 (rajatkrishna/Meta-Llama-3-8B-Instruct-OpenVINO-INT4)

🌟 Advertise your project 🚀

Meta Llama 3 8B Instruct OpenVINO INT4 Parameters and Internals

Model Type

text generation

Additional Notes

The model is optimized for dialogue and is claimed to outperform many open-source chat models on industry benchmarks.

Training Details

Methodology:

Supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF)

Model Architecture:

Auto-regressive language model using an optimized transformer architecture

Input Output

Input Format:

Text only

Output Format:

Text and code only

LLM Name	Meta Llama 3 8B Instruct OpenVINO INT4
Repository 🤗	https://huggingface.co/rajatkrishna/Meta-Llama-3-8B-Instruct-OpenVINO-INT4
Base Model(s)	Meta Llama 3 8B Instruct meta-llama/Meta-Llama-3-8B-Instruct
Model Size	8b
Required VRAM	4.8 GB
Updated	2025-09-23
Maintainer	rajatkrishna
Model Type	llama
Instruction-Based	Yes
Model Files	4.8 GB
Supported Languages	en
Model Architecture	LlamaForCausalLM
License	other
Context Length	8192
Model Max Length	8192
Transformers Version	4.38.2
Tokenizer Class	PreTrainedTokenizerFast
Vocabulary Size	128256
Torch Data Type	bfloat16

Quantized Models of the Meta Llama 3 8B Instruct OpenVINO INT4

Model	Likes	Downloads	VRAM
... Llama 3 8B Instruct GPTQ Int4	0	9	5 GB

Best Alternatives to Meta Llama 3 8B Instruct OpenVINO INT4

Best Alternatives	Context / RAM	Downloads	Likes
...otron 8B UltraLong 4M Instruct	4192K / 32.1 GB	2522	120
...a 3.1 8B UltraLong 4M Instruct	4192K / 32.1 GB	176	24
UltraLong Thinking	4192K / 16.1 GB	45	3
...otron 8B UltraLong 2M Instruct	2096K / 32.1 GB	1142	15
...a 3.1 8B UltraLong 2M Instruct	2096K / 32.1 GB	875	9
...otron 8B UltraLong 1M Instruct	1048K / 32.1 GB	7142	52
...a 3.1 8B UltraLong 1M Instruct	1048K / 32.1 GB	1387	29
Zero Llama 3.1 8B Beta6	1048K / 16.1 GB	2	1
...dger Nu Llama 3.1 8B UltraLong	1048K / 16.2 GB	5	3
....1 1million Ctx Dark Planet 8B	1048K / 32.3 GB	8	3

Note: green Score (e.g. "73.2") means that the model is better than rajatkrishna/Meta-Llama-3-8B-Instruct-OpenVINO-INT4.

Rank the Meta Llama 3 8B Instruct OpenVINO INT4 Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

What open-source LLMs or SLMs are you in search of? 51539 in total.

Email us: info@extractum.io. Our Privacy Policy | Terms and Conditions | Suggest an improvement.

Our Social Media →

Original data from HuggingFace, OpenCompass and various public git repos.

Release v20241124

Support LLM Explorer