What are the hardware requirements for Llama 7B Onnx Merged Fp32?

Llama 7B Onnx Merged Fp32 requires a context window of 2K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Llama 7B Onnx Merged Fp32 and how large is it?

Llama 7B Onnx Merged Fp32 is developed by nenkoru, a model with 7b parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Llama 7B Onnx Merged Fp32?

Llama 7B Onnx Merged Fp32 is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Llama 7B Onnx Merged Fp32 by nenkoru — 2K context

Name: Llama 7B Onnx Merged Fp32
Author: nenkoru

Llama 7B Onnx Merged Fp32 is an open-source language model by nenkoru. Features: 7b LLM, Context: 2K, License: other, Merged, LLM Explorer Score: 0.06.

Merged Model Endpoints compatible Llama Onnx Region:us

Model Card on HF 🤗: https://huggingface.co/nenkoru/llama-7b-onnx-merged-fp32

Llama 7B Onnx Merged Fp32 Parameters and Internals

Model Type

auto-regressive language model, transformer architecture

Use Cases

Areas:

research on large language models

Applications:

question answering, natural language understanding, reading comprehension

Primary Use Cases:

understanding capabilities and limitations of current language models, developing improvement techniques

Limitations:

not intended for downstream applications without risk evaluation

Considerations:

Model can produce harmful content or incorrect information.

Supported Languages

en (>20 languages including English, but primarily trained on English)

Training Details

Data Sources:

CCNet (67%), C4 (15%), GitHub (4.5%), Wikipedia (4.5%), Books (4.5%), ArXiv (2.5%), Stack Exchange (2%)

Responsible Ai Considerations

Fairness:

The model might exhibit biases related to gender, religion, race, sexual orientation, age, nationality, disability, and physical appearance, reflecting biases from the training data.

Transparency:

The model's performance and evaluation metrics are detailed in published resources.

Accountability:

Meta AI's FAIR team is responsible for the model's outputs.

Mitigation Strategies:

Data filtering was performed using a Kneser-Ney language model and a fastText linear classifier to remove offensive content.

Release Notes

Version:

Date:

2023-02-28

Notes:

Initial release of the model.

LLM Name	Llama 7B Onnx Merged Fp32
Repository 🤗	https://huggingface.co/nenkoru/llama-7b-onnx-merged-fp32
Merged Model	Yes
Model Size	7b
Updated	2026-07-11
Maintainer	nenkoru
Model Type	llama
Model Architecture	LLaMAForCausalLM
License	other
Context Length	2048
Model Max Length	2048
Transformers Version	4.28.0.dev0
Vocabulary Size	32000

Rank the Llama 7B Onnx Merged Fp32 capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Quantized Models of the Llama 7B Onnx Merged Fp32

Model	Likes	Downloads	VRAM
Llama 7B Onnx Merged Fp16	6	9	0 GB

Best Alternatives to Llama 7B Onnx Merged Fp32

Best Alternatives	Context / RAM	Downloads	Likes
Honest Llama2 Chat 7B	2K / 13.5 GB	212	9
Chatdoctor	0K / 27 GB	63	12
Explore LM 7B Math	0K / 27 GB	13	1
Explore LM Ext 7B Rewriting	0K / 27 GB	12	1
...xplore LM Ext 7B Brainstorming	0K / 27 GB	5	2
Explore LM 7B Brainstorming	0K / 27 GB	7	0
Explore LM 7B Rewriting	0K / 27 GB	7	0
Explore LM Ext 7B Math	0K / 27 GB	6	0
Alpaca7B Lora Zh Tiny2	0K / 7 GB	6	1
ChatDoctor Change	0K / 27 GB	6	1

Note: green Score (e.g. "73.2") means that the model is better than nenkoru/llama-7b-onnx-merged-fp32.