Alpaca Lora 7B Onnx Fp16 With Past by nenkoru

 ยป  All LLMs  ยป  nenkoru  ยป  Alpaca Lora 7B Onnx Fp16 With Past   URL Share it on

  Autotrain compatible   Endpoints compatible   Fp16   Llama   Lora   Onnx   Quantized   Region:us

Alpaca Lora 7B Onnx Fp16 With Past Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Alpaca Lora 7B Onnx Fp16 With Past (nenkoru/alpaca-lora-7b-onnx-fp16-with-past)
๐ŸŒŸ Advertise your project ๐Ÿš€

Alpaca Lora 7B Onnx Fp16 With Past Parameters and Internals

Model Type 
auto-regressive, transformer
Use Cases 
Primary Use Cases:
Research on large language models including question answering, natural language understanding, evaluating biases, toxic and harmful content generations
Limitations:
Model is foundational and should not be used on downstream applications without further risk evaluation and mitigation.
Supported Languages 
en (primarily, with support for bg, ca, cs, da, de, es, fr, hr, hu, it, nl, pl, pt, ro, ru, sl, sr, sv, uk)
Training Details 
Data Sources:
CCNet, C4, GitHub, Wikipedia, Books, ArXiv, Stack Exchange
Model Architecture:
Transformer-based auto-regressive
Safety Evaluation 
Ethical Considerations:
Data used to train the model could be offensive, harmful, and biased as it was collected from the web.
Responsible Ai Considerations 
Fairness:
Evaluated on RAI datasets for biases concerning gender, religion, race, sexual orientation, age, nationality, disability, physical appearance and socio-economic status.
Mitigation Strategies:
Filtered data from the Web using a Kneser-Ney language model and a fastText linear classifier.
LLM NameAlpaca Lora 7B Onnx Fp16 With Past
Repository ๐Ÿค—https://huggingface.co/nenkoru/alpaca-lora-7b-onnx-fp16-with-past 
Base Model(s)  ...ca Lora 7B Onnx Fp32 With Past   nenkoru/alpaca-lora-7b-onnx-fp32-with-past
Model Size7b
Updated2025-09-20
Maintainernenkoru
Model Typellama
Quantization Typefp16
Model ArchitectureLlamaForCausalLM
Licenseother
Transformers Version4.28.0.dev0
Vocabulary Size32000
LoRA ModelYes
Torch Data Typefloat16

Best Alternatives to Alpaca Lora 7B Onnx Fp16 With Past

Best Alternatives
Context / RAM
Downloads
Likes
Smaugv0.1 6.0bpw H6 EXL2195K / 26.4 GB54
Smaugv0.1 5.0bpw H6 EXL2195K / 22.3 GB43
Smaugv0.1 3.0bpw H6 EXL2195K / 13.9 GB61
Smaugv0.1 4.0bpw H6 EXL2195K / 18 GB51
Smaugv0.1 4.65bpw H6 EXL2195K / 20.8 GB51
Smaugv0.1 8.0bpw H8 EXL2195K / 34.9 GB51
DeepSeek Prover V2 7B 4bit64K / 3.9 GB10914
Mistral 7B Openplatypus 1K32K / 29 GB17260
Mistral 7B OpenOrca 1K32K / 29 GB17233
...rnlm2 20B Llama 4.0bpw H6 EXL232K / 11 GB81
Note: green Score (e.g. "73.2") means that the model is better than nenkoru/alpaca-lora-7b-onnx-fp16-with-past.

Rank the Alpaca Lora 7B Onnx Fp16 With Past Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51483 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124