L3.3 Nevoria R1 70B EXL2 4.0bpw H8 by ReadyArt

 ยป  All LLMs  ยป  ReadyArt  ยป  L3.3 Nevoria R1 70B EXL2 4.0bpw H8   URL Share it on

  Merged Model   4-bit   Autotrain compatible Base model:deepseek-ai/deepsee... Base model:eva-unit-01/eva-lla... Base model:nbeerbower/llama-3.... Base model:sao10k/l3.3-70b-eur... Base model:sicariussicariistuf... Base model:thedrummer/anubis-7...   Conversational   Endpoints compatible   Exl2   Llama   Quantized   Region:us   Safetensors   Sharded   Tensorflow

L3.3 Nevoria R1 70b EXL2 4.0bpw H8 Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
๐ŸŒŸ Advertise your project ๐Ÿš€

L3.3 Nevoria R1 70B EXL2 4.0bpw H8 Parameters and Internals

LLM NameL3.3 Nevoria R1 70b EXL2 4.0bpw H8
Repository ๐Ÿค—https://huggingface.co/ReadyArt/L3.3-Nevoria-R1-70b_EXL2_4.0bpw_H8 
Base Model(s)  nbeerbower/Llama-3.1-Nemotron-lorablated-70B   Negative LLAMA 70B   Anubis 70B V1   EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1   DeepSeek R1 Distill Llama 70B   Sao10K/L3.3-70B-Euryale-v2.3   nbeerbower/Llama-3.1-Nemotron-lorablated-70B   SicariusSicariiStuff/Negative_LLAMA_70B   TheDrummer/Anubis-70B-v1   EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1   deepseek-ai/DeepSeek-R1-Distill-Llama-70B   Sao10K/L3.3-70B-Euryale-v2.3
Merged ModelYes
Model Size70b
Required VRAM37.5 GB
Updated2025-06-09
MaintainerReadyArt
Model Typellama
Model Files  8.6 GB: 1-of-5   8.6 GB: 2-of-5   8.6 GB: 3-of-5   8.6 GB: 4-of-5   3.1 GB: 5-of-5
Quantization Typeexl2
Model ArchitectureLlamaForCausalLM
Context Length131072
Model Max Length131072
Transformers Version4.46.2
Tokenizer ClassPreTrainedTokenizerFast
Vocabulary Size128256
Torch Data Typebfloat16
L3.3 Nevoria R1 70B EXL2 4.0bpw H8 (ReadyArt/L3.3-Nevoria-R1-70b_EXL2_4.0bpw_H8)

Best Alternatives to L3.3 Nevoria R1 70B EXL2 4.0bpw H8

Best Alternatives
Context / RAM
Downloads
Likes
...B Instruct Gradient 1048K 4bit1024K / 39.7 GB413
...B Instruct Gradient 1048K 8bit1024K / 75 GB275
...B Instruct Gradient 1048K 2bit1024K / 21.9 GB372
...0B Instruct Gradient 262K 4bit256K / 39.7 GB353
...0B Instruct Gradient 262K 2bit256K / 21.9 GB261
...0B Instruct Gradient 262K 8bit256K / 75 GB162
... Gradient 262K 2.25bpw H6 EXL2256K / 22.2 GB130
...t Gradient 262K 4.0bpw H6 EXL2256K / 37.2 GB211
...t Gradient 262K 3.5bpw H6 EXL2256K / 32.9 GB190
...t Gradient 262K 2.4bpw H6 EXL2256K / 23.5 GB100

Rank the L3.3 Nevoria R1 70B EXL2 4.0bpw H8 Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 48023 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124