Open Sci Ref V0.02 1.7B Fineweb Edu 1.4t 300B 4096 4096 Longsft 16K is an open-source language model by ali-elganzory. Features: 300b LLM, VRAM: 3.4GB, Context: 16K, License: other, LLM Explorer Score: 0.32.
| LLM Name | Open Sci Ref V0.02 1.7B Fineweb Edu 1.4t 300B 4096 4096 Longsft 16k |
| Repository ๐ค | https://huggingface.co/ali-elganzory/open-sci-ref-v0.02-1.7b-fineweb-edu-1.4t-300B-4096-4096-longsft_16k |
| Base Model(s) | |
| Model Size | 300b |
| Required VRAM | 3.4 GB |
| Updated | 2026-04-10 |
| Maintainer | ali-elganzory |
| Model Type | opensci |
| Model Files | |
| Model Architecture | OpensciForCausalLM |
| License | other |
| Context Length | 16384 |
| Model Max Length | 16384 |
| Transformers Version | 4.51.3 |
| Tokenizer Class | GPTNeoXTokenizer |
| Padding Token | <end_of_turn> |
| Vocabulary Size | 50304 |
| Torch Data Type | bfloat16 |
Best Alternatives |
Context / RAM |
Downloads |
Likes |
|---|---|---|---|
| ...B 16K SFT Tulu3 Decontaminated | 16K / 3.4 GB | 267 | 0 |
| ... 4096 SFT Tulu3 Decontaminated | 4K / 3.4 GB | 253 | 0 |
| ... 4096 SFT Tulu3 Decontaminated | 4K / 3.4 GB | 244 | 0 |
| ... 4096 SFT Tulu3 Decontaminated | 4K / 0.8 GB | 239 | 0 |
| ....7B Fineweb Edu 1.4t 300B 4096 | 4K / 3.4 GB | 44 | 0 |
| ....7B Fineweb Edu 1.4t 300B 4096 | 4K / 3.4 GB | 17 | 0 |
๐ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐