Opt Iml 1.3B by facebook

 ยป  All LLMs  ยป  facebook  ยป  Opt Iml 1.3B   URL Share it on

  Arxiv:2212.12017   Autotrain compatible   Opt   Pytorch   Region:us
Model Card on HF ๐Ÿค—: https://huggingface.co/facebook/opt-iml-1.3b 

Opt Iml 1.3B Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
Opt Iml 1.3B (facebook/opt-iml-1.3b)
๐ŸŒŸ Advertise your project ๐Ÿš€

Opt Iml 1.3B Parameters and Internals

Model Type 
text-generation, opt
Use Cases 
Areas:
NLP tasks, instruction-tuning
Considerations:
Models are susceptible to risks involving factual correctness, toxic language, and stereotypes.
Training Details 
Data Sources:
Super-NaturalInstructions, FLAN, PromptSource
Data Volume:
approximately 2 billion tokens (during fine-tuning)
Methodology:
Fine-tuning with Instruction Meta-Learning
Context Length:
2048
Hardware Used:
64 40GB A100 GPUs
Model Architecture:
Instruction-tuned versions of OPT
Responsible Ai Considerations 
Mitigation Strategies:
Responsible best practices are recommended to mitigate risks related to factual correctness, toxic language generation, and stereotypes.
LLM NameOpt Iml 1.3B
Repository ๐Ÿค—https://huggingface.co/facebook/opt-iml-1.3b 
Model Size1.3b
Required VRAM2.6 GB
Updated2025-09-23
Maintainerfacebook
Model Typeopt
Model Files  2.6 GB
Model ArchitectureOPTForCausalLM
Licenseother
Context Length2048
Model Max Length2048
Transformers Version4.22.2
Beginning of Sentence Token</s>
End of Sentence Token</s>
Unk Token</s>
Vocabulary Size50272
Torch Data Typefloat16
Activation Functionrelu
Errorsreplace

Best Alternatives to Opt Iml 1.3B

Best Alternatives
Context / RAM
Downloads
Likes
LLmRa 1.3B V22K / 5.3 GB6640
... Distilled PromptKD Dolly V1.02K / 2.6 GB60
New Galactica 1.3b Mcq2K / 2.6 GB50
... Galactica 1.3b DPO 0.1beta Ai2K / 2.6 GB51
New Galactica 1.3b Mcq No Rag2K / 2.6 GB60
New Galactica 1.3b Mcq Rag2K / 2.6 GB60
... Galactica 1.3b DPO 0.1beta Ai2K / 2.6 GB50
...tica 1.3b 0.1beta Ai Raft Top32K / 2.6 GB50
...tica 1.3b 0.1beta Ai Raft Top42K / 2.6 GB50
... Galactica 1.3b DPO 0.1beta Ai2K / 2.6 GB50
Note: green Score (e.g. "73.2") means that the model is better than facebook/opt-iml-1.3b.

Rank the Opt Iml 1.3B Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 51547 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124