LLM EXPLORER
 LLM Explorer: A Curated Large Language Model Directory and Analytics
Dark Theme
  LLM  List    LLM Hosting    LLM Leaderboards    Blog    Newsfeed    Advertise

GPT Sw3 6.7B V2 Instruct by AI-Sweden-Models

 »  All LLMs  »  AI-Sweden-Models  »  GPT Sw3 6.7B V2 Instruct   URL Share it on

  1651   
  Autotrain compatible Base model:ai-sweden-models/gp... Base model:finetune:ai-sweden-...   Conversational   Da Dataset:databricks/databricks-...   Dataset:laion/oig   Dataset:openassistant/oasst1   En   Endpoints compatible   Gpt2   Instruct   Is   No   Pytorch   Region:us   Safetensors   Sharded   Sv   Tensorflow
Model Card on HF 🤗: https://huggingface.co/AI-Sweden-Models/gpt-sw3-6.7b-v2-instruct 

GPT Sw3 6.7B V2 Instruct Benchmarks

ARC: 40.78 vs 96.7 (so35)-57.8%
HellaSwag: 67.77 vs 95.3 (gpt4)-28.9%
MMLU: 31.57 vs 88.3 (so35)-64.2%
TruthfulQA: 40.32 vs 59 (gpt4)-31.7%
WinoGrande: 63.54 vs 87.5 (gpt4)-27.4%
GSM8K: 6.37 vs 96.4 (so35)-93.4%
LLME Score: 0.14241
nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
GPT Sw3 6.7B V2 Instruct (AI-Sweden-Models/gpt-sw3-6.7b-v2-instruct)
🌟 Advertise your project 🚀

GPT Sw3 6.7B V2 Instruct Parameters and Internals

Model Type 
language model, text generation
Use Cases 
Areas:
Nordic NLP ecosystem
Applications:
Pre-release for research and evaluation of the capabilities of Large Language Models for the Nordic languages.
Primary Use Cases:
GPT-SW3 can generate coherent text in multiple languages and perform text tasks by casting them as text generation tasks.
Limitations:
Bias, Safety, Generation diversity issues, Hallucination, Overrepresentation/Underrepresentation of certain viewpoints, Stereotypes, May generate inappropriate content
Supported Languages 
da (Unknown), sv (Unknown), no (Unknown), en (Unknown), is (Unknown)
Training Details 
Data Sources:
laion/OIG, databricks/databricks-dolly-15k, OpenAssistant/oasst1
Data Volume:
320B tokens
Methodology:
Trained with the NeMo Megatron GPT implementation.
Model Architecture:
Decoder-only transformer language model.
Input Output 
Input Format:
Raw text or instruction data in chat format.
Accepted Modalities:
text
Output Format:
Generated text
LLM NameGPT Sw3 6.7B V2 Instruct
Repository 🤗https://huggingface.co/AI-Sweden-Models/gpt-sw3-6.7b-v2-instruct 
Base Model(s)  AI-Sweden-Models/gpt-sw3-6.7b-v2   AI-Sweden-Models/gpt-sw3-6.7b-v2
Model Size6.7b
Required VRAM28.1 GB
Updated2025-06-17
MaintainerAI-Sweden-Models
Model Typegpt2
Instruction-BasedYes
Model Files  10.0 GB: 1-of-3   10.0 GB: 2-of-3   8.1 GB: 3-of-3   10.0 GB: 1-of-3   10.0 GB: 2-of-3   8.1 GB: 3-of-3
Supported Languagesda sv no en is
Model ArchitectureGPT2LMHeadModel
Licenseother
Model Max Length2048
Transformers Version4.22.1
Tokenizer ClassGPTSw3Tokenizer
Padding Token<pad>
Vocabulary Size64000
Torch Data Typefloat32
Activation Functiongelu

Rank the GPT Sw3 6.7B V2 Instruct Capabilities

🆘 Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! 🌟

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 48186 in total.

Email us: info@extractum.io. Our Privacy Policy  | Terms and Conditions  | Suggest an improvement.
Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124
  Support LLM Explorer