Custom Activations GPT KAN by AISE-TUDelft

 ยป  All LLMs  ยป  AISE-TUDelft  ยป  Custom Activations GPT KAN   URL Share it on

  Activations gpt neo   Autotrain compatible   Dataset:roneneldan/tinystories   Endpoints compatible   Pytorch   Region:us

Custom Activations GPT KAN Benchmarks

nn.n% — How the model compares to the reference models: Anthropic Sonnet 3.5 ("so35"), GPT-4o ("gpt4o") or GPT-4 ("gpt4").
๐ŸŒŸ Advertise your project ๐Ÿš€

Custom Activations GPT KAN Parameters and Internals

Additional Notes 
Configs: Vocab size 10,000, Hidden size 512, Max position embeddings 512, Number of layers 2, Number of heads 4, Window size 256, Intermediate-size 256.
Training Details 
Data Sources:
roneneldan/TinyStories
LLM NameCustom Activations GPT KAN
Repository ๐Ÿค—https://huggingface.co/AISE-TUDelft/Custom-Activations-GPT-KAN 
Required VRAM0 GB
Updated2025-06-09
MaintainerAISE-TUDelft
Model Typeactivations_gpt_neo
Model Files  0.0 GB
Model ArchitectureActivationsGPTNeoForCausalLM
Context Length512
Model Max Length512
Transformers Version4.26.1
Vocabulary Size10000
Torch Data Typefloat32
Activation Functiongelu_new
Custom Activations GPT KAN (AISE-TUDelft/Custom-Activations-GPT-KAN)

Rank the Custom Activations GPT KAN Capabilities

๐Ÿ†˜ Have you tried this model? Rate its performance. This feedback would greatly assist ML community in identifying the most suitable model for their needs. Your contribution really does make a difference! ๐ŸŒŸ

Instruction Following and Task Automation  
Factuality and Completeness of Knowledge  
Censorship and Alignment  
Data Analysis and Insight Generation  
Text Generation  
Text Summarization and Feature Extraction  
Code Generation  
Multi-Language Support and Translation  

What open-source LLMs or SLMs are you in search of? 48023 in total.

Our Social Media →  
Original data from HuggingFace, OpenCompass and various public git repos.
Release v20241124