LLM EXPLORER 59,420 MODELS INDEXED

Falcon Arxiv Long Summary 1B by GouthamVignesh

By GouthamVignesh · 4 downloads

Falcon Arxiv Long Summary 1B is an open-source language model by GouthamVignesh. Features: 1b LLM, VRAM: 0.2GB, LLM Explorer Score: 0.09.

  Arxiv:1910.09700   Adapter Base model:adapter:tiiuae/falc...   Base model:tiiuae/falcon-rw-1b   Custom code   Falcon   Finetuned   Lora   Peft   Pytorch   Region:us   Safetensors

Falcon Arxiv Long Summary 1B Parameters and Internals

Training Details 
Methodology:
bitsandbytes quantization config with various parameters
LLM NameFalcon Arxiv Long Summary 1B
Repository πŸ€—https://huggingface.co/GouthamVignesh/falcon-arxiv-long-summary-1B 
Base Model(s)  Falcon Rw 1B   tiiuae/falcon-rw-1b
Model Size1b
Required VRAM0.2 GB
Updated2026-07-19
MaintainerGouthamVignesh
Model Files  0.2 GB   2.6 GB   2.6 GB
Model ArchitectureAdapter
Model Max Length1024
Is Biasednone
Tokenizer ClassGPT2Tokenizer
Padding Token<|endoftext|>
PEFT TypeLORA
LoRA ModelYes
PEFT Target Modulesquery_key_value|dense_4h_to_h|dense_h_to_4h|dense
LoRA Alpha16
LoRA Dropout0.1
R Param64

Best Alternatives to Falcon Arxiv Long Summary 1B

Best Alternatives
Context / RAM
Downloads
Likes
...ma 3 1B It Reasoning Grpo Lora0K / 0.2 GB144
Openhermes 1B Olmo Sft Qlora0K / 0 GB70
Zephyr 1B Olmo Sft Qlora0K / 0 GB51
...iabolic6045 ELN AOC CAIN QLoRA0K / 0 GB50
Llama 3.2 1B Airoboros Merged0K / 0.1 GB50
...la Alpaca Orca Instruct V0.0.10K / 1.1 GB880
Peft Starcoder Lora Python0K / 0 GB140
Prem 1B 32K0K / 1.4 GB71
Prem 1B Chat 32K0K / 1.4 GB51
...ama 3 1M Context Gradient Lora0K / 3.5 GB012
Note: green Score (e.g. "73.2") means that the model is better than GouthamVignesh/falcon-arxiv-long-summary-1B.