What are the hardware requirements for Llama 68M?

Llama 68M requires a context window of 2K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed Llama 68M and how large is it?

Llama 68M is developed by JackFram, a model with 68m parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate Llama 68M?

Llama 68M is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

Llama 68M by JackFram — 2K context

Name: Llama 68M
Author: JackFram

Llama 68M is an open-source language model by JackFram. Features: 68m LLM, Context: 2K, License: apache-2.0, LLM Explorer Score: 0.16.

Arxiv:2305.09781 Dataset:wikipedia En Endpoints compatible Llama Pytorch Region:us

Model Card on HF 🤗: https://huggingface.co/JackFram/llama-68m

Llama 68M Parameters and Internals

Model Type

text generation

Additional Notes

No evaluation has been conducted on this model yet, so use it with care.

Supported Languages

English (Full Proficiency)

Training Details

Data Sources:

Wikipedia, C4-en, C4-realnewslike

Model Architecture:

Small Speculative Model

LLM Name	Llama 68M
Repository 🤗	https://huggingface.co/JackFram/llama-68m
Model Size	68m
Required VRAM	0 GB
Updated	2026-07-24
Maintainer	JackFram
Model Type	llama
Model Files	0.5 GB 0.3 GB 0.0 GB 0.0 GB
Supported Languages	en
Model Architecture	LlamaForCausalLM
License	apache-2.0
Context Length	2048
Model Max Length	2048
Transformers Version	4.30.0.dev0
Tokenizer Class	LlamaTokenizer
Beginning of Sentence Token	<s>
End of Sentence Token	</s>
Unk Token	<unk>
Vocabulary Size	32000
Torch Data Type	float32

Rank the Llama 68M capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to Llama 68M

Best Alternatives	Context / RAM	Downloads	Likes
Llama 68M Fft	4K / 0.1 GB	477	0
Llama 43M Beta	2K / 0.2 GB	6	0
Llama 68M Chat V1	2K / 0.3 GB	692	13
Vicuna 68M	2K / 0.3 GB	11617	6
Gpt2 Sft Dutch	2K / 0.1 GB	9	0
Jack 68M Text Structurization	2K / 0.1 GB	10	2
Llama 68M Oasst Top1	2K / 0.3 GB	10	0
Llama 68M Oasst	2K / 0.3 GB	5	0
Llama 68M Finetuned Wikitext2	2K / 0.3 GB	10	0
JackFram Llama 68M	2K / 0.3 GB	8	5

Note: green Score (e.g. "73.2") means that the model is better than JackFram/llama-68m.