What are the hardware requirements for JackFram Llama 68M?

JackFram Llama 68M requires approximately 0.3 GB of VRAM and supports a context window of 2K tokens. Quantized variants may run on less VRAM; see the Quantized Models section on this page.

Who developed JackFram Llama 68M and how large is it?

JackFram Llama 68M is developed by TheBlokeAI, a model with 68m parameters. The model is published as open weights on Hugging Face and indexed on LLM Explorer with full benchmark history.

Where can I download or evaluate JackFram Llama 68M?

JackFram Llama 68M is hosted on Hugging Face and linked from this page. LLM Explorer also lists quantized variants and similar alternatives if available.

JackFram Llama 68M by TheBlokeAI — VRAM 0.3GB, 2K context

Name: JackFram Llama 68M
Author: TheBlokeAI

JackFram Llama 68M is an open-source language model by TheBlokeAI. Features: 68m LLM, VRAM: 0.3GB, Context: 2K, License: other, LLM Explorer Score: 0.1.

Endpoints compatible Llama Region:us Safetensors

Model Card on HF 🤗: https://huggingface.co/TheBlokeAI/JackFram-Llama-68M

JackFram Llama 68M Parameters and Internals

Model Type

test, quantization

Use Cases

Areas:

testing

Applications:

quantization

Primary Use Cases:

Test quantization and other processes

Additional Notes

Removed unnecessary files (optimizer.pt, scheduler.pt, rng_state.pth, train*) and converted to safetensors to reduce size.

LLM Name	JackFram Llama 68M
Repository 🤗	https://huggingface.co/TheBlokeAI/JackFram-Llama-68M
Model Size	68m
Required VRAM	0.3 GB
Updated	2026-07-28
Maintainer	TheBlokeAI
Model Type	llama
Model Files	0.3 GB
Model Architecture	LlamaForCausalLM
License	other
Context Length	2048
Model Max Length	2048
Transformers Version	4.35.2
Tokenizer Class	LlamaTokenizer
Beginning of Sentence Token	<s>
End of Sentence Token	</s>
Unk Token	<unk>
Vocabulary Size	32000
Torch Data Type	float16

Rank the JackFram Llama 68M capabilities

Have you tried this model? Rate its performance — this feedback helps the ML community find the right model for their needs.

Instruction Following and Task Automation
Factuality and Completeness of Knowledge
Censorship and Alignment
Data Analysis and Insight Generation
Text Generation
Text Summarization and Feature Extraction
Code Generation
Multi-Language Support and Translation

Best Alternatives to JackFram Llama 68M

Best Alternatives	Context / RAM	Downloads	Likes
Llama 68M Fft	4K / 0.1 GB	477	0
Llama 43M Beta	2K / 0.2 GB	6	0
Llama 68M Chat V1	2K / 0.3 GB	692	13
Llama 68M	2K / 0 GB	131563	38
Vicuna 68M	2K / 0.3 GB	11617	6
Gpt2 Sft Dutch	2K / 0.1 GB	9	0
Jack 68M Text Structurization	2K / 0.1 GB	10	2
Llama 68M Oasst Top1	2K / 0.3 GB	10	0
Llama 68M Oasst	2K / 0.3 GB	5	0
Llama 68M Finetuned Wikitext2	2K / 0.3 GB	10	0

Note: green Score (e.g. "73.2") means that the model is better than TheBlokeAI/JackFram-Llama-68M.