← Back to community benchmarks

gemma-4-26B-A4B-it

M3 Ultra (60c) · 96 GB · 4bit · 2026-05-06
Performance
8k
tokens
1,710
PP tok/s
79.1
TG tok/s
4792
TTFT (ms)
14.8
Peak mem (GB)
Hardware
Chip M3 Ultra (60c)
Memory 96 GB
GPU Cores 60
Software
oMLX v0.3.8rc1
macOS macOS 15.7.5
Context 8,192
Performance by Context Length
Context PP tok/s TG tok/s Peak Mem
1k 1,300 99.8 14.3 GB view
4k 1,567 92.2 14.7 GB view
8k 1,710 79.1 14.8 GB current
16k 1,665 63.5 15.2 GB view
32k 1,506 45.1 16.0 GB view
64k 1,218 28.3 17.7 GB view
128k 858.8 8.7 21.2 GB view