← Back to community benchmarks

gemma-4-26B-A4B-it-oQ6

M4 Pro (16c) · 48 GB · 6bit · 2026-05-16
Performance
8k
tokens
588.9
PP tok/s
46.9
TG tok/s
13911
TTFT (ms)
20.8
Peak mem (GB)
Hardware
Chip M4 Pro (16c)
Memory 48 GB
GPU Cores 16
Software
oMLX v0.3.8
macOS macOS 15.7.7
Context 8,192
Performance by Context Length
Context PP tok/s TG tok/s Peak Mem
8k 588.9 46.9 20.8 GB current
16k 560.5 43.4 21.5 GB view
32k 499.4 37.6 22.5 GB view
64k 403.2 28.5 24.5 GB view