← Back to community benchmarks

gemma-4-31B-it

M5 Max (40c) · 128 GB · 8bit · 2026-05-18
Performance
64k
tokens
397.8
PP tok/s
9.6
TG tok/s
164760
TTFT (ms)
41.8
Peak mem (GB)
Hardware
Chip M5 Max (40c)
Memory 128 GB
GPU Cores 40
Software
oMLX v0.3.8
macOS macOS 26.5
Context 65,536