← Back to community benchmarks

gemma-4-31b-it

M5 Max (40c) · 128 GB · 4bit · 2026-05-06
Performance
64k
tokens
372.3
PP tok/s
12.4
TG tok/s
176007
TTFT (ms)
27.5
Peak mem (GB)
Hardware
Chip M5 Max (40c)
Memory 128 GB
GPU Cores 40
Software
oMLX v0.3.8
macOS macOS 26.5
Context 65,536