← Back to community benchmarks
gemma-4-31b-it-5bit
Performance
4k
tokens
683.9
PP tok/s
20.4
TG tok/s
5989
TTFT (ms)
22.9
Peak mem (GB)
Hardware
Chip
M5 Max (40c)
Memory
128 GB
GPU Cores
40
Software
oMLX
v0.3.3
macOS
macOS 26.4
Context
4,096