← Back to community benchmarks
gemma-4-31b-it-5bit
Performance
1k
tokens
152.9
PP tok/s
13.4
TG tok/s
6699
TTFT (ms)
22.4
Peak mem (GB)
Hardware
Chip
M4 Max (32c)
Memory
36 GB
GPU Cores
32
Software
oMLX
v0.3.1
macOS
macOS 26.4
Context
1,024