← Back to community benchmarks
gemma-4-31b-it-5bit
Performance
8k
tokens
130.1
PP tok/s
8.3
TG tok/s
62951
TTFT (ms)
24.3
Peak mem (GB)
Hardware
Chip
M4 Max (32c)
Memory
36 GB
GPU Cores
32
Software
oMLX
v0.3.1
macOS
macOS 26.4
Context
8,192