← Back to community benchmarks
gemma-4-31b-it-5bit
Performance
1k
tokens
136.6
PP tok/s
15.6
TG tok/s
7498
TTFT (ms)
21.1
Peak mem (GB)
Hardware
Chip
M1 Ultra (64c)
Memory
128 GB
GPU Cores
64
Software
oMLX
v0.3.4
macOS
macOS 15.6.1
Context
1,024