← Back to community benchmarks
gemma-4-31b-it-oQ6
Performance
32k
tokens
221.3
PP tok/s
17.9
TG tok/s
148038
TTFT (ms)
31.0
Peak mem (GB)
Hardware
Chip
M3 Ultra (60c)
Memory
256 GB
GPU Cores
60
Software
oMLX
v0.3.10
macOS
macOS 26.4.1
Context
32,768
Performance by Context Length
| Context | PP tok/s | TG tok/s | Peak Mem | |
|---|---|---|---|---|
| 32k | 221.3 | 17.9 | 31.0 GB | current |
| 64k | 189.5 | 14.5 | 39.7 GB | view |