← Back to community benchmarks
gemma-3-12b-it-qat
Performance
4k
tokens
220.3
PP tok/s
18.4
TG tok/s
18593
TTFT (ms)
9.2
Peak mem (GB)
Hardware
Chip
M4 Pro (16c)
Memory
24 GB
GPU Cores
16
Software
oMLX
v0.2.6
macOS
macOS 26.3.1
Context
4,096