Performance
4k
tokens
128.5
PP tok/s
11.1
TG tok/s
31867
TTFT (ms)
6.0
Peak mem (GB)
Hardware
Chip
M1 (8c)
Memory
16 GB
GPU Cores
8
Software
oMLX
v0.2.6
macOS
macOS 26.3.1
Context
4,096