Performance
128k
tokens
203.5
PP tok/s
18.7
TG tok/s
643998
TTFT (ms)
50.0
Peak mem (GB)
Hardware
Chip
M3 Ultra (60c)
Memory
96 GB
GPU Cores
60
Software
oMLX
v0.3.9.dev1
macOS
macOS 26.4.1
Context
131,072