← Back to community benchmarks

Qwen3.5-9B

M4 (8c) · 16 GB · 4bit · 2026-03-09
Performance
4k
tokens
168.1
PP tok/s
19.8
TG tok/s
24370
TTFT (ms)
6.8
Peak mem (GB)
Hardware
Chip M4 (8c)
Memory 16 GB
GPU Cores 8
Software
oMLX v0.2.6
macOS macOS 15.6
Context 4,096
Performance by Context Length
Context PP tok/s TG tok/s Peak Mem
1k 168.6 20.4 6.5 GB view
4k 168.1 19.8 6.8 GB current
Batching Results
Batch Size TG tok/s Speedup
20.4 1.00×
36.8 1.80×
38.4 1.88×