← Back to community benchmarks

Qwen3.5-9B

M1 (8c) · 16 GB · 4bit · 2026-03-19
Performance
1k
tokens
69.1
PP tok/s
11.8
TG tok/s
14818
TTFT (ms)
6.5
Peak mem (GB)
Hardware
Chip M1 (8c)
Memory 16 GB
GPU Cores 8
Software
oMLX v0.2.19
macOS macOS 26.3.1
Context 1,024
Performance by Context Length
Context PP tok/s TG tok/s Peak Mem
1k 69.1 11.8 6.5 GB current
4k 72.3 10.2 7.3 GB view
Batching Results
Batch Size TG tok/s Speedup
11.8 1.00×
18.7 1.58×
19.2 1.63×