← Back to community benchmarks

Qwen3.5-9B

M4 (8c) · 16 GB · 4bit · 2026-03-09
Performance
1k
tokens
85.6
PP tok/s
11.2
TG tok/s
11965
TTFT (ms)
6.5
Peak mem (GB)
Hardware
Chip M4 (8c)
Memory 16 GB
GPU Cores 8
Software
oMLX v0.2.6
macOS macOS 15.7.3
Context 1,024
Batching Results
Batch Size TG tok/s Speedup
11.2 1.00×
17.2 1.54×
21.6 1.93×