← Back to community benchmarks

Qwen3.5-9B

M1 (8c) · 16 GB · 4bit · 2026-03-12
Performance
1k
tokens
78.4
PP tok/s
12.7
TG tok/s
13058
TTFT (ms)
6.5
Peak mem (GB)
Hardware
Chip M1 (8c)
Memory 16 GB
GPU Cores 8
Software
oMLX v0.2.7
macOS macOS 26.2
Context 1,024
Batching Results
Batch Size TG tok/s Speedup
12.7 1.00×
19.0 1.50×
19.5 1.54×