← Back to community benchmarks

Qwen3.5-4B

M1 (8c) · 8 GB · 4bit · 2026-03-14
Performance
4k
tokens
143.2
PP tok/s
21.4
TG tok/s
28598
TTFT (ms)
4.2
Peak mem (GB)
Hardware
Chip M1 (8c)
Memory 8 GB
GPU Cores 8
Software
oMLX v0.2.8
macOS macOS 15.7.4
Context 4,096
Performance by Context Length
Context PP tok/s TG tok/s Peak Mem
1k 143.2 22.9 3.9 GB view
4k 143.2 21.4 4.2 GB current
Batching Results
Batch Size TG tok/s Speedup
1× 22.9 1.00×
2× 33.0 1.44×
4× 34.4 1.50×