← Back to community benchmarks

Qwen3.5-2B

M1 (8c) · 16 GB · 4bit · 2026-03-10
Performance
1k
tokens
365.2
PP tok/s
43.2
TG tok/s
2804
TTFT (ms)
2.5
Peak mem (GB)
Hardware
Chip M1 (8c)
Memory 16 GB
GPU Cores 8
Software
oMLX v0.2.7
macOS macOS 26.3
Context 1,024
Performance by Context Length
Context PP tok/s TG tok/s Peak Mem
1k 365.2 43.2 2.5 GB current
4k 366.3 45.7 2.5 GB view
Batching Results
Batch Size TG tok/s Speedup
43.2 1.00×
70.3 1.63×
74.4 1.72×