← Back to community benchmarks

Qwen3.5-2B

M1 (7c) · 8 GB · 6bit · 2026-03-13
Performance
1k
tokens
310.0
PP tok/s
32.2
TG tok/s
3304
TTFT (ms)
2.9
Peak mem (GB)
Hardware
Chip M1 (7c)
Memory 8 GB
GPU Cores 7
Software
oMLX v0.2.10
macOS macOS 26.3.1
Context 1,024
Performance by Context Length
Context PP tok/s TG tok/s Peak Mem
1k 310.0 32.2 2.9 GB current
4k 301.1 28.7 3.0 GB view
Batching Results
Batch Size TG tok/s Speedup
32.2 1.00×
42.2 1.31×
41.7 1.30×