← Back to community benchmarks

Qwen3.5-0.8B

M1 (7c) · 16 GB · unknown · 2026-03-10
Performance
1k
tokens
681.6
PP tok/s
7.3
TG tok/s
1502
TTFT (ms)
3.3
Peak mem (GB)
Hardware
Chip M1 (7c)
Memory 16 GB
GPU Cores 7
Software
oMLX v0.2.7
macOS macOS 26.3
Context 1,024
Performance by Context Length
Context PP tok/s TG tok/s Peak Mem
1k 681.6 7.3 3.3 GB current
4k 773.5 7.6 3.4 GB view
Batching Results
Batch Size TG tok/s Speedup
7.3 1.00×
14.1 1.93×
26.1 3.58×