← Back to community benchmarks

Qwen3.5-9B

M4 (8c) · 16 GB · 8bit · 2026-05-15

Performance

1k

tokens

81.4

PP tok/s

7.0

TG tok/s

12580

TTFT (ms)

9.8

Peak mem (GB)

Hardware

Chip M4 (8c)

Memory 16 GB

GPU Cores 8

Software

oMLX v0.3.9.dev2

macOS macOS 26.4.1

Context 1,024

Batching Results

Batch Size	TG tok/s	Speedup
1×	7.0	1.00×
2×	9.0	1.29×