← Back to community benchmarks

Qwen3.5-0.8B-4bit-OptiQ

M4 Max (40c) · 128 GB · 4bit · 2026-03-16

Performance

1k

tokens

3,756

PP tok/s

380.8

TG tok/s

273

TTFT (ms)

1.8

Peak mem (GB)

Hardware

Chip M4 Max (40c)

Memory 128 GB

GPU Cores 40

Software

oMLX v0.2.12

macOS macOS 26.3.1

Context 1,024