← Back to community benchmarks

unsloth-gemma-4-26B-A4B-it-qat-oQ4

M5 Max (40c) · 128 GB · 4bit · 2026-07-23

Performance

64k

tokens

2,665

PP tok/s

61.2

TG tok/s

24588

TTFT (ms)

27.4

Peak mem (GB)

Hardware

Chip M5 Max (40c)

Memory 128 GB

GPU Cores 40

Software

oMLX v0.5.3

macOS macOS 26.5.1

Context 65,536