← Back to community benchmarks

gemma-3-4b-it-qat

M4 (10c) · 24 GB · 4bit · 2026-04-01

Performance

64k

tokens

132.1

PP tok/s

6.7

TG tok/s

496022

TTFT (ms)

5.6

Peak mem (GB)

Hardware

Chip M4 (10c)

Memory 24 GB

GPU Cores 10

Software

oMLX v0.3.0

macOS macOS 26.3.1

Context 65,536