← Back to community benchmarks

gemma-4-12B-it

M5 Max (32c) · 36 GB · 8bit · 2026-06-04

Performance

64k

tokens

1,038

PP tok/s

26.6

TG tok/s

63127

TTFT (ms)

16.6

Peak mem (GB)

Hardware

Chip M5 Max (32c)

Memory 36 GB

GPU Cores 32

Software

oMLX v0.4.2.dev2

macOS macOS 26.5.1

Context 65,536