← Back to community benchmarks

gemma-4-31B-it

M5 Max (40c) · 128 GB · 8bit · 2026-05-09

Performance

64k

tokens

310.5

PP tok/s

5.2

TG tok/s

211096

TTFT (ms)

41.8

Peak mem (GB)

Hardware

Chip M5 Max (40c)

Memory 128 GB

GPU Cores 40

Software

oMLX v0.3.8

macOS macOS 26.4.1

Context 65,536