← Back to community benchmarks

gemma-4-31B-it

M3 Ultra (80c) · 512 GB · bf16 · 2026-05-23

Performance

64k

tokens

256.8

PP tok/s

8.3

TG tok/s

255217

TTFT (ms)

68.5

Peak mem (GB)

Hardware

Chip M3 Ultra (80c)

Memory 512 GB

GPU Cores 80

Software

oMLX v0.3.9

macOS macOS 26.4.1

Context 65,536