← Back to community benchmarks

gemma-4-31b-it

M3 Ultra (80c) · 512 GB · 8bit · 2026-05-03

Performance

64k

tokens

244.7

PP tok/s

12.2

TG tok/s

267826

TTFT (ms)

41.8

Peak mem (GB)

Hardware

Chip M3 Ultra (80c)

Memory 512 GB

GPU Cores 80

Software

oMLX v0.3.8

macOS macOS 26.4.1

Context 65,536