← Back to community benchmarks

gemma-4-31b-it

M5 Max (40c) · 128 GB · bf16 · 2026-04-16
Performance
4k
tokens
581.9
PP tok/s
7.2
TG tok/s
7039
TTFT (ms)
60.5
Peak mem (GB)
Hardware
Chip M5 Max (40c)
Memory 128 GB
GPU Cores 40
Software
oMLX v0.3.5.dev1
macOS macOS 26.3.2
Context 4,096