← Back to community benchmarks

Mistral-Medium-3.5-128B

M5 Max (40c) · 128 GB · 4bit · 2026-05-03

Performance

4k

tokens

174.9

PP tok/s

6.8

TG tok/s

23421

TTFT (ms)

70.3

Peak mem (GB)

Hardware

Chip M5 Max (40c)

Memory 128 GB

GPU Cores 40

Software

oMLX v0.3.8

macOS macOS 26.4.1

Context 4,096