← Back to community benchmarks

Ternary-Bonsai-27B

M3 Ultra (80c) · 96 GB · 2bit · 2026-07-20

Performance

64k

tokens

354.2

PP tok/s

38.7

TG tok/s

185002

TTFT (ms)

13.9

Peak mem (GB)

Hardware

Chip M3 Ultra (80c)

Memory 96 GB

GPU Cores 80

Software

oMLX v0.5.1

macOS macOS 26.5.2

Context 65,536