← Back to community benchmarks

Ternary-Bonsai-1.7B

M3 (8c) · 16 GB · 2bit · 2026-04-28

Performance

1k

tokens

712.7

PP tok/s

100.3

TG tok/s

1437

TTFT (ms)

1.2

Peak mem (GB)

Hardware

Chip M3 (8c)

Memory 16 GB

GPU Cores 8

Software

oMLX v0.3.8rc1

macOS macOS 26.2

Context 1,024

Batching Results

Batch Size	TG tok/s	Speedup
1×	100.3	1.00×
2×	110.2	1.10×