Community Benchmarks

Download oMLX →

Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).

# Chip RAM Model Quant Ctx PP tok/s TG tok/s Date ↓
76731 M4 (10c) 16 GB qianwen3.5-2B unknown 1k 581.8 5.2 26-03-09
76732 M1 Pro (14c) 16 GB Qwen3.5-9B 4bit 4k 137.9 28.8 26-03-09
76733 M1 Pro (14c) 16 GB Qwen3.5-9B 4bit 1k 140.2 30.0 26-03-09
76734 M1 Max (32c) 32 GB Qwen3.5-9B 8bit 64k 205.4 14.8 26-03-09
76735 M1 Max (32c) 32 GB Qwen3.5-9B 8bit 32k 233.2 20.8 26-03-09
76736 M1 Max (32c) 32 GB Qwen3.5-9B 8bit 16k 267.1 28.2 26-03-09
76737 M1 Max (32c) 32 GB Qwen3.5-9B 8bit 8k 272.4 32.0 26-03-09
76738 M1 Max (32c) 32 GB Qwen3.5-9B 8bit 4k 260.3 34.0 26-03-09
76739 M1 Max (32c) 32 GB Qwen3.5-9B 8bit 1k 260.1 33.8 26-03-09
76740 M4 (10c) 32 GB Qwen3.5-9B 4bit 4k 213.7 18.0 26-03-09
77,604 results · Page 7674 of 7761