Community Benchmarks

Download oMLX →

Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).

# Chip RAM Model Quant Ctx PP tok/s TG tok/s Date ↓
78751 M1 Pro (16c) 32 GB Qwen3.5-9B 4bit 4k 159.3 31.5 26-03-09
78752 M1 Pro (16c) 32 GB Qwen3.5-9B 4bit 1k 158.6 32.3 26-03-09
78753 M2 Ultra (76c) 128 GB Qwen3.5-9B 8bit 32k 742.0 46.4 26-03-09
78754 M2 Ultra (76c) 128 GB Qwen3.5-9B 8bit 64k 668.6 33.9 26-03-09
78755 M2 Ultra (76c) 128 GB Qwen3.5-9B 8bit 8k 797.4 59.7 26-03-09
78756 M2 Ultra (76c) 128 GB Qwen3.5-9B 8bit 16k 778.7 54.0 26-03-09
78757 M2 Ultra (76c) 128 GB Qwen3.5-9B 8bit 4k 804.0 62.6 26-03-09
78758 M2 Ultra (76c) 128 GB Qwen3.5-9B 8bit 1k 794.0 64.3 26-03-09
78759 M2 Ultra (76c) 128 GB Qwen3.5-4B 4bit 64k 1,051 50.4 26-03-09
78760 M2 Ultra (76c) 128 GB Qwen3.5-4B 4bit 32k 1,247 74.5 26-03-09
78,980 results · Page 7876 of 7898