Community Benchmarks

Download oMLX →

Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).

# Chip RAM Model Quant Ctx PP tok/s TG tok/s Date ↓
8291 M4 Pro (16c) 48 GB Qwen3.5-9B 8bit 1k 351.7 28.1 26-03-09
8292 M4 (10c) 16 GB Qwen3.5-4B 4bit 4k 259.7 31.5 26-03-09
8293 M4 (10c) 16 GB Qwen3.5-4B 4bit 1k 228.8 31.3 26-03-09
8294 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 64k 801.8 32.7 26-03-09
8295 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 32k 969.1 44.3 26-03-09
8296 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 16k 1,068 54.5 26-03-09
8297 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 8k 1,120 60.2 26-03-09
8298 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 4k 1,123 64.8 26-03-09
8299 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 1k 1,025 67.3 26-03-09
8300 M4 (10c) 24 GB Qwen3.5-9B 4bit 1k 223.3 21.1 26-03-09
8,815 results · Page 830 of 882