Community Benchmarks

Download oMLX →

Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).

# Chip RAM Model Quant Ctx PP tok/s TG tok/s Date ↓
279541 M4 Max (40c) 128 GB Qwen3.5-122B-A10B 4bit 32k 464.4 32.9 26-03-19
279542 M1 (8c) 16 GB Qwen3.5-9B 4bit 4k 72.3 10.2 26-03-19
279543 M1 (8c) 16 GB Qwen3.5-9B 4bit 1k 69.1 11.8 26-03-19
279544 M4 (10c) 24 GB Qwen3.5-9B 4bit 4k 224.3 20.6 26-03-19
279545 M4 (10c) 24 GB Qwen3.5-9B 4bit 1k 221.0 20.5 26-03-19
279546 M4 Pro (20c) 24 GB Qwen3.5-0.8B bf16 64k 2,350 64.0 26-03-19
279547 M4 Pro (20c) 24 GB Qwen3.5-0.8B bf16 16k 3,924 103.5 26-03-19
279548 M4 Pro (20c) 24 GB Qwen3.5-0.8B bf16 32k 3,224 84.7 26-03-19
279549 M4 Pro (20c) 24 GB Qwen3.5-0.8B bf16 8k 4,379 108.9 26-03-19
279550 M4 Pro (20c) 24 GB Qwen3.5-0.8B bf16 4k 4,553 122.9 26-03-19
305,215 results · Page 27955 of 30522