Community Benchmarks

Download oMLX →

Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).

# Chip RAM Model Quant Ctx PP tok/s TG tok/s Date ↓
7971 M4 (10c) 16 GB Qwen3.5-4B 4bit 1k 228.8 31.3 26-03-09
7972 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 64k 801.8 32.7 26-03-09
7973 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 32k 969.1 44.3 26-03-09
7974 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 16k 1,068 54.5 26-03-09
7975 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 8k 1,120 60.2 26-03-09
7976 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 4k 1,123 64.8 26-03-09
7977 M2 Ultra (60c) 64 GB Qwen3.5-35B-A3B 8bit 1k 1,025 67.3 26-03-09
7978 M4 (10c) 24 GB Qwen3.5-9B 4bit 1k 223.3 21.1 26-03-09
7979 M4 (10c) 16 GB Qwen3.5-9B 4bit 4k 225.0 20.1 26-03-09
7980 M4 (10c) 16 GB Qwen3.5-9B 4bit 1k 224.5 21.1 26-03-09
8,505 results · Page 798 of 851