Community Benchmarks

Download oMLX →

Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).

# Chip RAM Model Quant Ctx PP tok/s TG tok/s Date ↓
40631 M4 (10c) 16 GB Qwen3-Embedding-4B-4bit-D... 4bit 1k 387.1 38.4 26-03-10
40632 M4 (10c) 16 GB Qwen3-Embedding-4B-4bit-D... 4bit 4k 354.4 30.8 26-03-10
40633 M4 Pro (20c) 24 GB Qwen3.5-9B 4bit 1k 425.3 49.1 26-03-10
40634 M4 (10c) 16 GB Qwen3.5-9B 4bit 16k 201.5 18.5 26-03-10
40635 M4 (8c) 16 GB Meta-Llama-3.1-8B-Instruc... 4bit 4k 160.1 19.9 26-03-10
40636 M4 (10c) 16 GB Qwen3-Embedding-0.6B-4bit... 4bit 4k 1,856 95.3 26-03-10
40637 M4 (8c) 16 GB Meta-Llama-3.1-8B-Instruc... 4bit 1k 168.3 21.7 26-03-10
40638 M4 (10c) 16 GB Qwen3-Embedding-0.6B-4bit... 4bit 1k 1,979 173.0 26-03-10
40639 M4 (10c) 16 GB Qwen3.5-9B 4bit 8k 219.0 20.3 26-03-10
40640 M4 (10c) 16 GB Qwen3.5-9B 4bit 4k 223.4 21.3 26-03-10
45,324 results · Page 4064 of 4533