Community Benchmarks
Download oMLX →Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).
Reset filters| # | Chip | RAM | Model | Quant | Ctx | PP tok/s | TG tok/s | Date ↓ |
|---|---|---|---|---|---|---|---|---|
| 1 | M1 Max (32c) | 64 GB | gemma-4-31B-it-OptiQ | 4bit | 1k | 74.8 | 12.4 | 26-07-17 |
| 2 | M3 Ultra (80c) | 512 GB | gemma4H-31B-oQ8e | 8bit | 64k | 249.5 | 12.6 | 26-07-17 |
| 3 | M3 Ultra (80c) | 512 GB | gemma4H-31B-oQ8e | 8bit | 128k | 190.2 | 9.5 | 26-07-17 |
| 4 | M3 Ultra (80c) | 512 GB | gemma4H-31B-oQ8e | 8bit | 16k | 312.0 | 16.3 | 26-07-17 |
| 5 | M3 Ultra (80c) | 512 GB | gemma4H-31B-oQ8e | 8bit | 32k | 289.3 | 14.9 | 26-07-17 |
| 6 | M3 Ultra (80c) | 512 GB | gemma4H-31B-oQ8e | 8bit | 1k | 348.7 | 17.9 | 26-07-17 |
| 7 | M3 Ultra (80c) | 512 GB | gemma4H-31B-oQ8e | 8bit | 4k | 339.2 | 17.5 | 26-07-17 |
| 8 | M3 Ultra (80c) | 512 GB | gemma4H-31B-oQ8e | 8bit | 8k | 326.1 | 17.1 | 26-07-17 |
| 9 | M5 Pro (20c) | 48 GB | gemma-4-31b-it | 4bit | 4k | 389.7 | 14.0 | 26-07-17 |
| 10 | M5 Pro (20c) | 48 GB | gemma-4-31b-it | 4bit | 1k | 399.4 | 14.5 | 26-07-17 |