Community Benchmarks

Download oMLX →

Real performance numbers from oMLX users around the world. Submit yours from the app (v0.2.6+).

# Chip RAM Model Quant Ctx PP tok/s TG tok/s Date ↓
263451 M1 Max (32c) 64 GB Nemotron-Cascade-2-30B-A3... 4bit 4k 515.3 73.0 26-03-22
263452 M1 Max (32c) 64 GB Nemotron-Cascade-2-30B-A3... 4bit 1k 470.1 77.4 26-03-22
263453 M4 Pro (16c) 24 GB Qwen3.5-27B-Claude-4.6-Op... 4bit 4k 102.1 15.2 26-03-22
263454 M1 Ultra (48c) 64 GB Nemotron-Cascade-2-30B-A3... 4bit 195k 386.0 16.7 26-03-22
263455 M1 Ultra (48c) 64 GB Nemotron-Cascade-2-30B-A3... 4bit 128k 480.2 25.5 26-03-22
263456 M1 Ultra (48c) 64 GB Nemotron-Cascade-2-30B-A3... 4bit 32k 714.2 54.2 26-03-22
263457 M1 Ultra (48c) 64 GB Nemotron-Cascade-2-30B-A3... 4bit 64k 621.0 40.4 26-03-22
263458 M1 Ultra (48c) 64 GB Nemotron-Cascade-2-30B-A3... 4bit 16k 767.7 67.3 26-03-22
263459 M1 Ultra (48c) 64 GB Nemotron-Cascade-2-30B-A3... 4bit 4k 789.0 80.5 26-03-22
263460 M1 Ultra (48c) 64 GB Nemotron-Cascade-2-30B-A3... 4bit 8k 789.8 76.5 26-03-22
296,421 results · Page 26346 of 29643