Search operators

brand: benchmark: record: model: metric: date: org:

Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA

MMMU-Pro

Benchmark Family
MMMU-Pro
Organization
Unknown
Status
ACTIVE

Versions / Variants

Version or VariantReferenceStatusRecords
Unspecifiedmmmu-pro/defaultACTIVE153

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-007QWEN3VL32BINSTRUCT-011 Qwen3 VL 32B Instruct MMMU-Pro Overall 64.3% Unknown Primary source QWEN-QWEN3VL32BINSTRUCT
BR-007QWEN3VL4B-011 Qwen3 VL 4B MMMU-Pro Overall 52% Unknown Primary source QWEN-QWEN3VL4B
BR-007QWEN3VL4BINSTRUCT-011 Qwen3 VL 4B Instruct MMMU-Pro Overall 43.9% Unknown Primary source QWEN-QWEN3VL4BINSTRUCT
BR-007QWEN3VL8B-011 Qwen3 VL 8B MMMU-Pro Overall 56.6% Unknown Primary source QWEN-QWEN3VL8B
BR-007QWEN3VL8BINSTRUCT-011 Qwen3 VL 8B Instruct MMMU-Pro Overall 47.3% Unknown Primary source QWEN-QWEN3VL8BINSTRUCT
BR-009LLAMA32INSTRUCT11BVISION-011 Llama 3.2 Instruct 11B (Vision) MMMU-Pro Overall 29.3% Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT90BVISION-005 Llama 3.2 Instruct 90B (Vision) MMMU-Pro Overall 39.5% Unknown Primary source META-LLAMA32INSTRUCT90BVISION
BR-009LLAMA4MAVERICK-014 Llama 4 Maverick MMMU-Pro Overall 62.1% Unknown Primary source META-LLAMA4MAVERICK
BR-009LLAMA4SCOUT-014 Llama 4 Scout MMMU-Pro Overall 52.9% Unknown Primary source META-LLAMA4SCOUT
BR-009MUSESPARK-014 Muse Spark MMMU-Pro Overall 80.5% Unknown Primary source META-MUSESPARK
BR-010KIMIK25-012 Kimi K2.5 MMMU-Pro Overall 75.4% Unknown Primary source KIMI-KIMIK25
BR-010KIMIK25-024 Kimi K2.5 MMMU-Pro Overall 73.1% Unknown Primary source KIMI-KIMIK25
BR-010KIMIK26-016 Kimi K2.6 MMMU-Pro Overall 79.4% Unknown Primary source KIMI-KIMIK26
BR-011GLM45V-011 GLM-4.5V MMMU-Pro Overall 42.8% Unknown Primary source GLM-GLM45V
BR-011GLM45V-023 GLM-4.5V MMMU-Pro Overall 50.5% Unknown Primary source GLM-GLM45V
BR-011GLM46V-011 GLM-4.6V MMMU-Pro Overall 42.2% Unknown Primary source GLM-GLM46V
BR-011GLM46V-023 GLM-4.6V MMMU-Pro Overall 48.6% Unknown Primary source GLM-GLM46V
BR-011GLM5VTURBO-011 GLM 5V Turbo MMMU-Pro Overall 72.8% Unknown Primary source GLM-GLM5VTURBO
BR-012M3-005 MiniMax-M3 MMMU-Pro Overall 78.1 Unknown Primary source MMAX-M3
BR-012MINIMAXM3-014 MiniMax-M3 MMMU-Pro Overall 78.6% Unknown Primary source MMAX-M3
BR-013LG3-014 Mistral Large 3 MMMU-Pro Overall 55.7% Unknown Primary source MSTRL-LG3
BR-013SM32-014 Mistral Small 3.2 MMMU-Pro Overall 48% Unknown Primary source MSTRL-SM32
BR-013SM4-011 Mistral Small 4 MMMU-Pro Overall 46.5% Unknown Primary source MSTRL-SM4
BR-013SM4-025 Mistral Small 4 MMMU-Pro Overall 56.8% Unknown Primary source MSTRL-SM4
BR-014COMMANDAPLUS-014 Command A+ MMMU-Pro Overall 63.2% Unknown Primary source COHR-APLUS
BR-015NEMOTRON3NANOOMNI30BA3BREASONING-011 Nemotron 3 Nano Omni 30B A3B Reasoning MMMU-Pro Overall 53.2% Unknown Primary source NVDA-NEMOTRON3NANOOMNI30BA3BREASONING
BR-015NVIDIANEMOTRONNANO12BV2VL-011 NVIDIA Nemotron Nano 12B v2 VL MMMU-Pro Overall 52.9% Unknown Primary source NVDA-NVIDIANEMOTRONNANO12BV2VL
BR-015NVIDIANEMOTRONNANO12BV2VL-023 NVIDIA Nemotron Nano 12B v2 VL MMMU-Pro Overall 44.5% Unknown Primary source NVDA-NVIDIANEMOTRONNANO12BV2VL
BR-016NOVA20LITE-014 Nova 2.0 Lite MMMU-Pro Overall 63.8% Unknown Primary source AMZN-NOVA20LITE
BR-016NOVA20LITE-026 Nova 2.0 Lite MMMU-Pro Overall 58% Unknown Primary source AMZN-NOVA20LITE
BR-016NOVA20LITE-038 Nova 2.0 Lite MMMU-Pro Overall 49% Unknown Primary source AMZN-NOVA20LITE
BR-016NOVA20LITE-050 Nova 2.0 Lite MMMU-Pro Overall 62.5% Unknown Primary source AMZN-NOVA20LITE
BR-016NOVA20OMNI-011 Nova 2.0 Omni MMMU-Pro Overall 61.9% Unknown Primary source AMZN-NOVA20OMNI
BR-016NOVA20OMNI-023 Nova 2.0 Omni MMMU-Pro Overall 49.9% Unknown Primary source AMZN-NOVA20OMNI
BR-016NOVA20OMNI-035 Nova 2.0 Omni MMMU-Pro Overall 59.8% Unknown Primary source AMZN-NOVA20OMNI
BR-016NOVA20PROPREVIEW-014 Nova 2.0 Pro Preview MMMU-Pro Overall 64.5% Unknown Primary source AMZN-NOVA20PROPREVIEW
BR-016NOVA20PROPREVIEW-043 Nova 2.0 Pro Preview MMMU-Pro Overall 62.7% Unknown Primary source AMZN-NOVA20PROPREVIEW
BR-016NOVALITE-011 Nova Lite MMMU-Pro Overall 37.8% Unknown Primary source AMZN-NOVALITE
BR-016NOVAPRO-011 Nova Pro MMMU-Pro Overall 44.3% Unknown Primary source AMZN-NOVAPRO
BR-018MOLMO28B-011 Molmo2-8B MMMU-Pro Overall 37.5% Unknown Primary source AI2-MOLMO28B
BR-018MOLMO7BD-008 Molmo 7B-D MMMU-Pro Overall 24.5% Unknown Primary source AI2-MOLMO7BD
BR-019MIMOV25-014 MiMo-V2.5 MMMU-Pro Overall 75.4% Unknown Primary source XIAOM-MIMOV25
BR-019MIMOV2OMNI-011 MiMo-V2-Omni MMMU-Pro Overall 69.9% Unknown Primary source XIAOM-MIMOV2OMNI
BR-019MIMOV2OMNI0327-011 MiMo-V2-Omni-0327 MMMU-Pro Overall 73.9% Unknown Primary source XIAOM-MIMOV2OMNI0327
BR-020LFM25VL16B-011 LFM2.5-VL-1.6B MMMU-Pro Overall 26.5% Unknown Primary source LQAI-LFM25VL16B
BR-022EXAONE4533B-011 EXAONE 4.5 33B MMMU-Pro Overall 67.3% Unknown Primary source LGAI-EXAONE4533B
BR-026STEP37FLASH-016 Step 3.7 Flash MMMU-Pro Overall 75.3% Unknown Primary source STPFN-STEP37FLASH
BR-026STEP3VL10B-011 Step3 VL 10B MMMU-Pro Overall 64% Unknown Primary source STPFN-STEP3VL10B
BR-027PHI4MULTIMODALINSTRUCT-005 Phi-4 Multimodal Instruct MMMU-Pro Overall 14.5% Unknown Primary source MSFT-PHI4MULTIMODALINSTRUCT
BR-031MINICPMV4613B-014 MiniCPM-V 4.6 1.3B MMMU-Pro Overall 37.9% Unknown Primary source OBMB-MINICPMV4613B
BR-033DOUBAOSEEDCODE-011 Doubao Seed Code MMMU-Pro Overall 68.1% Unknown Primary source BDSD-DOUBAOSEEDCODE
BR-036ERNIE50THINKINGPREVIEW-011 ERNIE 5.0 Thinking Preview MMMU-Pro Overall 64.6% Unknown Primary source BAIDU-ERNIE50THINKINGPREVIEW
BR-037APRIELV1515BTHINKER-011 Apriel-v1.5-15B-Thinker MMMU-Pro Overall 57.1% Unknown Primary source SVNW-APRIELV1515BTHINKER