BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database
Search operators

brand: benchmark: record: model: metric: date: org:

Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA

Humanity's Last Exam

Benchmark Family
Humanity's Last Exam
Organization
Center for AI Safety
Status
ACTIVE

Versions / Variants

Version or VariantReferenceStatusRecords
Unspecifiedhumanitys-last-exam/defaultACTIVE5
No toolshumanitys-last-exam/no-toolsACTIVE397
With toolshumanitys-last-exam/with-toolsACTIVE9

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-018OLMO232B-003 OLMo 2 32B Humanity's Last Exam No tools Overall 3.7% Unknown Primary source AI2-OLMO232B
BR-018OLMO27B-003 OLMo 2 7B Humanity's Last Exam No tools Overall 5.5% Unknown Primary source AI2-OLMO27B
BR-018OLMO3132BINSTRUCT-003 Olmo 3.1 32B Instruct Humanity's Last Exam No tools Overall 4.9% Unknown Primary source AI2-OLMO3132BINSTRUCT
BR-018OLMO3132BTHINK-003 Olmo 3.1 32B Think Humanity's Last Exam No tools Overall 6% Unknown Primary source AI2-OLMO3132BTHINK
BR-018OLMO332BTHINK-003 Olmo 3 32B Think Humanity's Last Exam No tools Overall 5.9% Unknown Primary source AI2-OLMO332BTHINK
BR-018OLMO37BINSTRUCT-003 Olmo 3 7B Instruct Humanity's Last Exam No tools Overall 5.8% Unknown Primary source AI2-OLMO37BINSTRUCT
BR-018OLMO37BTHINK-003 Olmo 3 7B Think Humanity's Last Exam No tools Overall 5.7% Unknown Primary source AI2-OLMO37BTHINK
BR-019MIMOV25-003 MiMo-V2.5 Humanity's Last Exam No tools Overall 25.2% Unknown Primary source XIAOM-MIMOV25
BR-019MIMOV25PRO-003 MiMo-V2.5-Pro Humanity's Last Exam No tools Overall 33.8% Unknown Primary source XIAOM-MIMOV25PRO
BR-019MIMOV25PRO-019 MiMo-V2.5-Pro Humanity's Last Exam No tools Overall 13.3% Unknown Primary source XIAOM-MIMOV25PRO
BR-019MIMOV2FLASH-003 MiMo-V2-Flash Humanity's Last Exam No tools Overall 8% Unknown Primary source XIAOM-MIMOV2FLASH
BR-019MIMOV2FLASH-017 MiMo-V2-Flash Humanity's Last Exam No tools Overall 21.1% Unknown Primary source XIAOM-MIMOV2FLASH
BR-019MIMOV2FLASHFEB2026-003 MiMo-V2-Flash (Feb 2026) Humanity's Last Exam No tools Overall 20% Unknown Primary source XIAOM-MIMOV2FLASHFEB2026
BR-019MIMOV2OMNI-003 MiMo-V2-Omni Humanity's Last Exam No tools Overall 19.9% Unknown Primary source XIAOM-MIMOV2OMNI
BR-019MIMOV2OMNI0327-003 MiMo-V2-Omni-0327 Humanity's Last Exam No tools Overall 20.4% Unknown Primary source XIAOM-MIMOV2OMNI0327
BR-019MIMOV2PRO-003 MiMo-V2-Pro Humanity's Last Exam No tools Overall 28.3% Unknown Primary source XIAOM-MIMOV2PRO
BR-020LFM212B-003 LFM2 1.2B Humanity's Last Exam No tools Overall 5.7% Unknown Primary source LQAI-LFM212B
BR-020LFM224BA2B-003 LFM2 24B A2B Humanity's Last Exam No tools Overall 4.4% Unknown Primary source LQAI-LFM224BA2B
BR-020LFM226B-003 LFM2 2.6B Humanity's Last Exam No tools Overall 5.2% Unknown Primary source LQAI-LFM226B
BR-020LFM2512BINSTRUCT-003 LFM2.5-1.2B-Instruct Humanity's Last Exam No tools Overall 6.8% Unknown Primary source LQAI-LFM2512BINSTRUCT
BR-020LFM2512BTHINKING-003 LFM2.5-1.2B-Thinking Humanity's Last Exam No tools Overall 6.1% Unknown Primary source LQAI-LFM2512BTHINKING
BR-020LFM258BA1B-003 LFM2.5-8B-A1B Humanity's Last Exam No tools Overall 6.9% Unknown Primary source LQAI-LFM258BA1B
BR-020LFM25VL16B-003 LFM2.5-VL-1.6B Humanity's Last Exam No tools Overall 5.1% Unknown Primary source LQAI-LFM25VL16B
BR-020LFM28BA1B-003 LFM2 8B A1B Humanity's Last Exam No tools Overall 4.9% Unknown Primary source LQAI-LFM28BA1B
BR-020LFM40B-003 LFM 40B Humanity's Last Exam No tools Overall 4.9% Unknown Primary source LQAI-LFM40B
BR-021LING1T-003 Ling-1T Humanity's Last Exam No tools Overall 7.2% Unknown Primary source INCAI-LING1T
BR-021LING261T-003 Ling-2.6-1T Humanity's Last Exam No tools Overall 8.2% Unknown Primary source INCAI-LING261T
BR-021LING26FLASH-003 Ling 2.6 Flash Humanity's Last Exam No tools Overall 6.2% Unknown Primary source INCAI-LING26FLASH
BR-021LINGFLASH20-003 Ling-flash-2.0 Humanity's Last Exam No tools Overall 6.3% Unknown Primary source INCAI-LINGFLASH20
BR-021LINGMINI20-003 Ling-mini-2.0 Humanity's Last Exam No tools Overall 5% Unknown Primary source INCAI-LINGMINI20
BR-021RING1T-003 Ring-1T Humanity's Last Exam No tools Overall 10.2% Unknown Primary source INCAI-RING1T
BR-021RING261T-003 Ring-2.6-1T Humanity's Last Exam No tools Overall 18.3% Unknown Primary source INCAI-RING261T
BR-021RINGFLASH20-003 Ring-flash-2.0 Humanity's Last Exam No tools Overall 8.9% Unknown Primary source INCAI-RINGFLASH20
BR-022EXAONE4012B-003 Exaone 4.0 1.2B Humanity's Last Exam No tools Overall 5.8% Unknown Primary source LGAI-EXAONE4012B
BR-022EXAONE4012B-014 Exaone 4.0 1.2B Humanity's Last Exam No tools Overall 5.8% Unknown Primary source LGAI-EXAONE4012B
BR-022EXAONE4032B-003 EXAONE 4.0 32B Humanity's Last Exam No tools Overall 4.9% Unknown Primary source LGAI-EXAONE4032B
BR-022EXAONE4032B-014 EXAONE 4.0 32B Humanity's Last Exam No tools Overall 10.5% Unknown Primary source LGAI-EXAONE4032B
BR-022EXAONE4533B-003 EXAONE 4.5 33B Humanity's Last Exam No tools Overall 11.6% Unknown Primary source LGAI-EXAONE4533B
BR-022KEXAONE-003 K-EXAONE Humanity's Last Exam No tools Overall 13.1% Unknown Primary source LGAI-KEXAONE
BR-022KEXAONE-014 K-EXAONE Humanity's Last Exam No tools Overall 5.4% Unknown Primary source LGAI-KEXAONE
BR-023DEEPHERMES3LLAMA318BPREVIEW-003 DeepHermes 3 - Llama-3.1 8B Preview Humanity's Last Exam No tools Overall 4.3% Unknown Primary source NOUS-DEEPHERMES3LLAMA318BPREVIEW
BR-023DEEPHERMES3MISTRAL24BPREVIEW-003 DeepHermes 3 - Mistral 24B Preview Humanity's Last Exam No tools Overall 3.9% Unknown Primary source NOUS-DEEPHERMES3MISTRAL24BPREVIEW
BR-023HERMES3LLAMA3170B-003 Hermes 3 - Llama-3.1 70B Humanity's Last Exam No tools Overall 4.1% Unknown Primary source NOUS-HERMES3LLAMA3170B
BR-023HERMES4LLAMA31405B-003 Hermes 4 - Llama-3.1 405B Humanity's Last Exam No tools Overall 10.3% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-014 Hermes 4 - Llama-3.1 405B Humanity's Last Exam No tools Overall 4.2% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA3170B-003 Hermes 4 - Llama-3.1 70B Humanity's Last Exam No tools Overall 3.6% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-014 Hermes 4 - Llama-3.1 70B Humanity's Last Exam No tools Overall 7.9% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-024SOLAROPEN100B-003 Solar Open 100B Humanity's Last Exam No tools Overall 9.2% Unknown Primary source UPSTG-SOLAROPEN100B
BR-024SOLARPRO2-003 Solar Pro 2 Humanity's Last Exam No tools Overall 3.8% Unknown Primary source UPSTG-SOLARPRO2
BR-024SOLARPRO2-014 Solar Pro 2 Humanity's Last Exam No tools Overall 7% Unknown Primary source UPSTG-SOLARPRO2
BR-024SOLARPRO2PREVIEW-003 Solar Pro 2 (Preview) Humanity's Last Exam No tools Overall 3.8% Unknown Primary source UPSTG-SOLARPRO2PREVIEW
BR-024SOLARPRO2PREVIEW-007 Solar Pro 2 (Preview) Humanity's Last Exam No tools Overall 5.7% Unknown Primary source UPSTG-SOLARPRO2PREVIEW
BR-024SOLARPRO3-003 Solar Pro 3 Humanity's Last Exam No tools Overall 10.1% Unknown Primary source UPSTG-SOLARPRO3
BR-025JAMBA15LARGE-003 Jamba 1.5 Large Humanity's Last Exam No tools Overall 4% Unknown Primary source AI21-JAMBA15LARGE
BR-025JAMBA15MINI-003 Jamba 1.5 Mini Humanity's Last Exam No tools Overall 5.1% Unknown Primary source AI21-JAMBA15MINI
BR-025JAMBA16LARGE-003 Jamba 1.6 Large Humanity's Last Exam No tools Overall 4% Unknown Primary source AI21-JAMBA16LARGE
BR-025JAMBA16MINI-003 Jamba 1.6 Mini Humanity's Last Exam No tools Overall 4.6% Unknown Primary source AI21-JAMBA16MINI
BR-025JAMBA17LARGE-003 Jamba 1.7 Large Humanity's Last Exam No tools Overall 3.8% Unknown Primary source AI21-JAMBA17LARGE
BR-025JAMBA17MINI-003 Jamba 1.7 Mini Humanity's Last Exam No tools Overall 4.5% Unknown Primary source AI21-JAMBA17MINI
BR-025JAMBAREASONING3B-003 Jamba Reasoning 3B Humanity's Last Exam No tools Overall 4.6% Unknown Primary source AI21-JAMBAREASONING3B
BR-026STEP35FLASH-003 Step 3.5 Flash Humanity's Last Exam No tools Overall 19.1% Unknown Primary source STPFN-STEP35FLASH
BR-026STEP35FLASH2603-003 Step 3.5 Flash 2603 Humanity's Last Exam No tools Overall 22.6% Unknown Primary source STPFN-STEP35FLASH2603
BR-026STEP37FLASH-003 Step 3.7 Flash Humanity's Last Exam No tools Overall 19.9% Unknown Primary source STPFN-STEP37FLASH
BR-026STEP3VL10B-003 Step3 VL 10B Humanity's Last Exam No tools Overall 10.2% Unknown Primary source STPFN-STEP3VL10B
BR-027PHI3MINIINSTRUCT38B-003 Phi-3 Mini Instruct 3.8B Humanity's Last Exam No tools Overall 4.4% Unknown Primary source MSFT-PHI3MINIINSTRUCT38B
BR-027PHI4-003 Phi-4 Humanity's Last Exam No tools Overall 4.1% Unknown Primary source MSFT-PHI4
BR-027PHI4MINIINSTRUCT-003 Phi-4 Mini Instruct Humanity's Last Exam No tools Overall 4.2% Unknown Primary source MSFT-PHI4MINIINSTRUCT
BR-027PHI4MULTIMODALINSTRUCT-003 Phi-4 Multimodal Instruct Humanity's Last Exam No tools Overall 4.4% Unknown Primary source MSFT-PHI4MULTIMODALINSTRUCT
BR-028K2THINKV2-003 K2 Think V2 Humanity's Last Exam No tools Overall 9.5% Unknown Primary source MBZAI-K2THINKV2
BR-028K2V2-003 K2-V2 Humanity's Last Exam No tools Overall 9.8% Unknown Primary source MBZAI-K2V2
BR-028K2V2-014 K2-V2 Humanity's Last Exam No tools Overall 3.9% Unknown Primary source MBZAI-K2V2
BR-028K2V2-025 K2-V2 Humanity's Last Exam No tools Overall 4.4% Unknown Primary source MBZAI-K2V2
BR-029JT35BFLASH-003 JT-35B-Flash Humanity's Last Exam No tools Overall 6.1% Unknown Primary source CMOB-JT35BFLASH
BR-029JT41FLASH236BA21B-003 JT-4.1 Flash 236B A21B Humanity's Last Exam No tools Overall 16.1% Unknown Primary source CMOB-JT41FLASH236BA21B
BR-029JTMINI-003 JT-MINI Humanity's Last Exam No tools Overall 6.6% Unknown Primary source CMOB-JTMINI
BR-030SARVAM105B-003 Sarvam 105B Humanity's Last Exam No tools Overall 10.1% Unknown Primary source SRVM-SARVAM105B
BR-030SARVAM30B-003 Sarvam 30B Humanity's Last Exam No tools Overall 7% Unknown Primary source SRVM-SARVAM30B
BR-030SARVAMM-003 Sarvam M Humanity's Last Exam No tools Overall 3.3% Unknown Primary source SRVM-SARVAMM
BR-031MINICPM51B-003 MiniCPM5-1B Humanity's Last Exam No tools Overall 6.5% Unknown Primary source OBMB-MINICPM51B
BR-031MINICPM51B-014 MiniCPM5-1B Humanity's Last Exam No tools Overall 4.6% Unknown Primary source OBMB-MINICPM51B
BR-031MINICPMV4613B-003 MiniCPM-V 4.6 1.3B Humanity's Last Exam No tools Overall 4.9% Unknown Primary source OBMB-MINICPMV4613B
BR-032APERTUS70BINSTRUCT-003 Apertus 70B Instruct Humanity's Last Exam No tools Overall 5.5% Unknown Primary source SWAI-APERTUS70BINSTRUCT
BR-032APERTUS8BINSTRUCT-003 Apertus 8B Instruct Humanity's Last Exam No tools Overall 5% Unknown Primary source SWAI-APERTUS8BINSTRUCT
BR-033DOUBAOSEEDCODE-003 Doubao Seed Code Humanity's Last Exam No tools Overall 13.3% Unknown Primary source BDSD-DOUBAOSEEDCODE
BR-033SEEDOSS36BINSTRUCT-003 Seed-OSS-36B-Instruct Humanity's Last Exam No tools Overall 9.1% Unknown Primary source BDSD-SEEDOSS36BINSTRUCT
BR-034TRI21BTHINK-003 Tri-21B-Think Humanity's Last Exam No tools Overall 6.1% Unknown Primary source TRLN-TRI21BTHINK
BR-034TRI21BTHINKPREVIEW-003 Tri-21B-think Preview Humanity's Last Exam No tools Overall 5.7% Unknown Primary source TRLN-TRI21BTHINKPREVIEW
BR-035HY3PREVIEW-003 Hy3-preview Humanity's Last Exam No tools Overall 25.5% Unknown Primary source TCNT-HY3PREVIEW
BR-035HY3PREVIEW-014 Hy3-preview Humanity's Last Exam No tools Overall 6.3% Unknown Primary source TCNT-HY3PREVIEW
BR-036ERNIE45300BA47B-003 ERNIE 4.5 300B A47B Humanity's Last Exam No tools Overall 3.5% Unknown Primary source BAIDU-ERNIE45300BA47B
BR-036ERNIE50THINKINGPREVIEW-003 ERNIE 5.0 Thinking Preview Humanity's Last Exam No tools Overall 12.7% Unknown Primary source BAIDU-ERNIE50THINKINGPREVIEW
BR-037APRIELV1515BTHINKER-003 Apriel-v1.5-15B-Thinker Humanity's Last Exam No tools Overall 12% Unknown Primary source SVNW-APRIELV1515BTHINKER
BR-037APRIELV1615BTHINKER-003 Apriel-v1.6-15B-Thinker Humanity's Last Exam No tools Overall 9.8% Unknown Primary source SVNW-APRIELV1615BTHINKER
BR-038REKAFLASH3-003 Reka Flash 3 Humanity's Last Exam No tools Overall 5.1% Unknown Primary source REKA-REKAFLASH3
BR-039MIDMK25PRO-003 Mi:dm K 2.5 Pro Humanity's Last Exam No tools Overall 7.7% Unknown Primary source KT-MIDMK25PRO
BR-039MIDMK25PROPREVIEW-002 Mi:dm K 2.5 Pro Preview Humanity's Last Exam No tools Overall 8.8% Unknown Primary source KT-MIDMK25PROPREVIEW
BR-040KATCODERPROV1-003 KAT-Coder-Pro V1 Humanity's Last Exam No tools Overall 33.4% Unknown Primary source KWAI-KATCODERPROV1
BR-040KATCODERPROV2-003 KAT Coder Pro V2 Humanity's Last Exam No tools Overall 16% Unknown Primary source KWAI-KATCODERPROV2
BR-041MERCURY2-003 Mercury 2 Humanity's Last Exam No tools Overall 15.5% Unknown Primary source INCPT-MERCURY2
BR-042DBRXINSTRUCT-003 DBRX Instruct Humanity's Last Exam No tools Overall 6.6% Unknown Primary source DBRX-DBRXINSTRUCT