BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database
Search operators

brand: benchmark: record: model: metric: date: org:

Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA

Humanity's Last Exam

Benchmark Family
Humanity's Last Exam
Organization
Center for AI Safety
Status
ACTIVE

Versions / Variants

Version or VariantReferenceStatusRecords
Unspecifiedhumanitys-last-exam/defaultACTIVE5
No toolshumanitys-last-exam/no-toolsACTIVE397
With toolshumanitys-last-exam/with-toolsACTIVE9

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-009LLAMA33INSTRUCT70B-003 Llama 3.3 Instruct 70B Humanity's Last Exam No tools Overall 4% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA3INSTRUCT70B-003 Llama 3 Instruct 70B Humanity's Last Exam No tools Overall 4.4% Unknown Primary source META-LLAMA3INSTRUCT70B
BR-009LLAMA3INSTRUCT8B-003 Llama 3 Instruct 8B Humanity's Last Exam No tools Overall 5.1% Unknown Primary source META-LLAMA3INSTRUCT8B
BR-009LLAMA4MAVERICK-003 Llama 4 Maverick Humanity's Last Exam No tools Overall 4.8% Unknown Primary source META-LLAMA4MAVERICK
BR-009LLAMA4SCOUT-003 Llama 4 Scout Humanity's Last Exam No tools Overall 4.3% Unknown Primary source META-LLAMA4SCOUT
BR-009MUSESPARK-003 Muse Spark Humanity's Last Exam No tools Overall 39.9% Unknown Primary source META-MUSESPARK
BR-009MUSESPARK11-003 Muse Spark 1.1 Humanity's Last Exam No tools Overall 45.1% Unknown Primary source META-MS11
BR-010KIMIK2-003 Kimi K2 Humanity's Last Exam No tools Overall 7% Unknown Primary source KIMI-KIMIK2
BR-010KIMIK20905-003 Kimi K2 0905 Humanity's Last Exam No tools Overall 6.3% Unknown Primary source KIMI-KIMIK20905
BR-010KIMIK25-003 Kimi K2.5 Humanity's Last Exam No tools Overall 29.4% Unknown Primary source KIMI-KIMIK25
BR-010KIMIK25-016 Kimi K2.5 Humanity's Last Exam No tools Overall 12.3% Unknown Primary source KIMI-KIMIK25
BR-010KIMIK26-003 Kimi K2.6 Humanity's Last Exam No tools Overall 35.9% Unknown Primary source KIMI-KIMIK26
BR-010KIMIK26-020 Kimi K2.6 Humanity's Last Exam No tools Overall 18.2% Unknown Primary source KIMI-KIMIK26
BR-010KIMIK27CODE-003 Kimi K2.7 Code Humanity's Last Exam No tools Overall 32.8% Unknown Primary source KIMI-KIMIK27CODE
BR-010KIMIK2THINKING-003 Kimi K2 Thinking Humanity's Last Exam No tools Overall 22.3% Unknown Primary source KIMI-KIMIK2THINKING
BR-010KIMILINEAR48BA3BINSTRUCT-003 Kimi Linear 48B A3B Instruct Humanity's Last Exam No tools Overall 2.7% Unknown Primary source KIMI-KIMILINEAR48BA3BINSTRUCT
BR-01145-003 GLM-4.5 Humanity's Last Exam No tools Overall 12.2% Unknown Primary source GLM-45
BR-01146-003 GLM-4.6 Humanity's Last Exam No tools Overall 13.3% Unknown Primary source GLM-46
BR-01146-017 GLM-4.6 Humanity's Last Exam No tools Overall 5.2% Unknown Primary source GLM-46
BR-01147-003 GLM-4.7 Humanity's Last Exam No tools Overall 25.1% Unknown Primary source GLM-47
BR-01147-017 GLM-4.7 Humanity's Last Exam No tools Overall 6.1% Unknown Primary source GLM-47
BR-0115-003 GLM-5 Humanity's Last Exam No tools Overall 27.2% Unknown Primary source GLM-5
BR-0115-015 GLM-5 Humanity's Last Exam No tools Overall 7.2% Unknown Primary source GLM-5
BR-01151-003 GLM-5.1 Humanity's Last Exam No tools Overall 28% Unknown Primary source GLM-51
BR-01151-018 GLM-5.1 Humanity's Last Exam No tools Overall 25.6% Unknown Primary source GLM-51
BR-01152-002 GLM-5.2 Humanity's Last Exam Overall 40.5 Unknown Primary source GLM-52
BR-01152-003 GLM-5.2 Humanity's Last Exam With tools Overall 54.7 Unknown Primary source GLM-52
BR-011GLM45AIR-003 GLM-4.5-Air Humanity's Last Exam No tools Overall 6.8% Unknown Primary source GLM-GLM45AIR
BR-011GLM45V-003 GLM-4.5V Humanity's Last Exam No tools Overall 3.6% Unknown Primary source GLM-GLM45V
BR-011GLM45V-015 GLM-4.5V Humanity's Last Exam No tools Overall 5.9% Unknown Primary source GLM-GLM45V
BR-011GLM46V-003 GLM-4.6V Humanity's Last Exam No tools Overall 3.7% Unknown Primary source GLM-GLM46V
BR-011GLM46V-015 GLM-4.6V Humanity's Last Exam No tools Overall 8.9% Unknown Primary source GLM-GLM46V
BR-011GLM47FLASH-003 GLM-4.7-Flash Humanity's Last Exam No tools Overall 7.1% Unknown Primary source GLM-GLM47FLASH
BR-011GLM47FLASH-014 GLM-4.7-Flash Humanity's Last Exam No tools Overall 4.9% Unknown Primary source GLM-GLM47FLASH
BR-011GLM5TURBO-003 GLM-5-Turbo Humanity's Last Exam No tools Overall 25.4% Unknown Primary source GLM-GLM5TURBO
BR-011GLM5VTURBO-003 GLM 5V Turbo Humanity's Last Exam No tools Overall 15.8% Unknown Primary source GLM-GLM5VTURBO
BR-012MINIMAXM140K-003 MiniMax M1 40k Humanity's Last Exam No tools Overall 7.5% Unknown Primary source MMAX-MINIMAXM140K
BR-012MINIMAXM180K-003 MiniMax M1 80k Humanity's Last Exam No tools Overall 8.2% Unknown Primary source MMAX-MINIMAXM180K
BR-012MINIMAXM2-003 MiniMax-M2 Humanity's Last Exam No tools Overall 12.5% Unknown Primary source MMAX-MINIMAXM2
BR-012MINIMAXM21-003 MiniMax-M2.1 Humanity's Last Exam No tools Overall 22.2% Unknown Primary source MMAX-MINIMAXM21
BR-012MINIMAXM25-003 MiniMax-M2.5 Humanity's Last Exam No tools Overall 19.1% Unknown Primary source MMAX-MINIMAXM25
BR-012MINIMAXM27-003 MiniMax-M2.7 Humanity's Last Exam No tools Overall 28.1% Unknown Primary source MMAX-MINIMAXM27
BR-012MINIMAXM3-003 MiniMax-M3 Humanity's Last Exam No tools Overall 37.1% Unknown Primary source MMAX-M3
BR-013LG3-003 Mistral Large 3 Humanity's Last Exam No tools Overall 4.1% Unknown Primary source MSTRL-LG3
BR-013SM3-003 Mistral Small 3 Humanity's Last Exam No tools Overall 4.1% Unknown Primary source MSTRL-SM3
BR-013SM31-003 Mistral Small 3.1 Humanity's Last Exam No tools Overall 4.8% Unknown Primary source MSTRL-SM31
BR-013SM32-003 Mistral Small 3.2 Humanity's Last Exam No tools Overall 4.3% Unknown Primary source MSTRL-SM32
BR-013SM4-003 Mistral Small 4 Humanity's Last Exam No tools Overall 3.7% Unknown Primary source MSTRL-SM4
BR-013SM4-014 Mistral Small 4 Humanity's Last Exam No tools Overall 9.5% Unknown Primary source MSTRL-SM4
BR-014COMMANDA-003 Command A Humanity's Last Exam No tools Overall 4.6% Unknown Primary source COHR-COMMANDA
BR-014COMMANDAPLUS-003 Command A+ Humanity's Last Exam No tools Overall 11.4% Unknown Primary source COHR-APLUS
BR-014COMMANDRMAR24-003 Command-R (Mar '24) Humanity's Last Exam No tools Overall 4.8% Unknown Primary source COHR-COMMANDRMAR24
BR-014COMMANDRPLUSAPR24-003 Command-R+ (Apr '24) Humanity's Last Exam No tools Overall 4.5% Unknown Primary source COHR-COMMANDRPLUSAPR24
BR-014NORTHMINICODE-003 North Mini Code Humanity's Last Exam No tools Overall 9.9% Unknown Primary source COHR-NORTHMINICODE
BR-014TINYAYAGLOBAL-003 Tiny Aya Global Humanity's Last Exam No tools Overall 5.2% Unknown Primary source COHR-TINYAYAGLOBAL
BR-015LLAMA31NEMOTRONINSTRUCT70B-003 Llama 3.1 Nemotron Instruct 70B Humanity's Last Exam No tools Overall 4.6% Unknown Primary source NVDA-LLAMA31NEMOTRONINSTRUCT70B
BR-015LLAMA31NEMOTRONNANO4BV11-003 Llama 3.1 Nemotron Nano 4B v1.1 Humanity's Last Exam No tools Overall 5.1% Unknown Primary source NVDA-LLAMA31NEMOTRONNANO4BV11
BR-015LLAMA31NEMOTRONULTRA253BV1-003 Llama 3.1 Nemotron Ultra 253B v1 Humanity's Last Exam No tools Overall 8.1% Unknown Primary source NVDA-LLAMA31NEMOTRONULTRA253BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-003 Llama 3.3 Nemotron Super 49B v1 Humanity's Last Exam No tools Overall 6.5% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-014 Llama 3.3 Nemotron Super 49B v1 Humanity's Last Exam No tools Overall 3.5% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMANEMOTRONSUPER49BV15-003 Llama Nemotron Super 49B v1.5 Humanity's Last Exam No tools Overall 4.3% Unknown Primary source NVDA-LLAMANEMOTRONSUPER49BV15
BR-015LLAMANEMOTRONSUPER49BV15-014 Llama Nemotron Super 49B v1.5 Humanity's Last Exam No tools Overall 6.8% Unknown Primary source NVDA-LLAMANEMOTRONSUPER49BV15
BR-015NEMOTRON3NANOOMNI30BA3BREASONING-003 Nemotron 3 Nano Omni 30B A3B Reasoning Humanity's Last Exam No tools Overall 5.3% Unknown Primary source NVDA-NEMOTRON3NANOOMNI30BA3BREASONING
BR-015NEMOTRON3ULTRA550BA55B-003 Nemotron 3 Ultra 550B A55B Humanity's Last Exam No tools Overall 26.6% Unknown Primary source NVDA-NEMOTRON3ULTRA550BA55B
BR-015NEMOTRONCASCADE230BA3B-003 Nemotron Cascade 2 30B A3B Humanity's Last Exam No tools Overall 11.4% Unknown Primary source NVDA-NEMOTRONCASCADE230BA3B
BR-015NVIDIANEMOTRON3NANO30BA3B-003 NVIDIA Nemotron 3 Nano 30B A3B Humanity's Last Exam No tools Overall 4.6% Unknown Primary source NVDA-NVIDIANEMOTRON3NANO30BA3B
BR-015NVIDIANEMOTRON3NANO30BA3B-015 NVIDIA Nemotron 3 Nano 30B A3B Humanity's Last Exam No tools Overall 10.2% Unknown Primary source NVDA-NVIDIANEMOTRON3NANO30BA3B
BR-015NVIDIANEMOTRON3NANO4B-003 NVIDIA Nemotron 3 Nano 4B Humanity's Last Exam No tools Overall 4.8% Unknown Primary source NVDA-NVIDIANEMOTRON3NANO4B
BR-015NVIDIANEMOTRON3SUPER120BA12B-003 NVIDIA Nemotron 3 Super 120B A12B Humanity's Last Exam No tools Overall 19.2% Unknown Primary source NVDA-NVIDIANEMOTRON3SUPER120BA12B
BR-015NVIDIANEMOTRONNANO12BV2VL-003 NVIDIA Nemotron Nano 12B v2 VL Humanity's Last Exam No tools Overall 5.3% Unknown Primary source NVDA-NVIDIANEMOTRONNANO12BV2VL
BR-015NVIDIANEMOTRONNANO12BV2VL-015 NVIDIA Nemotron Nano 12B v2 VL Humanity's Last Exam No tools Overall 4.5% Unknown Primary source NVDA-NVIDIANEMOTRONNANO12BV2VL
BR-015NVIDIANEMOTRONNANO9BV2-003 NVIDIA Nemotron Nano 9B V2 Humanity's Last Exam No tools Overall 4% Unknown Primary source NVDA-NVIDIANEMOTRONNANO9BV2
BR-015NVIDIANEMOTRONNANO9BV2-014 NVIDIA Nemotron Nano 9B V2 Humanity's Last Exam No tools Overall 4.6% Unknown Primary source NVDA-NVIDIANEMOTRONNANO9BV2
BR-016NOVA20LITE-003 Nova 2.0 Lite Humanity's Last Exam No tools Overall 10.9% Unknown Primary source AMZN-NOVA20LITE
BR-016NOVA20LITE-018 Nova 2.0 Lite Humanity's Last Exam No tools Overall 4.2% Unknown Primary source AMZN-NOVA20LITE
BR-016NOVA20LITE-030 Nova 2.0 Lite Humanity's Last Exam No tools Overall 3% Unknown Primary source AMZN-NOVA20LITE
BR-016NOVA20LITE-042 Nova 2.0 Lite Humanity's Last Exam No tools Overall 8.6% Unknown Primary source AMZN-NOVA20LITE
BR-016NOVA20OMNI-003 Nova 2.0 Omni Humanity's Last Exam No tools Overall 6.8% Unknown Primary source AMZN-NOVA20OMNI
BR-016NOVA20OMNI-015 Nova 2.0 Omni Humanity's Last Exam No tools Overall 3.9% Unknown Primary source AMZN-NOVA20OMNI
BR-016NOVA20OMNI-027 Nova 2.0 Omni Humanity's Last Exam No tools Overall 4% Unknown Primary source AMZN-NOVA20OMNI
BR-016NOVA20PROPREVIEW-003 Nova 2.0 Pro Preview Humanity's Last Exam No tools Overall 8.9% Unknown Primary source AMZN-NOVA20PROPREVIEW
BR-016NOVA20PROPREVIEW-018 Nova 2.0 Pro Preview Humanity's Last Exam No tools Overall 4% Unknown Primary source AMZN-NOVA20PROPREVIEW
BR-016NOVA20PROPREVIEW-032 Nova 2.0 Pro Preview Humanity's Last Exam No tools Overall 5.2% Unknown Primary source AMZN-NOVA20PROPREVIEW
BR-016NOVALITE-003 Nova Lite Humanity's Last Exam No tools Overall 4.6% Unknown Primary source AMZN-NOVALITE
BR-016NOVAMICRO-003 Nova Micro Humanity's Last Exam No tools Overall 4.7% Unknown Primary source AMZN-NOVAMICRO
BR-016NOVAPREMIER-003 Nova Premier Humanity's Last Exam No tools Overall 4.7% Unknown Primary source AMZN-NOVAPREMIER
BR-016NOVAPRO-003 Nova Pro Humanity's Last Exam No tools Overall 3.4% Unknown Primary source AMZN-NOVAPRO
BR-017GRANITE338B-003 Granite 3.3 8B Humanity's Last Exam No tools Overall 4.2% Unknown Primary source IBM-GRANITE338B
BR-017GRANITE401B-003 Granite 4.0 1B Humanity's Last Exam No tools Overall 5.1% Unknown Primary source IBM-GRANITE401B
BR-017GRANITE40350M-003 Granite 4.0 350M Humanity's Last Exam No tools Overall 5.7% Unknown Primary source IBM-GRANITE40350M
BR-017GRANITE40H1B-003 Granite 4.0 H 1B Humanity's Last Exam No tools Overall 5% Unknown Primary source IBM-GRANITE40H1B
BR-017GRANITE40H350M-003 Granite 4.0 H 350M Humanity's Last Exam No tools Overall 6.4% Unknown Primary source IBM-GRANITE40H350M
BR-017GRANITE40HSMALL-003 Granite 4.0 H Small Humanity's Last Exam No tools Overall 3.7% Unknown Primary source IBM-GRANITE40HSMALL
BR-017GRANITE40MICRO-003 Granite 4.0 Micro Humanity's Last Exam No tools Overall 5.1% Unknown Primary source IBM-GRANITE40MICRO
BR-017GRANITE4130B-003 Granite 4.1 30B Humanity's Last Exam No tools Overall 4.2% Unknown Primary source IBM-GRANITE4130B
BR-017GRANITE413B-003 Granite 4.1 3B Humanity's Last Exam No tools Overall 3.4% Unknown Primary source IBM-GRANITE413B
BR-017GRANITE418B-003 Granite 4.1 8B Humanity's Last Exam No tools Overall 3.8% Unknown Primary source IBM-GRANITE418B
BR-018LLAMA31TULU3405B-003 Llama 3.1 Tulu3 405B Humanity's Last Exam No tools Overall 3.5% Unknown Primary source AI2-LLAMA31TULU3405B
BR-018MOLMO28B-003 Molmo2-8B Humanity's Last Exam No tools Overall 4.4% Unknown Primary source AI2-MOLMO28B
BR-018MOLMO7BD-003 Molmo 7B-D Humanity's Last Exam No tools Overall 5.1% Unknown Primary source AI2-MOLMO7BD