BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database
Search operators

brand: benchmark: record: model: metric: date: org:

Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA

Humanity's Last Exam

Benchmark Family
Humanity's Last Exam
Organization
Center for AI Safety
Status
ACTIVE

Versions / Variants

Version or VariantReferenceStatusRecords
Unspecifiedhumanitys-last-exam/defaultACTIVE5
No toolshumanitys-last-exam/no-toolsACTIVE397
With toolshumanitys-last-exam/with-toolsACTIVE9

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-007QWEN330BA3B-014 Qwen3 30B A3B Humanity's Last Exam No tools Overall 4.6% Unknown Primary source QWEN-QWEN330BA3B
BR-007QWEN330BA3B2507-003 Qwen3 30B A3B 2507 Humanity's Last Exam No tools Overall 9.8% Unknown Primary source QWEN-QWEN330BA3B2507
BR-007QWEN330BA3B2507INSTRUCT-003 Qwen3 30B A3B 2507 Instruct Humanity's Last Exam No tools Overall 6.8% Unknown Primary source QWEN-QWEN330BA3B2507INSTRUCT
BR-007QWEN332B-003 Qwen3 32B Humanity's Last Exam No tools Overall 8.3% Unknown Primary source QWEN-QWEN332B
BR-007QWEN332B-017 Qwen3 32B Humanity's Last Exam No tools Overall 4.3% Unknown Primary source QWEN-QWEN332B
BR-007QWEN34B-003 Qwen3 4B Humanity's Last Exam No tools Overall 5.1% Unknown Primary source QWEN-QWEN34B
BR-007QWEN34B-010 Qwen3 4B Humanity's Last Exam No tools Overall 3.7% Unknown Primary source QWEN-QWEN34B
BR-007QWEN34B2507-003 Qwen3 4B 2507 Humanity's Last Exam No tools Overall 5.9% Unknown Primary source QWEN-QWEN34B2507
BR-007QWEN34B2507INSTRUCT-003 Qwen3 4B 2507 Instruct Humanity's Last Exam No tools Overall 4.7% Unknown Primary source QWEN-QWEN34B2507INSTRUCT
BR-007QWEN3508B-003 Qwen3.5 0.8B Humanity's Last Exam No tools Overall 4.9% Unknown Primary source QWEN-QWEN3508B
BR-007QWEN3508B-017 Qwen3.5 0.8B Humanity's Last Exam No tools Overall 1.2% Unknown Primary source QWEN-QWEN3508B
BR-007QWEN35122BA10B-003 Qwen3.5 122B A10B Humanity's Last Exam No tools Overall 14.8% Unknown Primary source QWEN-QWEN35122BA10B
BR-007QWEN35122BA10B-018 Qwen3.5 122B A10B Humanity's Last Exam No tools Overall 23.4% Unknown Primary source QWEN-QWEN35122BA10B
BR-007QWEN3527B-003 Qwen3.5 27B Humanity's Last Exam No tools Overall 22.2% Unknown Primary source QWEN-QWEN3527B
BR-007QWEN3527B-016 Qwen3.5 27B Humanity's Last Exam No tools Overall 13.2% Unknown Primary source QWEN-QWEN3527B
BR-007QWEN352B-003 Qwen3.5 2B Humanity's Last Exam No tools Overall 4.9% Unknown Primary source QWEN-QWEN352B
BR-007QWEN352B-018 Qwen3.5 2B Humanity's Last Exam No tools Overall 2.1% Unknown Primary source QWEN-QWEN352B
BR-007QWEN3535BA3B-003 Qwen3.5 35B A3B Humanity's Last Exam No tools Overall 19.7% Unknown Primary source QWEN-QWEN3535BA3B
BR-007QWEN3535BA3B-016 Qwen3.5 35B A3B Humanity's Last Exam No tools Overall 12.8% Unknown Primary source QWEN-QWEN3535BA3B
BR-007QWEN35397BA17B-003 Qwen3.5 397B A17B Humanity's Last Exam No tools Overall 27.3% Unknown Primary source QWEN-QWEN35397BA17B
BR-007QWEN35397BA17B-020 Qwen3.5 397B A17B Humanity's Last Exam No tools Overall 18.8% Unknown Primary source QWEN-QWEN35397BA17B
BR-007QWEN354B-003 Qwen3.5 4B Humanity's Last Exam No tools Overall 7.5% Unknown Primary source QWEN-QWEN354B
BR-007QWEN354B-017 Qwen3.5 4B Humanity's Last Exam No tools Overall 7.8% Unknown Primary source QWEN-QWEN354B
BR-007QWEN359B-003 Qwen3.5 9B Humanity's Last Exam No tools Overall 8.6% Unknown Primary source QWEN-QWEN359B
BR-007QWEN359B-017 Qwen3.5 9B Humanity's Last Exam No tools Overall 13.3% Unknown Primary source QWEN-QWEN359B
BR-007QWEN35OMNIFLASH-003 Qwen3.5 Omni Flash Humanity's Last Exam No tools Overall 7.1% Unknown Primary source QWEN-QWEN35OMNIFLASH
BR-007QWEN35OMNIPLUS-003 Qwen3.5 Omni Plus Humanity's Last Exam No tools Overall 13.9% Unknown Primary source QWEN-QWEN35OMNIPLUS
BR-007QWEN3627B-003 Qwen3.6 27B Humanity's Last Exam No tools Overall 13.6% Unknown Primary source QWEN-QWEN3627B
BR-007QWEN3627B-018 Qwen3.6 27B Humanity's Last Exam No tools Overall 21.6% Unknown Primary source QWEN-QWEN3627B
BR-007QWEN3635BA3B-003 Qwen3.6 35B A3B Humanity's Last Exam No tools Overall 12.5% Unknown Primary source QWEN-QWEN3635BA3B
BR-007QWEN3635BA3B-016 Qwen3.6 35B A3B Humanity's Last Exam No tools Overall 20.2% Unknown Primary source QWEN-QWEN3635BA3B
BR-007QWEN36MAXPREVIEW-003 Qwen3.6 Max Preview Humanity's Last Exam No tools Overall 28.9% Unknown Primary source QWEN-QWEN36MAXPREVIEW
BR-007QWEN36PLUS-003 Qwen3.6 Plus Humanity's Last Exam No tools Overall 25.7% Unknown Primary source QWEN-QWEN36PLUS
BR-007QWEN37MAX-003 Qwen3.7 Max Humanity's Last Exam No tools Overall 38.1% Unknown Primary source QWEN-QWEN37MAX
BR-007QWEN37PLUS-003 Qwen3.7 Plus Humanity's Last Exam No tools Overall 33.4% Unknown Primary source QWEN-QWEN37PLUS
BR-007QWEN38B-003 Qwen3 8B Humanity's Last Exam No tools Overall 4.2% Unknown Primary source QWEN-QWEN38B
BR-007QWEN38B-017 Qwen3 8B Humanity's Last Exam No tools Overall 2.8% Unknown Primary source QWEN-QWEN38B
BR-007QWEN3CODER30BA3BINSTRUCT-003 Qwen3 Coder 30B A3B Instruct Humanity's Last Exam No tools Overall 4% Unknown Primary source QWEN-QWEN3CODER30BA3BINSTRUCT
BR-007QWEN3CODER480BA35BINSTRUCT-003 Qwen3 Coder 480B A35B Instruct Humanity's Last Exam No tools Overall 4.4% Unknown Primary source QWEN-QWEN3CODER480BA35BINSTRUCT
BR-007QWEN3CODERNEXT-003 Qwen3 Coder Next Humanity's Last Exam No tools Overall 9.3% Unknown Primary source QWEN-QWEN3CODERNEXT
BR-007QWEN3MAX-003 Qwen3 Max Humanity's Last Exam No tools Overall 11.1% Unknown Primary source QWEN-QWEN3MAX
BR-007QWEN3MAXPREVIEW-003 Qwen3 Max (Preview) Humanity's Last Exam No tools Overall 9.3% Unknown Primary source QWEN-QWEN3MAXPREVIEW
BR-007QWEN3MAXTHINKING-003 Qwen3 Max Thinking Humanity's Last Exam No tools Overall 26.2% Unknown Primary source QWEN-QWEN3MAXTHINKING
BR-007QWEN3MAXTHINKINGPREVIEW-003 Qwen3 Max Thinking (Preview) Humanity's Last Exam No tools Overall 12% Unknown Primary source QWEN-QWEN3MAXTHINKINGPREVIEW
BR-007QWEN3NEXT80BA3B-003 Qwen3 Next 80B A3B Humanity's Last Exam No tools Overall 11.7% Unknown Primary source QWEN-QWEN3NEXT80BA3B
BR-007QWEN3NEXT80BA3BINSTRUCT-003 Qwen3 Next 80B A3B Instruct Humanity's Last Exam No tools Overall 7.3% Unknown Primary source QWEN-QWEN3NEXT80BA3BINSTRUCT
BR-007QWEN3OMNI30BA3B-003 Qwen3 Omni 30B A3B Humanity's Last Exam No tools Overall 7.3% Unknown Primary source QWEN-QWEN3OMNI30BA3B
BR-007QWEN3OMNI30BA3BINSTRUCT-003 Qwen3 Omni 30B A3B Instruct Humanity's Last Exam No tools Overall 5.1% Unknown Primary source QWEN-QWEN3OMNI30BA3BINSTRUCT
BR-007QWEN3VL235BA22B-003 Qwen3 VL 235B A22B Humanity's Last Exam No tools Overall 10.1% Unknown Primary source QWEN-QWEN3VL235BA22B
BR-007QWEN3VL235BA22BINSTRUCT-003 Qwen3 VL 235B A22B Instruct Humanity's Last Exam No tools Overall 6.3% Unknown Primary source QWEN-QWEN3VL235BA22BINSTRUCT
BR-007QWEN3VL30BA3B-003 Qwen3 VL 30B A3B Humanity's Last Exam No tools Overall 8.7% Unknown Primary source QWEN-QWEN3VL30BA3B
BR-007QWEN3VL30BA3BINSTRUCT-003 Qwen3 VL 30B A3B Instruct Humanity's Last Exam No tools Overall 6.4% Unknown Primary source QWEN-QWEN3VL30BA3BINSTRUCT
BR-007QWEN3VL32B-003 Qwen3 VL 32B Humanity's Last Exam No tools Overall 9.6% Unknown Primary source QWEN-QWEN3VL32B
BR-007QWEN3VL32BINSTRUCT-003 Qwen3 VL 32B Instruct Humanity's Last Exam No tools Overall 6.3% Unknown Primary source QWEN-QWEN3VL32BINSTRUCT
BR-007QWEN3VL4B-003 Qwen3 VL 4B Humanity's Last Exam No tools Overall 4.4% Unknown Primary source QWEN-QWEN3VL4B
BR-007QWEN3VL4BINSTRUCT-003 Qwen3 VL 4B Instruct Humanity's Last Exam No tools Overall 3.7% Unknown Primary source QWEN-QWEN3VL4BINSTRUCT
BR-007QWEN3VL8B-003 Qwen3 VL 8B Humanity's Last Exam No tools Overall 3.3% Unknown Primary source QWEN-QWEN3VL8B
BR-007QWEN3VL8BINSTRUCT-003 Qwen3 VL 8B Instruct Humanity's Last Exam No tools Overall 2.9% Unknown Primary source QWEN-QWEN3VL8BINSTRUCT
BR-007QWQ32B-003 QwQ 32B Humanity's Last Exam No tools Overall 8.2% Unknown Primary source QWEN-QWQ32B
BR-007QWQ32BPREVIEW-003 QwQ 32B-Preview Humanity's Last Exam No tools Overall 4.8% Unknown Primary source QWEN-QWQ32BPREVIEW
BR-008DEEPSEEKCODERV2LITEINSTRUCT-003 DeepSeek Coder V2 Lite Instruct Humanity's Last Exam No tools Overall 5.3% Unknown Primary source DPSK-DEEPSEEKCODERV2LITEINSTRUCT
BR-008DEEPSEEKR10528MAY25-003 DeepSeek R1 0528 (May '25) Humanity's Last Exam No tools Overall 14.9% Unknown Primary source DPSK-DEEPSEEKR10528MAY25
BR-008DEEPSEEKR10528QWEN38B-003 DeepSeek R1 0528 Qwen3 8B Humanity's Last Exam No tools Overall 5.6% Unknown Primary source DPSK-DEEPSEEKR10528QWEN38B
BR-008DEEPSEEKR1DISTILLLLAMA70B-003 DeepSeek R1 Distill Llama 70B Humanity's Last Exam No tools Overall 6.1% Unknown Primary source DPSK-DEEPSEEKR1DISTILLLLAMA70B
BR-008DEEPSEEKR1DISTILLLLAMA8B-003 DeepSeek R1 Distill Llama 8B Humanity's Last Exam No tools Overall 4.2% Unknown Primary source DPSK-DEEPSEEKR1DISTILLLLAMA8B
BR-008DEEPSEEKR1DISTILLQWEN14B-003 DeepSeek R1 Distill Qwen 14B Humanity's Last Exam No tools Overall 4.4% Unknown Primary source DPSK-DEEPSEEKR1DISTILLQWEN14B
BR-008DEEPSEEKR1DISTILLQWEN15B-003 DeepSeek R1 Distill Qwen 1.5B Humanity's Last Exam No tools Overall 3.3% Unknown Primary source DPSK-DEEPSEEKR1DISTILLQWEN15B
BR-008DEEPSEEKR1DISTILLQWEN32B-003 DeepSeek R1 Distill Qwen 32B Humanity's Last Exam No tools Overall 5.5% Unknown Primary source DPSK-DEEPSEEKR1DISTILLQWEN32B
BR-008DEEPSEEKR1JAN25-003 DeepSeek R1 (Jan '25) Humanity's Last Exam No tools Overall 9.3% Unknown Primary source DPSK-DEEPSEEKR1JAN25
BR-008DEEPSEEKV30324-003 DeepSeek V3 0324 Humanity's Last Exam No tools Overall 5.2% Unknown Primary source DPSK-DEEPSEEKV30324
BR-008DEEPSEEKV31-003 DeepSeek V3.1 Humanity's Last Exam No tools Overall 13% Unknown Primary source DPSK-DEEPSEEKV31
BR-008DEEPSEEKV31-014 DeepSeek V3.1 Humanity's Last Exam No tools Overall 6.3% Unknown Primary source DPSK-DEEPSEEKV31
BR-008DEEPSEEKV31TERMINUS-003 DeepSeek V3.1 Terminus Humanity's Last Exam No tools Overall 15.2% Unknown Primary source DPSK-DEEPSEEKV31TERMINUS
BR-008DEEPSEEKV31TERMINUS-017 DeepSeek V3.1 Terminus Humanity's Last Exam No tools Overall 8.4% Unknown Primary source DPSK-DEEPSEEKV31TERMINUS
BR-008DEEPSEEKV32-003 DeepSeek V3.2 Humanity's Last Exam No tools Overall 10.5% Unknown Primary source DPSK-DEEPSEEKV32
BR-008DEEPSEEKV32-014 DeepSeek V3.2 Humanity's Last Exam No tools Overall 22.2% Unknown Primary source DPSK-DEEPSEEKV32
BR-008DEEPSEEKV32EXP-003 DeepSeek V3.2 Exp Humanity's Last Exam No tools Overall 8.6% Unknown Primary source DPSK-DEEPSEEKV32EXP
BR-008DEEPSEEKV32EXP-014 DeepSeek V3.2 Exp Humanity's Last Exam No tools Overall 13.8% Unknown Primary source DPSK-DEEPSEEKV32EXP
BR-008DEEPSEEKV32SPECIALE-003 DeepSeek V3.2 Speciale Humanity's Last Exam No tools Overall 26.1% Unknown Primary source DPSK-DEEPSEEKV32SPECIALE
BR-008DEEPSEEKV3DEC24-003 DeepSeek V3 (Dec '24) Humanity's Last Exam No tools Overall 3.6% Unknown Primary source DPSK-DEEPSEEKV3DEC24
BR-008DEEPSEEKV4FLASH-003 DeepSeek V4 Flash Humanity's Last Exam No tools Overall 27.8% Unknown Primary source DPSK-DEEPSEEKV4FLASH
BR-008DEEPSEEKV4FLASH-014 DeepSeek V4 Flash Humanity's Last Exam No tools Overall 7% Unknown Primary source DPSK-DEEPSEEKV4FLASH
BR-008DEEPSEEKV4FLASH-025 DeepSeek V4 Flash Humanity's Last Exam No tools Overall 32.1% Unknown Primary source DPSK-DEEPSEEKV4FLASH
BR-008DEEPSEEKV4PRO-003 DeepSeek V4 Pro Humanity's Last Exam No tools Overall 33.5% Unknown Primary source DPSK-DEEPSEEKV4PRO
BR-008DEEPSEEKV4PRO-015 DeepSeek V4 Pro Humanity's Last Exam No tools Overall 7.7% Unknown Primary source DPSK-DEEPSEEKV4PRO
BR-008DEEPSEEKV4PRO-026 DeepSeek V4 Pro Humanity's Last Exam No tools Overall 35.9% Unknown Primary source DPSK-DEEPSEEKV4PRO
BR-008V4FLASH-005 DeepSeek V4-Flash Humanity's Last Exam Pass@1 34.8 Unknown Primary source DPSK-V4FLASH
BR-008V4FLASH-019 DeepSeek V4-Flash Humanity's Last Exam With tools Pass@1 45.1 Unknown Primary source DPSK-V4FLASH
BR-008V4PRO-005 DeepSeek V4-Pro Humanity's Last Exam Pass@1 37.7 Unknown Primary source DPSK-V4PRO
BR-008V4PRO-019 DeepSeek V4-Pro Humanity's Last Exam With tools Pass@1 48.2 Unknown Primary source DPSK-V4PRO
BR-009LLAMA2CHAT13B-003 Llama 2 Chat 13B Humanity's Last Exam No tools Overall 4.7% Unknown Primary source META-LLAMA2CHAT13B
BR-009LLAMA2CHAT70B-003 Llama 2 Chat 70B Humanity's Last Exam No tools Overall 5% Unknown Primary source META-LLAMA2CHAT70B
BR-009LLAMA2CHAT7B-003 Llama 2 Chat 7B Humanity's Last Exam No tools Overall 5.8% Unknown Primary source META-LLAMA2CHAT7B
BR-009LLAMA31INSTRUCT405B-003 Llama 3.1 Instruct 405B Humanity's Last Exam No tools Overall 4.2% Unknown Primary source META-LLAMA31INSTRUCT405B
BR-009LLAMA31INSTRUCT70B-003 Llama 3.1 Instruct 70B Humanity's Last Exam No tools Overall 4.6% Unknown Primary source META-LLAMA31INSTRUCT70B
BR-009LLAMA31INSTRUCT8B-003 Llama 3.1 Instruct 8B Humanity's Last Exam No tools Overall 5.1% Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA32INSTRUCT11BVISION-003 Llama 3.2 Instruct 11B (Vision) Humanity's Last Exam No tools Overall 5.2% Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT1B-003 Llama 3.2 Instruct 1B Humanity's Last Exam No tools Overall 5.3% Unknown Primary source META-LLAMA32INSTRUCT1B
BR-009LLAMA32INSTRUCT3B-003 Llama 3.2 Instruct 3B Humanity's Last Exam No tools Overall 5.2% Unknown Primary source META-LLAMA32INSTRUCT3B
BR-009LLAMA32INSTRUCT90BVISION-003 Llama 3.2 Instruct 90B (Vision) Humanity's Last Exam No tools Overall 4.9% Unknown Primary source META-LLAMA32INSTRUCT90BVISION