BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database

Humanity's Last Exam

Benchmark Family
Humanity's Last Exam
Organization
Center for AI Safety
Status
ACTIVE

Versions / Variants

Version or VariantReferenceStatusRecords
Unspecifiedhumanitys-last-exam/defaultACTIVE5
No toolshumanitys-last-exam/no-toolsACTIVE397
With toolshumanitys-last-exam/with-toolsACTIVE9

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-00141-003 GPT-4.1 Humanity's Last Exam No tools Overall 4.6% Unknown Primary source OPNAI-41
BR-0015-003 GPT-5 Humanity's Last Exam No tools Overall 26.5% Unknown Primary source OPNAI-5
BR-0015-018 GPT-5 Humanity's Last Exam No tools Overall 23.5% Unknown Primary source OPNAI-5
BR-0015-030 GPT-5 Humanity's Last Exam No tools Overall 18.4% Unknown Primary source OPNAI-5
BR-0015-042 GPT-5 Humanity's Last Exam No tools Overall 5.4% Unknown Primary source OPNAI-5
BR-00151-003 GPT-5.1 Humanity's Last Exam No tools Overall 26.5% Unknown Primary source OPNAI-51
BR-00151-018 GPT-5.1 Humanity's Last Exam No tools Overall 5.2% Unknown Primary source OPNAI-51
BR-00152-003 GPT-5.2 Humanity's Last Exam No tools Overall 35.4% Unknown Primary source OPNAI-52
BR-00152-014 GPT-5.2 Humanity's Last Exam No tools Overall 7.3% Unknown Primary source OPNAI-52
BR-00152-027 GPT-5.2 Humanity's Last Exam No tools Overall 24.9% Unknown Primary source OPNAI-52
BR-00154-004 GPT-5.4 Humanity's Last Exam No tools Overall 10.6% Unknown Primary source OPNAI-54
BR-00154-016 GPT-5.4 Humanity's Last Exam No tools Overall 28.9% Unknown Primary source OPNAI-54
BR-00154-028 GPT-5.4 Humanity's Last Exam No tools Overall 41.6% Unknown Primary source OPNAI-54
BR-00155-004 GPT-5.5 Humanity's Last Exam No tools Overall 41.4 Unknown Primary source OPNAI-55
BR-00155-005 GPT-5.5 Humanity's Last Exam With tools Overall 52.2 Unknown Primary source OPNAI-55
BR-00156LN-004 GPT-5.6 Luna Humanity's Last Exam No tools Overall 18.8% Unknown Primary source OPNAI-56LN
BR-00156LN-015 GPT-5.6 Luna Humanity's Last Exam No tools Overall 37.2% Unknown Primary source OPNAI-56LN
BR-00156LN-027 GPT-5.6 Luna Humanity's Last Exam No tools Overall 24.5% Unknown Primary source OPNAI-56LN
BR-00156LN-038 GPT-5.6 Luna Humanity's Last Exam No tools Overall 35.6% Unknown Primary source OPNAI-56LN
BR-00156LN-049 GPT-5.6 Luna Humanity's Last Exam No tools Overall 31.6% Unknown Primary source OPNAI-56LN
BR-00156LN-060 GPT-5.6 Luna Humanity's Last Exam No tools Overall 6.7% Unknown Primary source OPNAI-56LN
BR-00156SL-004 GPT-5.6 Sol Humanity's Last Exam No tools Overall 36.6% Unknown Primary source OPNAI-56SL
BR-00156SL-018 GPT-5.6 Sol Humanity's Last Exam No tools Overall 39.7% Unknown Primary source OPNAI-56SL
BR-00156SL-032 GPT-5.6 Sol Humanity's Last Exam No tools Overall 15.8% Unknown Primary source OPNAI-56SL
BR-00156SL-043 GPT-5.6 Sol Humanity's Last Exam No tools Overall 44.1% Unknown Primary source OPNAI-56SL
BR-00156SL-057 GPT-5.6 Sol Humanity's Last Exam No tools Overall 47.2% Unknown Primary source OPNAI-56SL
BR-00156SL-072 GPT-5.6 Sol Humanity's Last Exam No tools Overall 44.7% Unknown Primary source OPNAI-56SL
BR-00156TR-004 GPT-5.6 Terra Humanity's Last Exam No tools Overall 31.6% Unknown Primary source OPNAI-56TR
BR-00156TR-017 GPT-5.6 Terra Humanity's Last Exam No tools Overall 36.7% Unknown Primary source OPNAI-56TR
BR-00156TR-031 GPT-5.6 Terra Humanity's Last Exam No tools Overall 11% Unknown Primary source OPNAI-56TR
BR-00156TR-042 GPT-5.6 Terra Humanity's Last Exam No tools Overall 40% Unknown Primary source OPNAI-56TR
BR-00156TR-056 GPT-5.6 Terra Humanity's Last Exam No tools Overall 41.8% Unknown Primary source OPNAI-56TR
BR-00156TR-071 GPT-5.6 Terra Humanity's Last Exam No tools Overall 27.4% Unknown Primary source OPNAI-56TR
BR-002FB5-004 Claude Fable 5 Humanity's Last Exam No tools Overall 53.3% Unknown Primary source ANTHR-FB5
BR-002H3-003 Claude 3 Haiku Humanity's Last Exam No tools Overall 3.9% Unknown Primary source ANTHR-H3
BR-002H35-003 Claude 3.5 Haiku Humanity's Last Exam No tools Overall 3.5% Unknown Primary source ANTHR-H35
BR-002H45-003 Claude 4.5 Haiku Humanity's Last Exam No tools Overall 9.7% Unknown Primary source ANTHR-H45
BR-002H45-019 Claude 4.5 Haiku Humanity's Last Exam No tools Overall 4.3% Unknown Primary source ANTHR-H45
BR-002O3-003 Claude 3 Opus Humanity's Last Exam No tools Overall 3.1% Unknown Primary source ANTHR-O3
BR-002O4-003 Claude 4 Opus Humanity's Last Exam No tools Overall 5.9% Unknown Primary source ANTHR-O4
BR-002O4-009 Claude 4 Opus Humanity's Last Exam No tools Overall 11.7% Unknown Primary source ANTHR-O4
BR-002O41-003 Claude 4.1 Opus Humanity's Last Exam No tools Overall 11.9% Unknown Primary source ANTHR-O41
BR-002O45-003 Claude Opus 4.5 Humanity's Last Exam No tools Overall 28.4% Unknown Primary source ANTHR-O45
BR-002O45-015 Claude Opus 4.5 Humanity's Last Exam No tools Overall 12.9% Unknown Primary source ANTHR-O45
BR-002O46-003 Claude Opus 4.6 Humanity's Last Exam No tools Overall 18.6% Unknown Primary source ANTHR-O46
BR-002O46-015 Claude Opus 4.6 Humanity's Last Exam No tools Overall 36.7% Unknown Primary source ANTHR-O46
BR-002O47-009 Claude Opus 4.7 Humanity's Last Exam No tools Overall 46.9% Unknown Primary source ANTHR-O47
BR-002O47-010 Claude Opus 4.7 Humanity's Last Exam With tools Overall 54.7% Unknown Primary source ANTHR-O47
BR-002O48-008 Claude Opus 4.8 Humanity's Last Exam No tools Overall 49.8 Unknown Primary source ANTHR-O48
BR-002O48-009 Claude Opus 4.8 Humanity's Last Exam With tools Overall 57.9 Unknown Primary source ANTHR-O48
BR-002S3-003 Claude 3 Sonnet Humanity's Last Exam No tools Overall 3.8% Unknown Primary source ANTHR-S3
BR-002S37-003 Claude 3.7 Sonnet Humanity's Last Exam No tools Overall 10.3% Unknown Primary source ANTHR-S37
BR-002S37-014 Claude 3.7 Sonnet Humanity's Last Exam No tools Overall 4.8% Unknown Primary source ANTHR-S37
BR-002S4-003 Claude 4 Sonnet Humanity's Last Exam No tools Overall 9.6% Unknown Primary source ANTHR-S4
BR-002S4-018 Claude 4 Sonnet Humanity's Last Exam No tools Overall 4% Unknown Primary source ANTHR-S4
BR-002S45-003 Claude 4.5 Sonnet Humanity's Last Exam No tools Overall 17.3% Unknown Primary source ANTHR-S45
BR-002S45-018 Claude 4.5 Sonnet Humanity's Last Exam No tools Overall 7.1% Unknown Primary source ANTHR-S45
BR-002S46-004 Claude Sonnet 4.6 Humanity's Last Exam No tools Overall 13.2% Unknown Primary source ANTHR-S46
BR-002S46-016 Claude Sonnet 4.6 Humanity's Last Exam No tools Overall 30% Unknown Primary source ANTHR-S46
BR-002S46-033 Claude Sonnet 4.6 Humanity's Last Exam No tools Overall 10.8% Unknown Primary source ANTHR-S46
BR-002S5-005 Claude Sonnet 5 Humanity's Last Exam No tools Overall 39.6% Unknown Primary source ANTHR-S5
BR-002S5-018 Claude Sonnet 5 Humanity's Last Exam No tools Overall 17.8% Unknown Primary source ANTHR-S5
BR-00310P-003 Gemini 1.0 Pro Humanity's Last Exam No tools Overall 4.6% Unknown Primary source GOOGL-G10P
BR-00325F-003 Gemini 2.5 Flash Humanity's Last Exam No tools Overall 11.1% Unknown Primary source GOOGL-G25F
BR-00325F-015 Gemini 2.5 Flash Humanity's Last Exam No tools Overall 5.1% Unknown Primary source GOOGL-G25F
BR-00325P-003 Gemini 2.5 Pro Humanity's Last Exam No tools Overall 21.1% Unknown Primary source GOOGL-G25P
BR-00331P-005 Gemini 3.1 Pro Humanity's Last Exam No tools Overall 44.4% Unknown Primary source GOOGL-G31P
BR-00331P-006 Gemini 3.1 Pro Humanity's Last Exam With tools Overall 51.4% Unknown Primary source GOOGL-G31P
BR-00335F-005 Gemini 3.5 Flash Humanity's Last Exam No tools Overall 41% Unknown Primary source GOOGL-G35F
BR-00335F-020 Gemini 3.5 Flash Humanity's Last Exam No tools Overall 23.1% Unknown Primary source GOOGL-G35F
BR-00335F-030 Gemini 3.5 Flash Humanity's Last Exam No tools Overall 39.9% Unknown Primary source GOOGL-G35F
BR-0043-003 Grok 3 Humanity's Last Exam No tools Overall 5.1% Unknown Primary source XAI-G3
BR-0044-003 Grok 4 Humanity's Last Exam No tools Overall 23.9% Unknown Primary source XAI-G4
BR-00443-003 Grok 4.3 Humanity's Last Exam No tools Overall 28.1% Unknown Primary source XAI-G43
BR-00443-015 Grok 4.3 Humanity's Last Exam No tools Overall 6.5% Unknown Primary source XAI-G43
BR-00443-030 Grok 4.3 Humanity's Last Exam No tools Overall 35% Unknown Primary source XAI-G43
BR-00443-047 Grok 4.3 Humanity's Last Exam No tools Overall 17.3% Unknown Primary source XAI-G43
BR-00445-004 Grok 4.5 Humanity's Last Exam No tools Overall 40.3% Unknown Primary source XAI-G45
BR-00735-008 Qwen3.5-397B-A17B Humanity's Last Exam Overall 28.7 Unknown Primary source QWEN-35
BR-00735-021 Qwen3.5-397B-A17B Humanity's Last Exam With tools Overall 48.3 Unknown Primary source QWEN-35
BR-00737-001 Qwen3.7-Max Humanity's Last Exam Overall 41.4 Unknown Primary source QWEN-37
BR-00737-002 Qwen3.7-Max Humanity's Last Exam With tools Overall 53.5 Unknown Primary source QWEN-37
BR-007QWEN25CODERINSTRUCT32B-003 Qwen2.5 Coder Instruct 32B Humanity's Last Exam No tools Overall 3.8% Unknown Primary source QWEN-QWEN25CODERINSTRUCT32B
BR-007QWEN25CODERINSTRUCT7B-003 Qwen2.5 Coder Instruct 7B Humanity's Last Exam No tools Overall 4.8% Unknown Primary source QWEN-QWEN25CODERINSTRUCT7B
BR-007QWEN25INSTRUCT32B-003 Qwen2.5 Instruct 32B Humanity's Last Exam No tools Overall 3.8% Unknown Primary source QWEN-QWEN25INSTRUCT32B
BR-007QWEN25INSTRUCT72B-003 Qwen2.5 Instruct 72B Humanity's Last Exam No tools Overall 4.2% Unknown Primary source QWEN-QWEN25INSTRUCT72B
BR-007QWEN25MAX-003 Qwen2.5 Max Humanity's Last Exam No tools Overall 4.5% Unknown Primary source QWEN-QWEN25MAX
BR-007QWEN25TURBO-003 Qwen2.5 Turbo Humanity's Last Exam No tools Overall 4.2% Unknown Primary source QWEN-QWEN25TURBO
BR-007QWEN2INSTRUCT72B-003 Qwen2 Instruct 72B Humanity's Last Exam No tools Overall 3.7% Unknown Primary source QWEN-QWEN2INSTRUCT72B
BR-007QWEN306B-003 Qwen3 0.6B Humanity's Last Exam No tools Overall 5.2% Unknown Primary source QWEN-QWEN306B
BR-007QWEN306B-014 Qwen3 0.6B Humanity's Last Exam No tools Overall 5.7% Unknown Primary source QWEN-QWEN306B
BR-007QWEN314B-003 Qwen3 14B Humanity's Last Exam No tools Overall 4.3% Unknown Primary source QWEN-QWEN314B
BR-007QWEN314B-017 Qwen3 14B Humanity's Last Exam No tools Overall 4.2% Unknown Primary source QWEN-QWEN314B
BR-007QWEN317B-003 Qwen3 1.7B Humanity's Last Exam No tools Overall 5.2% Unknown Primary source QWEN-QWEN317B
BR-007QWEN317B-014 Qwen3 1.7B Humanity's Last Exam No tools Overall 4.8% Unknown Primary source QWEN-QWEN317B
BR-007QWEN3235BA22B-003 Qwen3 235B A22B Humanity's Last Exam No tools Overall 4.7% Unknown Primary source QWEN-QWEN3235BA22B
BR-007QWEN3235BA22B-014 Qwen3 235B A22B Humanity's Last Exam No tools Overall 11.7% Unknown Primary source QWEN-QWEN3235BA22B
BR-007QWEN3235BA22B2507-003 Qwen3 235B A22B 2507 Humanity's Last Exam No tools Overall 15% Unknown Primary source QWEN-QWEN3235BA22B2507
BR-007QWEN3235BA22B2507INSTRUCT-003 Qwen3 235B A22B 2507 Instruct Humanity's Last Exam No tools Overall 10.6% Unknown Primary source QWEN-QWEN3235BA22B2507INSTRUCT
BR-007QWEN330BA3B-003 Qwen3 30B A3B Humanity's Last Exam No tools Overall 6.6% Unknown Primary source QWEN-QWEN330BA3B