BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database
Search operators

brand: benchmark: record: model: metric: date: org:

Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA

Anthropic

Provider prefix
ANTHR
Benchmark Record namespace
002

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-002S37-019 Claude 3.7 Sonnet AA-Omniscience Overall -9.2 Unknown Primary source ANTHR-S37
BR-002S37-020 Claude 3.7 Sonnet AA-Omniscience Accuracy 28.3% Unknown Primary source ANTHR-S37
BR-002S37-021 Claude 3.7 Sonnet IFBench Overall 44% Unknown Primary source ANTHR-S37
BR-002S37-022 Claude 3.7 Sonnet MMMU-Pro Overall 60.1% Unknown Primary source ANTHR-S37
BR-002S37-023 Claude 3.7 Sonnet AA-LCR Overall 48.3% Unknown Primary source ANTHR-S37
BR-002S37-024 Claude 3.7 Sonnet ARC-AGI-1 Overall 13.6% Unknown Primary source ANTHR-S37
BR-002S37-025 Claude 3.7 Sonnet ARC-AGI-1 Overall 28.6% Unknown Primary source ANTHR-S37
BR-002S37-026 Claude 3.7 Sonnet ARC-AGI-2 Overall 0.7% Unknown Primary source ANTHR-S37
BR-002S37-027 Claude 3.7 Sonnet ARC-AGI-1 Overall 11.6% Unknown Primary source ANTHR-S37
BR-002S37-028 Claude 3.7 Sonnet ARC-AGI-2 Overall 0.4% Unknown Primary source ANTHR-S37
BR-002S37-029 Claude 3.7 Sonnet ARC-AGI-1 Overall 21.2% Unknown Primary source ANTHR-S37
BR-002S37-030 Claude 3.7 Sonnet ARC-AGI-2 Overall 0.9% Unknown Primary source ANTHR-S37
BR-002S37-031 Claude 3.7 Sonnet ARC-AGI-2 Overall 0.0% Unknown Primary source ANTHR-S37
BR-002S4-001 Claude 4 Sonnet Artificial Analysis Intelligence Index Overall 28.9 Unknown Primary source ANTHR-S4
BR-002S4-002 Claude 4 Sonnet GPQA Diamond Accuracy 77.7% Unknown Primary source ANTHR-S4
BR-002S4-003 Claude 4 Sonnet Humanity's Last Exam No tools Overall 9.6% Unknown Primary source ANTHR-S4
BR-002S4-004 Claude 4 Sonnet SciCode Overall 40% Unknown Primary source ANTHR-S4
BR-002S4-005 Claude 4 Sonnet tau2-bench Overall 64.6% Unknown Primary source ANTHR-S4
BR-002S4-006 Claude 4 Sonnet tau3-Banking Overall 13.8% Unknown Primary source ANTHR-S4
BR-002S4-007 Claude 4 Sonnet Terminal-Bench Hard Overall 31.1% Unknown Primary source ANTHR-S4
BR-002S4-008 Claude 4 Sonnet Terminal-Bench 2.1 Overall 36.3% Unknown Primary source ANTHR-S4
BR-002S4-009 Claude 4 Sonnet CritPt Overall 0.3% Unknown Primary source ANTHR-S4
BR-002S4-010 Claude 4 Sonnet AA-Omniscience Overall 0.2 Unknown Primary source ANTHR-S4
BR-002S4-011 Claude 4 Sonnet AA-Omniscience Accuracy 22.3% Unknown Primary source ANTHR-S4
BR-002S4-012 Claude 4 Sonnet IFBench Overall 54.7% Unknown Primary source ANTHR-S4
BR-002S4-013 Claude 4 Sonnet GDPval-AA Average Normalized Score 18% Unknown Primary source ANTHR-S4
BR-002S4-014 Claude 4 Sonnet MMMU-Pro Overall 61.8% Unknown Primary source ANTHR-S4
BR-002S4-015 Claude 4 Sonnet AA-LCR Overall 64.7% Unknown Primary source ANTHR-S4
BR-002S4-016 Claude 4 Sonnet Artificial Analysis Intelligence Index Overall 25.5 Unknown Primary source ANTHR-S4
BR-002S4-017 Claude 4 Sonnet GPQA Diamond Accuracy 68.3% Unknown Primary source ANTHR-S4
BR-002S4-018 Claude 4 Sonnet Humanity's Last Exam No tools Overall 4% Unknown Primary source ANTHR-S4
BR-002S4-019 Claude 4 Sonnet SciCode Overall 37.3% Unknown Primary source ANTHR-S4
BR-002S4-020 Claude 4 Sonnet tau2-bench Overall 52.3% Unknown Primary source ANTHR-S4
BR-002S4-021 Claude 4 Sonnet Terminal-Bench Hard Overall 27.3% Unknown Primary source ANTHR-S4
BR-002S4-022 Claude 4 Sonnet CritPt Overall 1.1% Unknown Primary source ANTHR-S4
BR-002S4-023 Claude 4 Sonnet AA-Omniscience Overall -9.2 Unknown Primary source ANTHR-S4
BR-002S4-024 Claude 4 Sonnet AA-Omniscience Accuracy 22.4% Unknown Primary source ANTHR-S4
BR-002S4-025 Claude 4 Sonnet IFBench Overall 45.4% Unknown Primary source ANTHR-S4
BR-002S4-026 Claude 4 Sonnet MMMU-Pro Overall 62.4% Unknown Primary source ANTHR-S4
BR-002S4-027 Claude 4 Sonnet AA-LCR Overall 44.3% Unknown Primary source ANTHR-S4
BR-002S4-028 Claude 4 Sonnet ARC-AGI-1 Overall 23.8% Unknown Primary source ANTHR-S4
BR-002S4-029 Claude 4 Sonnet ARC-AGI-2 Overall 1.3% Unknown Primary source ANTHR-S4
BR-002S4-030 Claude 4 Sonnet ARC-AGI-1 Overall 28.0% Unknown Primary source ANTHR-S4
BR-002S4-031 Claude 4 Sonnet ARC-AGI-2 Overall 0.9% Unknown Primary source ANTHR-S4
BR-002S4-032 Claude 4 Sonnet ARC-AGI-1 Overall 29.0% Unknown Primary source ANTHR-S4
BR-002S4-033 Claude 4 Sonnet ARC-AGI-2 Overall 2.1% Unknown Primary source ANTHR-S4
BR-002S4-034 Claude 4 Sonnet ARC-AGI-1 Overall 40.0% Unknown Primary source ANTHR-S4
BR-002S4-035 Claude 4 Sonnet ARC-AGI-2 Overall 5.9% Unknown Primary source ANTHR-S4
BR-002S4-036 Claude 4 Sonnet SWE-bench Pro Public Dataset Resolved 42.70 ±3.59 Unknown Primary source ANTHR-S4
BR-002S4-037 Claude 4 Sonnet SWE-bench Pro Private Dataset Resolved 9.06 ±3.39 Unknown Primary source ANTHR-S4
BR-002S45-001 Claude 4.5 Sonnet Artificial Analysis Intelligence Index Overall 36.4 Unknown Primary source ANTHR-S45
BR-002S45-002 Claude 4.5 Sonnet GPQA Diamond Accuracy 83.4% Unknown Primary source ANTHR-S45
BR-002S45-003 Claude 4.5 Sonnet Humanity's Last Exam No tools Overall 17.3% Unknown Primary source ANTHR-S45
BR-002S45-004 Claude 4.5 Sonnet SciCode Overall 44.7% Unknown Primary source ANTHR-S45
BR-002S45-005 Claude 4.5 Sonnet tau2-bench Overall 78.1% Unknown Primary source ANTHR-S45
BR-002S45-006 Claude 4.5 Sonnet tau3-Banking Overall 19% Unknown Primary source ANTHR-S45
BR-002S45-007 Claude 4.5 Sonnet Terminal-Bench Hard Overall 35.6% Unknown Primary source ANTHR-S45
BR-002S45-008 Claude 4.5 Sonnet Terminal-Bench 2.1 Overall 55.8% Unknown Primary source ANTHR-S45
BR-002S45-009 Claude 4.5 Sonnet CritPt Overall 1.1% Unknown Primary source ANTHR-S45
BR-002S45-010 Claude 4.5 Sonnet AA-Omniscience Overall 0.3 Unknown Primary source ANTHR-S45
BR-002S45-011 Claude 4.5 Sonnet AA-Omniscience Accuracy 32.4% Unknown Primary source ANTHR-S45
BR-002S45-012 Claude 4.5 Sonnet IFBench Overall 57.3% Unknown Primary source ANTHR-S45
BR-002S45-013 Claude 4.5 Sonnet GDPval-AA Average Normalized Score 27.6% Unknown Primary source ANTHR-S45
BR-002S45-014 Claude 4.5 Sonnet MMMU-Pro Overall 68.7% Unknown Primary source ANTHR-S45
BR-002S45-015 Claude 4.5 Sonnet AA-LCR Overall 65.7% Unknown Primary source ANTHR-S45
BR-002S45-016 Claude 4.5 Sonnet Artificial Analysis Intelligence Index Overall 29.3 Unknown Primary source ANTHR-S45
BR-002S45-017 Claude 4.5 Sonnet GPQA Diamond Accuracy 72.7% Unknown Primary source ANTHR-S45
BR-002S45-018 Claude 4.5 Sonnet Humanity's Last Exam No tools Overall 7.1% Unknown Primary source ANTHR-S45
BR-002S45-019 Claude 4.5 Sonnet SciCode Overall 42.8% Unknown Primary source ANTHR-S45
BR-002S45-020 Claude 4.5 Sonnet tau2-bench Overall 70.5% Unknown Primary source ANTHR-S45
BR-002S45-021 Claude 4.5 Sonnet Terminal-Bench Hard Overall 28.8% Unknown Primary source ANTHR-S45
BR-002S45-022 Claude 4.5 Sonnet CritPt Overall 0% Unknown Primary source ANTHR-S45
BR-002S45-023 Claude 4.5 Sonnet AA-Omniscience Overall -9.2 Unknown Primary source ANTHR-S45
BR-002S45-024 Claude 4.5 Sonnet AA-Omniscience Accuracy 27.5% Unknown Primary source ANTHR-S45
BR-002S45-025 Claude 4.5 Sonnet IFBench Overall 42.7% Unknown Primary source ANTHR-S45
BR-002S45-026 Claude 4.5 Sonnet MMMU-Pro Overall 65.2% Unknown Primary source ANTHR-S45
BR-002S45-027 Claude 4.5 Sonnet AA-LCR Overall 51.3% Unknown Primary source ANTHR-S45
BR-002S45-028 Claude 4.5 Sonnet ARC-AGI-1 Overall 25.5% Unknown Primary source ANTHR-S45
BR-002S45-029 Claude 4.5 Sonnet ARC-AGI-2 Overall 3.8% Unknown Primary source ANTHR-S45
BR-002S45-030 Claude 4.5 Sonnet ARC-AGI-1 Overall 31.0% Unknown Primary source ANTHR-S45
BR-002S45-031 Claude 4.5 Sonnet ARC-AGI-2 Overall 5.8% Unknown Primary source ANTHR-S45
BR-002S45-032 Claude 4.5 Sonnet ARC-AGI-1 Overall 46.5% Unknown Primary source ANTHR-S45
BR-002S45-033 Claude 4.5 Sonnet ARC-AGI-2 Overall 6.9% Unknown Primary source ANTHR-S45
BR-002S45-034 Claude 4.5 Sonnet ARC-AGI-1 Overall 48.3% Unknown Primary source ANTHR-S45
BR-002S45-035 Claude 4.5 Sonnet ARC-AGI-2 Overall 6.9% Unknown Primary source ANTHR-S45
BR-002S45-036 Claude 4.5 Sonnet ARC-AGI-1 Overall 63.7% Unknown Primary source ANTHR-S45
BR-002S45-037 Claude 4.5 Sonnet ARC-AGI-2 Overall 13.6% Unknown Primary source ANTHR-S45
BR-002S45-038 Claude 4.5 Sonnet SWE-bench Pro Public Dataset Resolved 43.60 ±3.60 Unknown Primary source ANTHR-S45
BR-002S46-001 Claude Sonnet 4.6 DeepSWE Resolved 30% ±4% Unknown Primary source ANTHR-S46
BR-002S46-002 Claude Sonnet 4.6 Artificial Analysis Intelligence Index Overall 35.9 Unknown Primary source ANTHR-S46
BR-002S46-003 Claude Sonnet 4.6 GPQA Diamond Accuracy 79.9% Unknown Primary source ANTHR-S46
BR-002S46-004 Claude Sonnet 4.6 Humanity's Last Exam No tools Overall 13.2% Unknown Primary source ANTHR-S46
BR-002S46-005 Claude Sonnet 4.6 SciCode Overall 46.9% Unknown Primary source ANTHR-S46
BR-002S46-006 Claude Sonnet 4.6 tau2-bench Overall 79.5% Unknown Primary source ANTHR-S46
BR-002S46-007 Claude Sonnet 4.6 Terminal-Bench Hard Overall 46.2% Unknown Primary source ANTHR-S46
BR-002S46-008 Claude Sonnet 4.6 CritPt Overall 0.9% Unknown Primary source ANTHR-S46
BR-002S46-009 Claude Sonnet 4.6 AA-Omniscience Overall -2.9 Unknown Primary source ANTHR-S46
BR-002S46-010 Claude Sonnet 4.6 AA-Omniscience Accuracy 38% Unknown Primary source ANTHR-S46
BR-002S46-011 Claude Sonnet 4.6 IFBench Overall 41.2% Unknown Primary source ANTHR-S46
BR-002S46-012 Claude Sonnet 4.6 MMMU-Pro Overall 70.6% Unknown Primary source ANTHR-S46