Claude 3.7 Sonnet

MODEL RECORD: ANTHR-S37

Organization
Anthropic
Family
Claude
Model number
37
Tier
S
Status
ACTIVE
Release date
2025-02-24

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-002S37-001 Claude 3.7 Sonnet Artificial Analysis Intelligence Index Overall 27.1 Unknown Primary source ANTHR-S37
BR-002S37-002 Claude 3.7 Sonnet GPQA Diamond Accuracy 77.2% Unknown Primary source ANTHR-S37
BR-002S37-003 Claude 3.7 Sonnet Humanity's Last Exam No tools Overall 10.3% Unknown Primary source ANTHR-S37
BR-002S37-004 Claude 3.7 Sonnet SciCode Overall 40.3% Unknown Primary source ANTHR-S37
BR-002S37-005 Claude 3.7 Sonnet tau2-bench Overall 54.7% Unknown Primary source ANTHR-S37
BR-002S37-006 Claude 3.7 Sonnet Terminal-Bench Hard Overall 21.2% Unknown Primary source ANTHR-S37
BR-002S37-007 Claude 3.7 Sonnet CritPt Overall 0.9% Unknown Primary source ANTHR-S37
BR-002S37-008 Claude 3.7 Sonnet AA-Omniscience Overall 0.3 Unknown Primary source ANTHR-S37
BR-002S37-009 Claude 3.7 Sonnet AA-Omniscience Accuracy 28% Unknown Primary source ANTHR-S37
BR-002S37-010 Claude 3.7 Sonnet IFBench Overall 48.3% Unknown Primary source ANTHR-S37
BR-002S37-011 Claude 3.7 Sonnet AA-LCR Overall 60.7% Unknown Primary source ANTHR-S37
BR-002S37-012 Claude 3.7 Sonnet Artificial Analysis Intelligence Index Overall 23.5 Unknown Primary source ANTHR-S37
BR-002S37-013 Claude 3.7 Sonnet GPQA Diamond Accuracy 65.6% Unknown Primary source ANTHR-S37
BR-002S37-014 Claude 3.7 Sonnet Humanity's Last Exam No tools Overall 4.8% Unknown Primary source ANTHR-S37
BR-002S37-015 Claude 3.7 Sonnet SciCode Overall 37.6% Unknown Primary source ANTHR-S37
BR-002S37-016 Claude 3.7 Sonnet tau2-bench Overall 50% Unknown Primary source ANTHR-S37
BR-002S37-017 Claude 3.7 Sonnet Terminal-Bench Hard Overall 21.2% Unknown Primary source ANTHR-S37
BR-002S37-018 Claude 3.7 Sonnet CritPt Overall 0% Unknown Primary source ANTHR-S37
BR-002S37-019 Claude 3.7 Sonnet AA-Omniscience Overall -9.2 Unknown Primary source ANTHR-S37
BR-002S37-020 Claude 3.7 Sonnet AA-Omniscience Accuracy 28.3% Unknown Primary source ANTHR-S37
BR-002S37-021 Claude 3.7 Sonnet IFBench Overall 44% Unknown Primary source ANTHR-S37
BR-002S37-022 Claude 3.7 Sonnet MMMU-Pro Overall 60.1% Unknown Primary source ANTHR-S37
BR-002S37-023 Claude 3.7 Sonnet AA-LCR Overall 48.3% Unknown Primary source ANTHR-S37