Claude 3.7 Sonnet on ARC-AGI-2

BENCHMARK RECORD: BR-002S37-028

Canonical URL: https://www.benchmarkregistry.org/records/BR-002S37-028

Benchmark scores may depend on benchmark version, evaluation configuration, model snapshot, and evaluator. Records sharing a benchmark name are not necessarily directly comparable.

Record

Record Identifier

BR-002S37-028

Record Status

ACTIVE

Created At

2026-07-13T13:13:05.293Z

Updated At

2026-07-13T13:13:05.293Z

Superseded By

Not applicable

Model

Official Model Name

Claude 3.7 Sonnet

Model Identifier

ANTHR-S37

Organization

Anthropic

Model Family

Claude

Model Number

37

Tier

S

Model Snapshot

Unknown

Snapshot Label

Unknown

Provider Model Identifier

Unknown

Snapshot Date

Unknown

Benchmark

Benchmark Family

ARC-AGI

Benchmark Version or Variant

ARC-AGI-2

Benchmark Version Reference

arc-agi/2

Benchmark Organization

ARC Prize Foundation

Benchmark Status

ACTIVE

Result

Metric

Overall

Score

0.4%

Numeric Score

0.4

Evaluation Date

Unknown

Reported Date

2026-07-09

Evaluation Context

Configuration Reference

CFG-000007

Shots

Unknown

Reasoning Mode

reasoning

Reasoning Effort

Unknown

Pass Count

Unknown

Agent Scaffold

Unknown

Evaluation Harness

Unknown

Temperature

Unknown

Top P

Unknown

Max Output Tokens

Unknown

System Prompt Description

Unknown

Additional Configuration

None reported

Source and Reporting

Primary Source

ARC-AGI Leaderboard ↗

Source Type

LEADERBOARD

Publisher

ARC Prize Foundation

Source Published Date

2026-07-09

Source Accessed At

2026-07-13T12:57:08.196Z

Report Type

BENCHMARK_OWNER

Evaluator

ARC Prize Foundation

Evaluator Type

BENCHMARK_OWNER

Provenance

Record Status

This record is ACTIVE. Registry identifiers remain reserved when record status changes.