Claude 4 Opus on ARC-AGI-2

BENCHMARK RECORD: BR-002O4-021

Canonical URL: https://www.benchmarkregistry.org/records/BR-002O4-021

Benchmark scores may depend on benchmark version, evaluation configuration, model snapshot, and evaluator. Records sharing a benchmark name are not necessarily directly comparable.

Record

Record Identifier

BR-002O4-021

Record Status

ACTIVE

Created At

2026-07-13T13:13:05.293Z

Updated At

2026-07-13T13:13:05.293Z

Superseded By

Not applicable

Model

Official Model Name

Claude 4 Opus

Model Identifier

ANTHR-O4

Organization

Anthropic

Model Family

Claude

Model Number

4

Tier

O

Model Snapshot

SNP-000010

Snapshot Label

Unknown

Provider Model Identifier

claude-opus-4-20250514

Snapshot Date

2025-05-14

Benchmark

Benchmark Family

ARC-AGI

Benchmark Version or Variant

ARC-AGI-2

Benchmark Version Reference

arc-agi/2

Benchmark Organization

ARC Prize Foundation

Benchmark Status

ACTIVE

Result

Metric

Overall

Score

1.3%

Numeric Score

1.27

Evaluation Date

Unknown

Reported Date

2026-07-09

Evaluation Context

Configuration Reference

CFG-000007

Shots

Unknown

Reasoning Mode

reasoning

Reasoning Effort

Unknown

Pass Count

Unknown

Agent Scaffold

Unknown

Evaluation Harness

Unknown

Temperature

Unknown

Top P

Unknown

Max Output Tokens

Unknown

System Prompt Description

Unknown

Additional Configuration

None reported

Source and Reporting

Primary Source

ARC-AGI Leaderboard ↗

Source Type

LEADERBOARD

Publisher

ARC Prize Foundation

Source Published Date

2026-07-09

Source Accessed At

2026-07-13T12:57:08.196Z

Report Type

BENCHMARK_OWNER

Evaluator

ARC Prize Foundation

Evaluator Type

BENCHMARK_OWNER

Provenance

Record Status

This record is ACTIVE. Registry identifiers remain reserved when record status changes.