Claude Sonnet 4.6 on ITBench SRE

BENCHMARK RECORD: BR-002S46-027

Canonical URL: https://www.benchmarkregistry.org/records/BR-002S46-027

Benchmark scores may depend on benchmark version, evaluation configuration, model snapshot, and evaluator. Records sharing a benchmark name are not necessarily directly comparable.

Record

Record Identifier

BR-002S46-027

Record Status

ACTIVE

Created At

2026-07-13T05:55:24.887Z

Updated At

2026-07-13T05:55:24.887Z

Superseded By

Not applicable

Model

Official Model Name

Claude Sonnet 4.6

Model Identifier

ANTHR-S46

Organization

Anthropic

Model Family

Claude

Model Number

46

Tier

S

Model Snapshot

Unknown

Snapshot Label

Unknown

Provider Model Identifier

Unknown

Snapshot Date

Unknown

Benchmark

Benchmark Family

ITBench SRE

Benchmark Version or Variant

Unknown

Benchmark Version Reference

itbench-sre/default

Benchmark Organization

IBM

Benchmark Status

ACTIVE

Result

Metric

Overall

Score

39.8%

Numeric Score

39.8

Evaluation Date

Unknown

Reported Date

2026-07-13

Evaluation Context

Configuration Reference

CFG-000015

Shots

Unknown

Reasoning Mode

adaptive

Reasoning Effort

max

Pass Count

Unknown

Agent Scaffold

Unknown

Evaluation Harness

Unknown

Temperature

Unknown

Top P

Unknown

Max Output Tokens

Unknown

System Prompt Description

Unknown

Additional Configuration

None reported

Source and Reporting

Primary Source

Artificial Analysis Model Leaderboard ↗

Source Type

LEADERBOARD

Publisher

Artificial Analysis

Source Published Date

Unknown

Source Accessed At

2026-07-13T04:53:32.160Z

Report Type

INDEPENDENT

Evaluator

Artificial Analysis

Evaluator Type

INDEPENDENT_ORGANIZATION

Provenance

Record Status

This record is ACTIVE. Registry identifiers remain reserved when record status changes.