Search operators

brand: benchmark: record: model: metric: date: org:

Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA

GPT-5 on SWE-bench Pro Public Dataset

BENCHMARK RECORD: BR-0015-064

Report record

Canonical URL: https://www.benchmarkregistry.org/records/BR-0015-064

Benchmark scores may depend on benchmark version, evaluation configuration, model snapshot, and evaluator. Records sharing a benchmark name are not necessarily directly comparable.

Record

Record Identifier
BR-0015-064
Record Status
WITHDRAWN
Created At
2026-07-13T13:19:46.462Z
Updated At
2026-07-13T13:23:50.210Z
Superseded By
Not applicable

Model

Official Model Name
GPT-5
Model Identifier
OPNAI-5
Organization
OpenAI
Model Family
GPT
Model Number
5
Tier
Unknown
Model Snapshot
SNP-000007
Snapshot Label
Unknown
Provider Model Identifier
gpt-5-2025-08-07
Snapshot Date
2025-08-07

Benchmark

Benchmark Family
SWE-bench
Benchmark Version or Variant
Pro Public Dataset
Benchmark Version Reference
swe-bench/pro-public
Benchmark Organization
Princeton University
Benchmark Status
ACTIVE

Result

Metric
Resolved
Score
41.78 ±3.49
Numeric Score
41.78
Evaluation Date
Unknown
Reported Date
2025-11-26

Evaluation Context

Configuration Reference
CFG-000021
Shots
Unknown
Reasoning Mode
reasoning
Reasoning Effort
high
Pass Count
Unknown
Agent Scaffold
Unknown
Evaluation Harness
Unknown
Temperature
Unknown
Top P
Unknown
Max Output Tokens
Unknown
System Prompt Description
Unknown
Additional Configuration
None reported

Source and Reporting

Primary Source
SWE-Bench Pro (Public Dataset)
Source Type
LEADERBOARD
Publisher
Scale AI
Source Published Date
Unknown
Source Accessed At
2026-07-13T12:57:10.168Z
Report Type
INDEPENDENT
Evaluator
Scale AI
Evaluator Type
INDEPENDENT_ORGANIZATION

Provenance

DateEventSourceDetails
2026-07-13T13:19:46.462ZRecord created manuallySWE-Bench Pro (Public Dataset)
2026-07-13T13:23:50.161ZRecord withdrawn

Record Status

This record is WITHDRAWN. Registry identifiers remain reserved when record status changes.