Search operators
brand: benchmark: record: model: metric: date: org:
Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA
Models
|
Benchmarks
|
Organizations
|
Recent Records
|
Sources
|
Documentation
GPT-5 on SWE-bench Pro Public Dataset
BENCHMARK RECORD: BR-0015-064
Canonical URL: https://www.benchmarkregistry.org/records/BR-0015-064
Benchmark scores may depend on benchmark version, evaluation configuration, model snapshot, and evaluator. Records sharing a benchmark name are not necessarily directly comparable.
Record
Record Identifier BR-0015-064Record Status WITHDRAWN Created At 2026-07-13T13:19:46.462Z Updated At 2026-07-13T13:23:50.210Z Superseded By Not applicable
Model
Official Model Name GPT-5 Model Identifier OPNAI-5Organization OpenAI Model Family GPT Model Number 5 Tier Unknown Model Snapshot SNP-000007 Snapshot Label Unknown Provider Model Identifier gpt-5-2025-08-07Snapshot Date 2025-08-07
Benchmark
Benchmark Family SWE-bench Benchmark Version or Variant Pro Public Dataset Benchmark Version Reference swe-bench/pro-publicBenchmark Organization Princeton University Benchmark Status ACTIVE
Result
Metric Resolved Score 41.78 ±3.49 Numeric Score 41.78 Evaluation Date Unknown Reported Date 2025-11-26
Evaluation Context
Configuration Reference CFG-000021 Shots Unknown Reasoning Mode reasoning Reasoning Effort high Pass Count Unknown Agent Scaffold Unknown Evaluation Harness Unknown Temperature Unknown Top P Unknown Max Output Tokens Unknown System Prompt Description Unknown Additional Configuration None reported
Source and Reporting
Primary Source SWE-Bench Pro (Public Dataset) ↗ Source Type LEADERBOARD Publisher Scale AI Source Published Date Unknown Source Accessed At 2026-07-13T12:57:10.168Z Report Type INDEPENDENT Evaluator Scale AI Evaluator Type INDEPENDENT_ORGANIZATION
Provenance
Record Status
This record is WITHDRAWN . Registry identifiers remain reserved when record status changes.