Search operators
brand: benchmark: record: model: metric: date: org:
Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA
Models
|
Benchmarks
|
Organizations
|
Recent Records
|
Sources
|
Documentation
Gemini 2.5 Pro on SWE-bench Pro Private Dataset
BENCHMARK RECORD: BR-00325P-029
Canonical URL: https://www.benchmarkregistry.org/records/BR-00325P-029
Benchmark scores may depend on benchmark version, evaluation configuration, model snapshot, and evaluator. Records sharing a benchmark name are not necessarily directly comparable.
Record
Record Identifier BR-00325P-029Record Status WITHDRAWN Created At 2026-07-13T13:20:58.839Z Updated At 2026-07-13T13:24:31.734Z Superseded By Not applicable Model
Official Model Name Gemini 2.5 Pro Model Identifier GOOGL-G25POrganization Google Model Family Gemini Model Number 25 Tier P Model Snapshot Unknown Snapshot Label Unknown Provider Model Identifier UnknownSnapshot Date Unknown Benchmark
Benchmark Family SWE-bench Benchmark Version or Variant Pro Private Dataset Benchmark Version Reference swe-bench/pro-privateBenchmark Organization Princeton University Benchmark Status ACTIVE Result
Metric Resolved Score 10.14 ±3.56 Numeric Score 10.14 Evaluation Date Unknown Reported Date 2025-09-19 Evaluation Context
Configuration Reference Unspecified Shots Unknown Reasoning Mode Unknown Reasoning Effort Unknown Pass Count Unknown Agent Scaffold Unknown Evaluation Harness Unknown Temperature Unknown Top P Unknown Max Output Tokens Unknown System Prompt Description Unknown Additional Configuration None reported Source and Reporting
Primary Source SWE-Bench Pro (Private Dataset) ↗ Source Type LEADERBOARD Publisher Scale AI Source Published Date Unknown Source Accessed At 2026-07-13T12:57:12.424Z Report Type INDEPENDENT Evaluator Scale AI Evaluator Type INDEPENDENT_ORGANIZATION Provenance
Record Status
This record is WITHDRAWN . Registry identifiers remain reserved when record status changes.