Search operators

brand: benchmark: record: model: metric: date: org:

Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA

Gemini 2.5 Pro on SWE-bench Pro Private Dataset

BENCHMARK RECORD: BR-00325P-027

Report record

Canonical URL: https://www.benchmarkregistry.org/records/BR-00325P-027

Benchmark scores may depend on benchmark version, evaluation configuration, model snapshot, and evaluator. Records sharing a benchmark name are not necessarily directly comparable.

Record

Record Identifier
BR-00325P-027
Record Status
ACTIVE
Created At
2026-07-13T13:16:10.160Z
Updated At
2026-07-13T13:16:10.160Z
Superseded By
Not applicable

Model

Official Model Name
Gemini 2.5 Pro
Model Identifier
GOOGL-G25P
Organization
Google
Model Family
Gemini
Model Number
25
Tier
P
Model Snapshot
Unknown
Snapshot Label
Unknown
Provider Model Identifier
Unknown
Snapshot Date
Unknown

Benchmark

Benchmark Family
SWE-bench
Benchmark Version or Variant
Pro Private Dataset
Benchmark Version Reference
swe-bench/pro-private
Benchmark Organization
Princeton University
Benchmark Status
ACTIVE

Result

Metric
Resolved
Score
10.14 ±3.56
Numeric Score
10.14
Evaluation Date
Unknown
Reported Date
2025-09-19

Evaluation Context

Configuration Reference
Unspecified
Shots
Unknown
Reasoning Mode
Unknown
Reasoning Effort
Unknown
Pass Count
Unknown
Agent Scaffold
Unknown
Evaluation Harness
Unknown
Temperature
Unknown
Top P
Unknown
Max Output Tokens
Unknown
System Prompt Description
Unknown
Additional Configuration
None reported

Source and Reporting

Primary Source
SWE-Bench Pro (Private Dataset)
Source Type
LEADERBOARD
Publisher
Scale AI
Source Published Date
Unknown
Source Accessed At
2026-07-13T12:57:12.424Z
Report Type
INDEPENDENT
Evaluator
Scale AI
Evaluator Type
INDEPENDENT_ORGANIZATION

Provenance

DateEventSourceDetails
2026-07-13T13:16:10.160ZRecord created manuallySWE-Bench Pro (Private Dataset)

Record Status

This record is ACTIVE. Registry identifiers remain reserved when record status changes.