Olmo 3 7B Instruct on tau2-bench

BENCHMARK RECORD: BR-018OLMO37BINSTRUCT-005

Canonical URL: https://www.benchmarkregistry.org/records/BR-018OLMO37BINSTRUCT-005

Benchmark scores may depend on benchmark version, evaluation configuration, model snapshot, and evaluator. Records sharing a benchmark name are not necessarily directly comparable.

Record

Record Identifier

BR-018OLMO37BINSTRUCT-005

Record Status

ACTIVE

Created At

2026-07-13T06:14:16.723Z

Updated At

2026-07-13T06:14:16.723Z

Superseded By

Not applicable

Model

Official Model Name

Olmo 3 7B Instruct

Model Identifier

AI2-OLMO37BINSTRUCT

Organization

Allen Institute for AI

Model Family

OLMO37BINSTRUCT

Model Number

Unknown

Tier

Unknown

Model Snapshot

Unknown

Snapshot Label

Unknown

Provider Model Identifier

Unknown

Snapshot Date

Unknown

Benchmark

Benchmark Family

tau2-bench

Benchmark Version or Variant

Unknown

Benchmark Version Reference

tau2-bench/default

Benchmark Organization

Sierra

Benchmark Status

ACTIVE

Result

Metric

Overall

Score

12.6%

Numeric Score

12.6

Evaluation Date

Unknown

Reported Date

2026-07-13

Evaluation Context

Configuration Reference

Unspecified

Shots

Unknown

Reasoning Mode

Unknown

Reasoning Effort

Unknown

Pass Count

Unknown

Agent Scaffold

Unknown

Evaluation Harness

Unknown

Temperature

Unknown

Top P

Unknown

Max Output Tokens

Unknown

System Prompt Description

Unknown

Additional Configuration

None reported

Source and Reporting

Primary Source

Artificial Analysis Model Leaderboard ↗

Source Type

LEADERBOARD

Publisher

Artificial Analysis

Source Published Date

Unknown

Source Accessed At

2026-07-13T04:53:32.160Z

Report Type

INDEPENDENT

Evaluator

Artificial Analysis

Evaluator Type

INDEPENDENT_ORGANIZATION

Provenance

Record Status

This record is ACTIVE. Registry identifiers remain reserved when record status changes.