Models
|
Benchmarks
|
Organizations
|
Recent Records
|
Sources
|
Documentation
Llama 3.1 Tulu3 405B on GPQA Diamond
BENCHMARK RECORD: BR-018LLAMA31TULU3405B-002
Canonical URL: https://www.benchmarkregistry.org/records/BR-018LLAMA31TULU3405B-002
Benchmark scores may depend on benchmark version, evaluation configuration, model snapshot, and evaluator. Records sharing a benchmark name are not necessarily directly comparable.
Record
Record Identifier BR-018LLAMA31TULU3405B-002Record Status ACTIVE Created At 2026-07-13T06:23:34.146Z Updated At 2026-07-13T06:23:34.146Z Superseded By Not applicable Model
Official Model Name Llama 3.1 Tulu3 405B Model Identifier AI2-LLAMA31TULU3405BOrganization Allen Institute for AI Model Family LLAMA31TULU3405B Model Number Unknown Tier Unknown Model Snapshot Unknown Snapshot Label Unknown Provider Model Identifier UnknownSnapshot Date Unknown Benchmark
Benchmark Family GPQA Benchmark Version or Variant Diamond Benchmark Version Reference gpqa/diamondBenchmark Organization New York University Benchmark Status ACTIVE Result
Metric Accuracy Score 51.6% Numeric Score 51.6 Evaluation Date Unknown Reported Date 2026-07-13 Evaluation Context
Configuration Reference Unspecified Shots Unknown Reasoning Mode Unknown Reasoning Effort Unknown Pass Count Unknown Agent Scaffold Unknown Evaluation Harness Unknown Temperature Unknown Top P Unknown Max Output Tokens Unknown System Prompt Description Unknown Additional Configuration None reported Source and Reporting
Primary Source Artificial Analysis Model Leaderboard ↗ Source Type LEADERBOARD Publisher Artificial Analysis Source Published Date Unknown Source Accessed At 2026-07-13T04:53:32.160Z Report Type INDEPENDENT Evaluator Artificial Analysis Evaluator Type INDEPENDENT_ORGANIZATION Provenance
Record Status
This record is ACTIVE . Registry identifiers remain reserved when record status changes.