Search operators
brand: benchmark: record: model: metric: date: org:
Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA
Models
|
Benchmarks
|
Organizations
|
Recent Records
|
Sources
|
Documentation
Llama 3.3 Nemotron Super 49B v1 on GPQA Diamond
BENCHMARK RECORD: BR-015LLAMA33NEMOTRONSUPER49BV1-002
Canonical URL: https://www.benchmarkregistry.org/records/BR-015LLAMA33NEMOTRONSUPER49BV1-002
Benchmark scores may depend on benchmark version, evaluation configuration, model snapshot, and evaluator. Records sharing a benchmark name are not necessarily directly comparable.
Record
Record Identifier BR-015LLAMA33NEMOTRONSUPER49BV1-002Record Status ACTIVE Created At 2026-07-13T05:49:30.989Z Updated At 2026-07-13T05:49:30.989Z Superseded By Not applicable
Model
Official Model Name Llama 3.3 Nemotron Super 49B v1 Model Identifier NVDA-LLAMA33NEMOTRONSUPER49BV1Organization NVIDIA Model Family LLAMA33NEMOTRONSUPER49BV1 Model Number Unknown Tier Unknown Model Snapshot Unknown Snapshot Label Unknown Provider Model Identifier UnknownSnapshot Date Unknown
Benchmark
Benchmark Family GPQA Benchmark Version or Variant Diamond Benchmark Version Reference gpqa/diamondBenchmark Organization New York University Benchmark Status ACTIVE
Result
Metric Accuracy Score 64.3% Numeric Score 64.3 Evaluation Date Unknown Reported Date 2026-07-13
Evaluation Context
Configuration Reference CFG-000007 Shots Unknown Reasoning Mode reasoning Reasoning Effort Unknown Pass Count Unknown Agent Scaffold Unknown Evaluation Harness Unknown Temperature Unknown Top P Unknown Max Output Tokens Unknown System Prompt Description Unknown Additional Configuration None reported
Source and Reporting
Primary Source Artificial Analysis Model Leaderboard ↗ Source Type LEADERBOARD Publisher Artificial Analysis Source Published Date Unknown Source Accessed At 2026-07-13T04:53:32.160Z Report Type INDEPENDENT Evaluator Artificial Analysis Evaluator Type INDEPENDENT_ORGANIZATION
Provenance
Record Status
This record is ACTIVE . Registry identifiers remain reserved when record status changes.