BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database

Llama 3.1 Nemotron Ultra 253B v1

MODEL RECORD: NVDA-LLAMA31NEMOTRONULTRA253BV1

Organization
NVIDIA
Family
LLAMA31NEMOTRONULTRA253BV1
Model number
Unknown
Tier
Unknown
Status
ACTIVE
Release date
2025-04-07

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-015LLAMA31NEMOTRONULTRA253BV1-001 Llama 3.1 Nemotron Ultra 253B v1 Artificial Analysis Intelligence Index Overall 9.1 Unknown Primary source NVDA-LLAMA31NEMOTRONULTRA253BV1
BR-015LLAMA31NEMOTRONULTRA253BV1-002 Llama 3.1 Nemotron Ultra 253B v1 GPQA Diamond Accuracy 72.8% Unknown Primary source NVDA-LLAMA31NEMOTRONULTRA253BV1
BR-015LLAMA31NEMOTRONULTRA253BV1-003 Llama 3.1 Nemotron Ultra 253B v1 Humanity's Last Exam No tools Overall 8.1% Unknown Primary source NVDA-LLAMA31NEMOTRONULTRA253BV1
BR-015LLAMA31NEMOTRONULTRA253BV1-004 Llama 3.1 Nemotron Ultra 253B v1 SciCode Overall 34.7% Unknown Primary source NVDA-LLAMA31NEMOTRONULTRA253BV1
BR-015LLAMA31NEMOTRONULTRA253BV1-005 Llama 3.1 Nemotron Ultra 253B v1 tau2-bench Overall 11.4% Unknown Primary source NVDA-LLAMA31NEMOTRONULTRA253BV1
BR-015LLAMA31NEMOTRONULTRA253BV1-006 Llama 3.1 Nemotron Ultra 253B v1 Terminal-Bench Hard Overall 2.3% Unknown Primary source NVDA-LLAMA31NEMOTRONULTRA253BV1
BR-015LLAMA31NEMOTRONULTRA253BV1-007 Llama 3.1 Nemotron Ultra 253B v1 CritPt Overall 0% Unknown Primary source NVDA-LLAMA31NEMOTRONULTRA253BV1
BR-015LLAMA31NEMOTRONULTRA253BV1-008 Llama 3.1 Nemotron Ultra 253B v1 AA-Omniscience Overall -45.5 Unknown Primary source NVDA-LLAMA31NEMOTRONULTRA253BV1
BR-015LLAMA31NEMOTRONULTRA253BV1-009 Llama 3.1 Nemotron Ultra 253B v1 AA-Omniscience Accuracy 19.9% Unknown Primary source NVDA-LLAMA31NEMOTRONULTRA253BV1
BR-015LLAMA31NEMOTRONULTRA253BV1-010 Llama 3.1 Nemotron Ultra 253B v1 IFBench Overall 38.2% Unknown Primary source NVDA-LLAMA31NEMOTRONULTRA253BV1
BR-015LLAMA31NEMOTRONULTRA253BV1-011 Llama 3.1 Nemotron Ultra 253B v1 AA-LCR Overall 7.3% Unknown Primary source NVDA-LLAMA31NEMOTRONULTRA253BV1