BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database

Llama 3.3 Nemotron Super 49B v1

MODEL RECORD: NVDA-LLAMA33NEMOTRONSUPER49BV1

Organization
NVIDIA
Family
LLAMA33NEMOTRONSUPER49BV1
Model number
Unknown
Tier
Unknown
Status
ACTIVE
Release date
2025-03-18

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-015LLAMA33NEMOTRONSUPER49BV1-001 Llama 3.3 Nemotron Super 49B v1 Artificial Analysis Intelligence Index Overall 12.2 Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-002 Llama 3.3 Nemotron Super 49B v1 GPQA Diamond Accuracy 64.3% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-003 Llama 3.3 Nemotron Super 49B v1 Humanity's Last Exam No tools Overall 6.5% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-004 Llama 3.3 Nemotron Super 49B v1 SciCode Overall 28.2% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-005 Llama 3.3 Nemotron Super 49B v1 tau2-bench Overall 26.9% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-006 Llama 3.3 Nemotron Super 49B v1 Terminal-Bench Hard Overall 0% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-007 Llama 3.3 Nemotron Super 49B v1 CritPt Overall 0% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-008 Llama 3.3 Nemotron Super 49B v1 AA-Omniscience Overall -58.3 Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-009 Llama 3.3 Nemotron Super 49B v1 AA-Omniscience Accuracy 16.9% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-010 Llama 3.3 Nemotron Super 49B v1 IFBench Overall 38.1% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-011 Llama 3.3 Nemotron Super 49B v1 AA-LCR Overall 17% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-012 Llama 3.3 Nemotron Super 49B v1 Artificial Analysis Intelligence Index Overall 8.5 Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-013 Llama 3.3 Nemotron Super 49B v1 GPQA Diamond Accuracy 51.7% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-014 Llama 3.3 Nemotron Super 49B v1 Humanity's Last Exam No tools Overall 3.5% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-015 Llama 3.3 Nemotron Super 49B v1 SciCode Overall 22.9% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-016 Llama 3.3 Nemotron Super 49B v1 Terminal-Bench Hard Overall 0% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-017 Llama 3.3 Nemotron Super 49B v1 CritPt Overall 0% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-018 Llama 3.3 Nemotron Super 49B v1 AA-Omniscience Overall -49.7 Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-019 Llama 3.3 Nemotron Super 49B v1 AA-Omniscience Accuracy 13.5% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-020 Llama 3.3 Nemotron Super 49B v1 IFBench Overall 39.5% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1
BR-015LLAMA33NEMOTRONSUPER49BV1-021 Llama 3.3 Nemotron Super 49B v1 AA-LCR Overall 11.3% Unknown Primary source NVDA-LLAMA33NEMOTRONSUPER49BV1