BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database

Meta

Provider prefix
META
Benchmark Record namespace
009

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-009LLAMA2CHAT13B-001 Llama 2 Chat 13B Artificial Analysis Intelligence Index Overall 3 Unknown Primary source META-LLAMA2CHAT13B
BR-009LLAMA2CHAT13B-002 Llama 2 Chat 13B GPQA Diamond Accuracy 32.1% Unknown Primary source META-LLAMA2CHAT13B
BR-009LLAMA2CHAT13B-003 Llama 2 Chat 13B Humanity's Last Exam No tools Overall 4.7% Unknown Primary source META-LLAMA2CHAT13B
BR-009LLAMA2CHAT13B-004 Llama 2 Chat 13B SciCode Overall 11.8% Unknown Primary source META-LLAMA2CHAT13B
BR-009LLAMA2CHAT70B-001 Llama 2 Chat 70B Artificial Analysis Intelligence Index Overall 3 Unknown Primary source META-LLAMA2CHAT70B
BR-009LLAMA2CHAT70B-002 Llama 2 Chat 70B GPQA Diamond Accuracy 32.7% Unknown Primary source META-LLAMA2CHAT70B
BR-009LLAMA2CHAT70B-003 Llama 2 Chat 70B Humanity's Last Exam No tools Overall 5% Unknown Primary source META-LLAMA2CHAT70B
BR-009LLAMA2CHAT7B-001 Llama 2 Chat 7B Artificial Analysis Intelligence Index Overall 4.3 Unknown Primary source META-LLAMA2CHAT7B
BR-009LLAMA2CHAT7B-002 Llama 2 Chat 7B GPQA Diamond Accuracy 22.7% Unknown Primary source META-LLAMA2CHAT7B
BR-009LLAMA2CHAT7B-003 Llama 2 Chat 7B Humanity's Last Exam No tools Overall 5.8% Unknown Primary source META-LLAMA2CHAT7B
BR-009LLAMA2CHAT7B-004 Llama 2 Chat 7B SciCode Overall 0% Unknown Primary source META-LLAMA2CHAT7B
BR-009LLAMA31INSTRUCT405B-001 Llama 3.1 Instruct 405B Artificial Analysis Intelligence Index Overall 8.5 Unknown Primary source META-LLAMA31INSTRUCT405B
BR-009LLAMA31INSTRUCT405B-002 Llama 3.1 Instruct 405B GPQA Diamond Accuracy 51.5% Unknown Primary source META-LLAMA31INSTRUCT405B
BR-009LLAMA31INSTRUCT405B-003 Llama 3.1 Instruct 405B Humanity's Last Exam No tools Overall 4.2% Unknown Primary source META-LLAMA31INSTRUCT405B
BR-009LLAMA31INSTRUCT405B-004 Llama 3.1 Instruct 405B SciCode Overall 29.9% Unknown Primary source META-LLAMA31INSTRUCT405B
BR-009LLAMA31INSTRUCT405B-005 Llama 3.1 Instruct 405B tau2-bench Overall 19% Unknown Primary source META-LLAMA31INSTRUCT405B
BR-009LLAMA31INSTRUCT405B-006 Llama 3.1 Instruct 405B Terminal-Bench Hard Overall 6.8% Unknown Primary source META-LLAMA31INSTRUCT405B
BR-009LLAMA31INSTRUCT405B-007 Llama 3.1 Instruct 405B CritPt Overall 0% Unknown Primary source META-LLAMA31INSTRUCT405B
BR-009LLAMA31INSTRUCT405B-008 Llama 3.1 Instruct 405B AA-Omniscience Overall -17.3 Unknown Primary source META-LLAMA31INSTRUCT405B
BR-009LLAMA31INSTRUCT405B-009 Llama 3.1 Instruct 405B AA-Omniscience Accuracy 22.3% Unknown Primary source META-LLAMA31INSTRUCT405B
BR-009LLAMA31INSTRUCT405B-010 Llama 3.1 Instruct 405B IFBench Overall 39% Unknown Primary source META-LLAMA31INSTRUCT405B
BR-009LLAMA31INSTRUCT405B-011 Llama 3.1 Instruct 405B AA-LCR Overall 24.3% Unknown Primary source META-LLAMA31INSTRUCT405B
BR-009LLAMA31INSTRUCT70B-001 Llama 3.1 Instruct 70B Artificial Analysis Intelligence Index Overall 6.8 Unknown Primary source META-LLAMA31INSTRUCT70B
BR-009LLAMA31INSTRUCT70B-002 Llama 3.1 Instruct 70B GPQA Diamond Accuracy 40.9% Unknown Primary source META-LLAMA31INSTRUCT70B
BR-009LLAMA31INSTRUCT70B-003 Llama 3.1 Instruct 70B Humanity's Last Exam No tools Overall 4.6% Unknown Primary source META-LLAMA31INSTRUCT70B
BR-009LLAMA31INSTRUCT70B-004 Llama 3.1 Instruct 70B SciCode Overall 26.7% Unknown Primary source META-LLAMA31INSTRUCT70B
BR-009LLAMA31INSTRUCT70B-005 Llama 3.1 Instruct 70B tau2-bench Overall 15.2% Unknown Primary source META-LLAMA31INSTRUCT70B
BR-009LLAMA31INSTRUCT70B-006 Llama 3.1 Instruct 70B Terminal-Bench Hard Overall 3% Unknown Primary source META-LLAMA31INSTRUCT70B
BR-009LLAMA31INSTRUCT70B-007 Llama 3.1 Instruct 70B CritPt Overall 0% Unknown Primary source META-LLAMA31INSTRUCT70B
BR-009LLAMA31INSTRUCT70B-008 Llama 3.1 Instruct 70B AA-Omniscience Overall -40.8 Unknown Primary source META-LLAMA31INSTRUCT70B
BR-009LLAMA31INSTRUCT70B-009 Llama 3.1 Instruct 70B AA-Omniscience Accuracy 19.4% Unknown Primary source META-LLAMA31INSTRUCT70B
BR-009LLAMA31INSTRUCT70B-010 Llama 3.1 Instruct 70B IFBench Overall 34.4% Unknown Primary source META-LLAMA31INSTRUCT70B
BR-009LLAMA31INSTRUCT70B-011 Llama 3.1 Instruct 70B AA-LCR Overall 6.3% Unknown Primary source META-LLAMA31INSTRUCT70B
BR-009LLAMA31INSTRUCT8B-001 Llama 3.1 Instruct 8B Artificial Analysis Intelligence Index Overall 7.6 Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA31INSTRUCT8B-002 Llama 3.1 Instruct 8B GPQA Diamond Accuracy 25.9% Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA31INSTRUCT8B-003 Llama 3.1 Instruct 8B Humanity's Last Exam No tools Overall 5.1% Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA31INSTRUCT8B-004 Llama 3.1 Instruct 8B SciCode Overall 13.2% Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA31INSTRUCT8B-005 Llama 3.1 Instruct 8B tau2-bench Overall 16.4% Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA31INSTRUCT8B-006 Llama 3.1 Instruct 8B tau3-Banking Overall 1.6% Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA31INSTRUCT8B-007 Llama 3.1 Instruct 8B Terminal-Bench Hard Overall 0.8% Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA31INSTRUCT8B-008 Llama 3.1 Instruct 8B Terminal-Bench 2.1 Overall 1.5% Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA31INSTRUCT8B-009 Llama 3.1 Instruct 8B CritPt Overall 0% Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA31INSTRUCT8B-010 Llama 3.1 Instruct 8B AA-Omniscience Overall -30.3 Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA31INSTRUCT8B-011 Llama 3.1 Instruct 8B AA-Omniscience Accuracy 8.1% Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA31INSTRUCT8B-012 Llama 3.1 Instruct 8B IFBench Overall 28.6% Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA31INSTRUCT8B-013 Llama 3.1 Instruct 8B GDPval-AA Average Normalized Score 0% Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA31INSTRUCT8B-014 Llama 3.1 Instruct 8B AA-LCR Overall 15.7% Unknown Primary source META-LLAMA31INSTRUCT8B
BR-009LLAMA32INSTRUCT11BVISION-001 Llama 3.2 Instruct 11B (Vision) Artificial Analysis Intelligence Index Overall 3.3 Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT11BVISION-002 Llama 3.2 Instruct 11B (Vision) GPQA Diamond Accuracy 22.1% Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT11BVISION-003 Llama 3.2 Instruct 11B (Vision) Humanity's Last Exam No tools Overall 5.2% Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT11BVISION-004 Llama 3.2 Instruct 11B (Vision) SciCode Overall 11.2% Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT11BVISION-005 Llama 3.2 Instruct 11B (Vision) tau2-bench Overall 14.6% Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT11BVISION-006 Llama 3.2 Instruct 11B (Vision) Terminal-Bench Hard Overall 0.8% Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT11BVISION-007 Llama 3.2 Instruct 11B (Vision) CritPt Overall 0% Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT11BVISION-008 Llama 3.2 Instruct 11B (Vision) AA-Omniscience Overall -63.1 Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT11BVISION-009 Llama 3.2 Instruct 11B (Vision) AA-Omniscience Accuracy 10.2% Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT11BVISION-010 Llama 3.2 Instruct 11B (Vision) IFBench Overall 30.4% Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT11BVISION-011 Llama 3.2 Instruct 11B (Vision) MMMU-Pro Overall 29.3% Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT11BVISION-012 Llama 3.2 Instruct 11B (Vision) AA-LCR Overall 11.7% Unknown Primary source META-LLAMA32INSTRUCT11BVISION
BR-009LLAMA32INSTRUCT1B-001 Llama 3.2 Instruct 1B Artificial Analysis Intelligence Index Overall 1.1 Unknown Primary source META-LLAMA32INSTRUCT1B
BR-009LLAMA32INSTRUCT1B-002 Llama 3.2 Instruct 1B GPQA Diamond Accuracy 19.6% Unknown Primary source META-LLAMA32INSTRUCT1B
BR-009LLAMA32INSTRUCT1B-003 Llama 3.2 Instruct 1B Humanity's Last Exam No tools Overall 5.3% Unknown Primary source META-LLAMA32INSTRUCT1B
BR-009LLAMA32INSTRUCT1B-004 Llama 3.2 Instruct 1B SciCode Overall 1.7% Unknown Primary source META-LLAMA32INSTRUCT1B
BR-009LLAMA32INSTRUCT1B-005 Llama 3.2 Instruct 1B tau2-bench Overall 0% Unknown Primary source META-LLAMA32INSTRUCT1B
BR-009LLAMA32INSTRUCT1B-006 Llama 3.2 Instruct 1B Terminal-Bench Hard Overall 0% Unknown Primary source META-LLAMA32INSTRUCT1B
BR-009LLAMA32INSTRUCT1B-007 Llama 3.2 Instruct 1B CritPt Overall 0% Unknown Primary source META-LLAMA32INSTRUCT1B
BR-009LLAMA32INSTRUCT1B-008 Llama 3.2 Instruct 1B AA-Omniscience Overall -55.2 Unknown Primary source META-LLAMA32INSTRUCT1B
BR-009LLAMA32INSTRUCT1B-009 Llama 3.2 Instruct 1B AA-Omniscience Accuracy 6.9% Unknown Primary source META-LLAMA32INSTRUCT1B
BR-009LLAMA32INSTRUCT1B-010 Llama 3.2 Instruct 1B IFBench Overall 22.8% Unknown Primary source META-LLAMA32INSTRUCT1B
BR-009LLAMA32INSTRUCT1B-011 Llama 3.2 Instruct 1B AA-LCR Overall 5% Unknown Primary source META-LLAMA32INSTRUCT1B
BR-009LLAMA32INSTRUCT3B-001 Llama 3.2 Instruct 3B Artificial Analysis Intelligence Index Overall 4.2 Unknown Primary source META-LLAMA32INSTRUCT3B
BR-009LLAMA32INSTRUCT3B-002 Llama 3.2 Instruct 3B GPQA Diamond Accuracy 25.5% Unknown Primary source META-LLAMA32INSTRUCT3B
BR-009LLAMA32INSTRUCT3B-003 Llama 3.2 Instruct 3B Humanity's Last Exam No tools Overall 5.2% Unknown Primary source META-LLAMA32INSTRUCT3B
BR-009LLAMA32INSTRUCT3B-004 Llama 3.2 Instruct 3B SciCode Overall 5.2% Unknown Primary source META-LLAMA32INSTRUCT3B
BR-009LLAMA32INSTRUCT3B-005 Llama 3.2 Instruct 3B tau2-bench Overall 21.1% Unknown Primary source META-LLAMA32INSTRUCT3B
BR-009LLAMA32INSTRUCT3B-006 Llama 3.2 Instruct 3B IFBench Overall 26.2% Unknown Primary source META-LLAMA32INSTRUCT3B
BR-009LLAMA32INSTRUCT3B-007 Llama 3.2 Instruct 3B AA-LCR Overall 2% Unknown Primary source META-LLAMA32INSTRUCT3B
BR-009LLAMA32INSTRUCT90BVISION-001 Llama 3.2 Instruct 90B (Vision) Artificial Analysis Intelligence Index Overall 6.2 Unknown Primary source META-LLAMA32INSTRUCT90BVISION
BR-009LLAMA32INSTRUCT90BVISION-002 Llama 3.2 Instruct 90B (Vision) GPQA Diamond Accuracy 43.2% Unknown Primary source META-LLAMA32INSTRUCT90BVISION
BR-009LLAMA32INSTRUCT90BVISION-003 Llama 3.2 Instruct 90B (Vision) Humanity's Last Exam No tools Overall 4.9% Unknown Primary source META-LLAMA32INSTRUCT90BVISION
BR-009LLAMA32INSTRUCT90BVISION-004 Llama 3.2 Instruct 90B (Vision) SciCode Overall 24% Unknown Primary source META-LLAMA32INSTRUCT90BVISION
BR-009LLAMA32INSTRUCT90BVISION-005 Llama 3.2 Instruct 90B (Vision) MMMU-Pro Overall 39.5% Unknown Primary source META-LLAMA32INSTRUCT90BVISION
BR-009LLAMA33INSTRUCT70B-001 Llama 3.3 Instruct 70B Artificial Analysis Intelligence Index Overall 9.4 Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA33INSTRUCT70B-002 Llama 3.3 Instruct 70B GPQA Diamond Accuracy 49.8% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA33INSTRUCT70B-003 Llama 3.3 Instruct 70B Humanity's Last Exam No tools Overall 4% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA33INSTRUCT70B-004 Llama 3.3 Instruct 70B SciCode Overall 26% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA33INSTRUCT70B-005 Llama 3.3 Instruct 70B tau2-bench Overall 26.6% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA33INSTRUCT70B-006 Llama 3.3 Instruct 70B tau3-Banking Overall 1% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA33INSTRUCT70B-007 Llama 3.3 Instruct 70B Terminal-Bench Hard Overall 3% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA33INSTRUCT70B-008 Llama 3.3 Instruct 70B Terminal-Bench 2.1 Overall 4.9% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA33INSTRUCT70B-009 Llama 3.3 Instruct 70B CritPt Overall 0% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA33INSTRUCT70B-010 Llama 3.3 Instruct 70B AA-Omniscience Overall -51.9 Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA33INSTRUCT70B-011 Llama 3.3 Instruct 70B AA-Omniscience Accuracy 17.9% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA33INSTRUCT70B-012 Llama 3.3 Instruct 70B IFBench Overall 47.1% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA33INSTRUCT70B-013 Llama 3.3 Instruct 70B ITBench SRE Overall 0.6% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA33INSTRUCT70B-014 Llama 3.3 Instruct 70B GDPval-AA Average Normalized Score 0% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA33INSTRUCT70B-015 Llama 3.3 Instruct 70B AA-LCR Overall 15% Unknown Primary source META-LLAMA33INSTRUCT70B
BR-009LLAMA3INSTRUCT70B-001 Llama 3 Instruct 70B Artificial Analysis Intelligence Index Overall 3.5 Unknown Primary source META-LLAMA3INSTRUCT70B
BR-009LLAMA3INSTRUCT70B-002 Llama 3 Instruct 70B GPQA Diamond Accuracy 37.9% Unknown Primary source META-LLAMA3INSTRUCT70B
BR-009LLAMA3INSTRUCT70B-003 Llama 3 Instruct 70B Humanity's Last Exam No tools Overall 4.4% Unknown Primary source META-LLAMA3INSTRUCT70B