| 3871 | BR-008DEEPSEEKCODERV2LITEINSTRUCT-003 |
DeepSeek Coder V2 Lite Instruct |
Humanity's Last Exam No tools |
Overall |
5.3% |
Unknown |
Primary source ↗
|
DPSK-DEEPSEEKCODERV2LITEINSTRUCT |
| 3252 | BR-008DEEPSEEKCODERV2LITEINSTRUCT-004 |
DeepSeek Coder V2 Lite Instruct |
SciCode |
Overall |
13.9% |
Unknown |
Primary source ↗
|
DPSK-DEEPSEEKCODERV2LITEINSTRUCT |
| 3725 | BR-008DEEPSEEKV25DEC24-001 |
DeepSeek-V2.5 (Dec '24) |
Artificial Analysis Intelligence Index |
Overall |
6.8 |
Unknown |
Primary source ↗
|
DPSK-DEEPSEEKV25DEC24 |
| 2146 | BR-010KIMIK2THINKING-001 |
Kimi K2 Thinking |
Artificial Analysis Intelligence Index |
Overall |
32.7 |
Unknown |
Primary source ↗
|
KIMI-KIMIK2THINKING |
| 305 | BR-010KIMIK2THINKING-002 |
Kimi K2 Thinking |
GPQA Diamond |
Accuracy |
83.8% |
Unknown |
Primary source ↗
|
KIMI-KIMIK2THINKING |
| 2758 | BR-010KIMIK2THINKING-003 |
Kimi K2 Thinking |
Humanity's Last Exam No tools |
Overall |
22.3% |
Unknown |
Primary source ↗
|
KIMI-KIMIK2THINKING |
| 1617 | BR-010KIMIK2THINKING-004 |
Kimi K2 Thinking |
SciCode |
Overall |
42.4% |
Unknown |
Primary source ↗
|
KIMI-KIMIK2THINKING |
| 91 | BR-010KIMIK2THINKING-005 |
Kimi K2 Thinking |
tau2-bench |
Overall |
93% |
Unknown |
Primary source ↗
|
KIMI-KIMIK2THINKING |
| 2235 | BR-010KIMIK2THINKING-006 |
Kimi K2 Thinking |
Terminal-Bench Hard |
Overall |
31.1% |
Unknown |
Primary source ↗
|
KIMI-KIMIK2THINKING |
| 4212 | BR-010KIMIK2THINKING-007 |
Kimi K2 Thinking |
CritPt |
Overall |
2.6% |
Unknown |
Primary source ↗
|
KIMI-KIMIK2THINKING |
| 4744 | BR-010KIMIK2THINKING-008 |
Kimi K2 Thinking |
AA-Omniscience |
Overall |
-20.5 |
Unknown |
Primary source ↗
|
KIMI-KIMIK2THINKING |
| 2292 | BR-010KIMIK2THINKING-009 |
Kimi K2 Thinking |
AA-Omniscience |
Accuracy |
30% |
Unknown |
Primary source ↗
|
KIMI-KIMIK2THINKING |
| 760 | BR-010KIMIK2THINKING-010 |
Kimi K2 Thinking |
IFBench |
Overall |
68.1% |
Unknown |
Primary source ↗
|
KIMI-KIMIK2THINKING |
| 824 | BR-010KIMIK2THINKING-011 |
Kimi K2 Thinking |
AA-LCR |
Overall |
66.3% |
Unknown |
Primary source ↗
|
KIMI-KIMIK2THINKING |
| 3778 | BR-018OLMO332BTHINK-001 |
Olmo 3 32B Think |
Artificial Analysis Intelligence Index |
Overall |
6.4 |
Unknown |
Primary source ↗
|
AI2-OLMO332BTHINK |
| 984 | BR-018OLMO332BTHINK-002 |
Olmo 3 32B Think |
GPQA Diamond |
Accuracy |
61% |
Unknown |
Primary source ↗
|
AI2-OLMO332BTHINK |
| 3826 | BR-018OLMO332BTHINK-003 |
Olmo 3 32B Think |
Humanity's Last Exam No tools |
Overall |
5.9% |
Unknown |
Primary source ↗
|
AI2-OLMO332BTHINK |
| 2365 | BR-018OLMO332BTHINK-004 |
Olmo 3 32B Think |
SciCode |
Overall |
28.6% |
Unknown |
Primary source ↗
|
AI2-OLMO332BTHINK |
| 4917 | BR-018OLMO332BTHINK-005 |
Olmo 3 32B Think |
tau2-bench |
Overall |
0% |
Unknown |
Primary source ↗
|
AI2-OLMO332BTHINK |
| 4300 | BR-018OLMO332BTHINK-006 |
Olmo 3 32B Think |
Terminal-Bench Hard |
Overall |
1.5% |
Unknown |
Primary source ↗
|
AI2-OLMO332BTHINK |
| 4918 | BR-018OLMO332BTHINK-007 |
Olmo 3 32B Think |
CritPt |
Overall |
0% |
Unknown |
Primary source ↗
|
AI2-OLMO332BTHINK |
| 4919 | BR-018OLMO332BTHINK-008 |
Olmo 3 32B Think |
AA-Omniscience |
Overall |
-58.4 |
Unknown |
Primary source ↗
|
AI2-OLMO332BTHINK |
| 3220 | BR-018OLMO332BTHINK-009 |
Olmo 3 32B Think |
AA-Omniscience |
Accuracy |
14.5% |
Unknown |
Primary source ↗
|
AI2-OLMO332BTHINK |
| 1334 | BR-018OLMO332BTHINK-010 |
Olmo 3 32B Think |
IFBench |
Overall |
49.1% |
Unknown |
Primary source ↗
|
AI2-OLMO332BTHINK |
| 4920 | BR-018OLMO332BTHINK-011 |
Olmo 3 32B Think |
AA-LCR |
Overall |
0% |
Unknown |
Primary source ↗
|
AI2-OLMO332BTHINK |
| 4236 | BR-023DEEPHERMES3LLAMA318BPREVIEW-001 |
DeepHermes 3 - Llama-3.1 8B Preview |
Artificial Analysis Intelligence Index |
Overall |
2.3 |
Unknown |
Primary source ↗
|
NOUS-DEEPHERMES3LLAMA318BPREVIEW |
| 2468 | BR-023DEEPHERMES3LLAMA318BPREVIEW-002 |
DeepHermes 3 - Llama-3.1 8B Preview |
GPQA Diamond |
Accuracy |
27% |
Unknown |
Primary source ↗
|
NOUS-DEEPHERMES3LLAMA318BPREVIEW |
| 4032 | BR-023DEEPHERMES3LLAMA318BPREVIEW-003 |
DeepHermes 3 - Llama-3.1 8B Preview |
Humanity's Last Exam No tools |
Overall |
4.3% |
Unknown |
Primary source ↗
|
NOUS-DEEPHERMES3LLAMA318BPREVIEW |
| 3564 | BR-023DEEPHERMES3LLAMA318BPREVIEW-004 |
DeepHermes 3 - Llama-3.1 8B Preview |
SciCode |
Overall |
9.1% |
Unknown |
Primary source ↗
|
NOUS-DEEPHERMES3LLAMA318BPREVIEW |
| 3242 | BR-024SOLARPRO3-001 |
Solar Pro 3 |
Artificial Analysis Intelligence Index |
Overall |
14.1 |
Unknown |
Primary source ↗
|
UPSTG-SOLARPRO3 |
| 620 | BR-024SOLARPRO3-002 |
Solar Pro 3 |
GPQA Diamond |
Accuracy |
72.4% |
Unknown |
Primary source ↗
|
UPSTG-SOLARPRO3 |
| 3498 | BR-024SOLARPRO3-003 |
Solar Pro 3 |
Humanity's Last Exam No tools |
Overall |
10.1% |
Unknown |
Primary source ↗
|
UPSTG-SOLARPRO3 |
| 2628 | BR-024SOLARPRO3-004 |
Solar Pro 3 |
SciCode |
Overall |
24.7% |
Unknown |
Primary source ↗
|
UPSTG-SOLARPRO3 |
| 233 | BR-024SOLARPRO3-005 |
Solar Pro 3 |
tau2-bench |
Overall |
86.3% |
Unknown |
Primary source ↗
|
UPSTG-SOLARPRO3 |
| 3643 | BR-024SOLARPRO3-006 |
Solar Pro 3 |
tau3-Banking |
Overall |
8% |
Unknown |
Primary source ↗
|
UPSTG-SOLARPRO3 |
| 3669 | BR-024SOLARPRO3-007 |
Solar Pro 3 |
Terminal-Bench Hard |
Overall |
7.6% |
Unknown |
Primary source ↗
|
UPSTG-SOLARPRO3 |
| 3375 | BR-024SOLARPRO3-008 |
Solar Pro 3 |
Terminal-Bench 2.1 |
Overall |
12% |
Unknown |
Primary source ↗
|
UPSTG-SOLARPRO3 |
| 5011 | BR-024SOLARPRO3-009 |
Solar Pro 3 |
CritPt |
Overall |
0% |
Unknown |
Primary source ↗
|
UPSTG-SOLARPRO3 |
| 5012 | BR-024SOLARPRO3-010 |
Solar Pro 3 |
AA-Omniscience |
Overall |
-53.8 |
Unknown |
Primary source ↗
|
UPSTG-SOLARPRO3 |
| 3002 | BR-024SOLARPRO3-011 |
Solar Pro 3 |
AA-Omniscience |
Accuracy |
18.1% |
Unknown |
Primary source ↗
|
UPSTG-SOLARPRO3 |
| 661 | BR-024SOLARPRO3-012 |
Solar Pro 3 |
IFBench |
Overall |
71.2% |
Unknown |
Primary source ↗
|
UPSTG-SOLARPRO3 |
| 5013 | BR-024SOLARPRO3-013 |
Solar Pro 3 |
GDPval-AA |
Average Normalized Score |
0% |
Unknown |
Primary source ↗
|
UPSTG-SOLARPRO3 |
| 2469 | BR-024SOLARPRO3-014 |
Solar Pro 3 |
AA-LCR |
Overall |
27% |
Unknown |
Primary source ↗
|
UPSTG-SOLARPRO3 |
| 2576 | BR-026STEP35FLASH-001 |
Step 3.5 Flash |
Artificial Analysis Intelligence Index |
Overall |
25.5 |
Unknown |
Primary source ↗
|
STPFN-STEP35FLASH |
| 321 | BR-026STEP35FLASH-002 |
Step 3.5 Flash |
GPQA Diamond |
Accuracy |
83.1% |
Unknown |
Primary source ↗
|
STPFN-STEP35FLASH |
| 2937 | BR-026STEP35FLASH-003 |
Step 3.5 Flash |
Humanity's Last Exam No tools |
Overall |
19.1% |
Unknown |
Primary source ↗
|
STPFN-STEP35FLASH |
| 1703 | BR-026STEP35FLASH-004 |
Step 3.5 Flash |
SciCode |
Overall |
40.4% |
Unknown |
Primary source ↗
|
STPFN-STEP35FLASH |
| 62 | BR-026STEP35FLASH-005 |
Step 3.5 Flash |
tau2-bench |
Overall |
94.4% |
Unknown |
Primary source ↗
|
STPFN-STEP35FLASH |
| 2451 | BR-026STEP35FLASH-006 |
Step 3.5 Flash |
Terminal-Bench Hard |
Overall |
27.3% |
Unknown |
Primary source ↗
|
STPFN-STEP35FLASH |
| 4219 | BR-026STEP35FLASH-007 |
Step 3.5 Flash |
CritPt |
Overall |
2.5% |
Unknown |
Primary source ↗
|
STPFN-STEP35FLASH |
| 5021 | BR-026STEP35FLASH-008 |
Step 3.5 Flash |
AA-Omniscience |
Overall |
-40.9 |
Unknown |
Primary source ↗
|
STPFN-STEP35FLASH |
| 2670 | BR-026STEP35FLASH-009 |
Step 3.5 Flash |
AA-Omniscience |
Accuracy |
23.9% |
Unknown |
Primary source ↗
|
STPFN-STEP35FLASH |
| 874 | BR-026STEP35FLASH-010 |
Step 3.5 Flash |
IFBench |
Overall |
64.6% |
Unknown |
Primary source ↗
|
STPFN-STEP35FLASH |
| 1591 | BR-026STEP35FLASH-011 |
Step 3.5 Flash |
AA-LCR |
Overall |
43% |
Unknown |
Primary source ↗
|
STPFN-STEP35FLASH |
| 5123 | BR-051TRINITYLARGETHINKING-008 |
Trinity Large Thinking |
AA-Omniscience |
Overall |
-44.2 |
Unknown |
Primary source ↗
|
ARCEE-TRINITYLARGETHINKING |
| 2729 | BR-051TRINITYLARGETHINKING-009 |
Trinity Large Thinking |
AA-Omniscience |
Accuracy |
22.8% |
Unknown |
Primary source ↗
|
ARCEE-TRINITYLARGETHINKING |
| 1107 | BR-051TRINITYLARGETHINKING-010 |
Trinity Large Thinking |
IFBench |
Overall |
56.3% |
Unknown |
Primary source ↗
|
ARCEE-TRINITYLARGETHINKING |
| 2134 | BR-051TRINITYLARGETHINKING-011 |
Trinity Large Thinking |
AA-LCR |
Overall |
33% |
Unknown |
Primary source ↗
|
ARCEE-TRINITYLARGETHINKING |
| 3521 | BR-052FALCONH1R7B-001 |
Falcon-H1R-7B |
Artificial Analysis Intelligence Index |
Overall |
9.8 |
Unknown |
Primary source ↗
|
TIIUA-FALCONH1R7B |
| 828 | BR-052FALCONH1R7B-002 |
Falcon-H1R-7B |
GPQA Diamond |
Accuracy |
66.1% |
Unknown |
Primary source ↗
|
TIIUA-FALCONH1R7B |
| 3454 | BR-052FALCONH1R7B-003 |
Falcon-H1R-7B |
Humanity's Last Exam No tools |
Overall |
10.8% |
Unknown |
Primary source ↗
|
TIIUA-FALCONH1R7B |
| 2619 | BR-052FALCONH1R7B-004 |
Falcon-H1R-7B |
SciCode |
Overall |
24.9% |
Unknown |
Primary source ↗
|
TIIUA-FALCONH1R7B |
| 2427 | BR-052FALCONH1R7B-005 |
Falcon-H1R-7B |
tau2-bench |
Overall |
27.8% |
Unknown |
Primary source ↗
|
TIIUA-FALCONH1R7B |
| 4246 | BR-052FALCONH1R7B-006 |
Falcon-H1R-7B |
Terminal-Bench Hard |
Overall |
2.3% |
Unknown |
Primary source ↗
|
TIIUA-FALCONH1R7B |
| 4454 | BR-052FALCONH1R7B-007 |
Falcon-H1R-7B |
CritPt |
Overall |
0.3% |
Unknown |
Primary source ↗
|
TIIUA-FALCONH1R7B |
| 5124 | BR-052FALCONH1R7B-008 |
Falcon-H1R-7B |
AA-Omniscience |
Overall |
-62.1 |
Unknown |
Primary source ↗
|
TIIUA-FALCONH1R7B |
| 3243 | BR-052FALCONH1R7B-009 |
Falcon-H1R-7B |
AA-Omniscience |
Accuracy |
14.1% |
Unknown |
Primary source ↗
|
TIIUA-FALCONH1R7B |
| 1169 | BR-052FALCONH1R7B-010 |
Falcon-H1R-7B |
IFBench |
Overall |
54.4% |
Unknown |
Primary source ↗
|
TIIUA-FALCONH1R7B |
| 3596 | BR-052FALCONH1R7B-011 |
Falcon-H1R-7B |
AA-LCR |
Overall |
8.7% |
Unknown |
Primary source ↗
|
TIIUA-FALCONH1R7B |
| 3959 | BR-002S3-001 |
Claude 3 Sonnet |
Artificial Analysis Intelligence Index |
Overall |
4.7 |
Unknown |
Primary source ↗
|
ANTHR-S3 |
| 1720 | BR-002S3-002 |
Claude 3 Sonnet |
GPQA Diamond |
Accuracy |
40% |
Unknown |
Primary source ↗
|
ANTHR-S3 |
| 4086 | BR-002S3-003 |
Claude 3 Sonnet |
Humanity's Last Exam No tools |
Overall |
3.8% |
Unknown |
Primary source ↗
|
ANTHR-S3 |
| 2715 | BR-002S3-004 |
Claude 3 Sonnet |
SciCode |
Overall |
22.9% |
Unknown |
Primary source ↗
|
ANTHR-S3 |
| 3532 | BR-007QWEN25INSTRUCT72B-001 |
Qwen2.5 Instruct 72B |
Artificial Analysis Intelligence Index |
Overall |
9.6 |
Unknown |
Primary source ↗
|
QWEN-QWEN25INSTRUCT72B |
| 1333 | BR-007QWEN25INSTRUCT72B-002 |
Qwen2.5 Instruct 72B |
GPQA Diamond |
Accuracy |
49.1% |
Unknown |
Primary source ↗
|
QWEN-QWEN25INSTRUCT72B |
| 4034 | BR-007QWEN25INSTRUCT72B-003 |
Qwen2.5 Instruct 72B |
Humanity's Last Exam No tools |
Overall |
4.2% |
Unknown |
Primary source ↗
|
QWEN-QWEN25INSTRUCT72B |
| 2480 | BR-007QWEN25INSTRUCT72B-004 |
Qwen2.5 Instruct 72B |
SciCode |
Overall |
26.7% |
Unknown |
Primary source ↗
|
QWEN-QWEN25INSTRUCT72B |
| 2035 | BR-007QWEN25INSTRUCT72B-005 |
Qwen2.5 Instruct 72B |
tau2-bench |
Overall |
34.5% |
Unknown |
Primary source ↗
|
QWEN-QWEN25INSTRUCT72B |
| 3990 | BR-007QWEN25INSTRUCT72B-006 |
Qwen2.5 Instruct 72B |
Terminal-Bench Hard |
Overall |
4.5% |
Unknown |
Primary source ↗
|
QWEN-QWEN25INSTRUCT72B |
| 4528 | BR-007QWEN25INSTRUCT72B-007 |
Qwen2.5 Instruct 72B |
CritPt |
Overall |
0% |
Unknown |
Primary source ↗
|
QWEN-QWEN25INSTRUCT72B |
| 4529 | BR-007QWEN25INSTRUCT72B-008 |
Qwen2.5 Instruct 72B |
AA-Omniscience |
Overall |
-52.2 |
Unknown |
Primary source ↗
|
QWEN-QWEN25INSTRUCT72B |
| 3027 | BR-007QWEN25INSTRUCT72B-009 |
Qwen2.5 Instruct 72B |
AA-Omniscience |
Accuracy |
17.6% |
Unknown |
Primary source ↗
|
QWEN-QWEN25INSTRUCT72B |
| 1909 | BR-007QWEN25INSTRUCT72B-010 |
Qwen2.5 Instruct 72B |
IFBench |
Overall |
36.9% |
Unknown |
Primary source ↗
|
QWEN-QWEN25INSTRUCT72B |
| 2875 | BR-007QWEN25INSTRUCT72B-011 |
Qwen2.5 Instruct 72B |
AA-LCR |
Overall |
20.3% |
Unknown |
Primary source ↗
|
QWEN-QWEN25INSTRUCT72B |
| 3404 | BR-007QWEN332B-001 |
Qwen3 32B |
Artificial Analysis Intelligence Index |
Overall |
11.5 |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |
| 803 | BR-007QWEN332B-002 |
Qwen3 32B |
GPQA Diamond |
Accuracy |
66.8% |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |
| 3615 | BR-007QWEN332B-003 |
Qwen3 32B |
Humanity's Last Exam No tools |
Overall |
8.3% |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |
| 1989 | BR-007QWEN332B-004 |
Qwen3 32B |
SciCode |
Overall |
35.4% |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |
| 2301 | BR-007QWEN332B-005 |
Qwen3 32B |
tau2-bench |
Overall |
29.8% |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |
| 3863 | BR-007QWEN332B-006 |
Qwen3 32B |
tau3-Banking |
Overall |
5.4% |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |
| 4167 | BR-007QWEN332B-007 |
Qwen3 32B |
Terminal-Bench Hard |
Overall |
3% |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |
| 3886 | BR-007QWEN332B-008 |
Qwen3 32B |
Terminal-Bench 2.1 |
Overall |
5.2% |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |
| 4428 | BR-007QWEN332B-009 |
Qwen3 32B |
CritPt |
Overall |
0.3% |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |
| 4573 | BR-007QWEN332B-010 |
Qwen3 32B |
AA-Omniscience |
Overall |
-50.5 |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |
| 3051 | BR-007QWEN332B-011 |
Qwen3 32B |
AA-Omniscience |
Accuracy |
17.3% |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |
| 1937 | BR-007QWEN332B-012 |
Qwen3 32B |
IFBench |
Overall |
36.3% |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |
| 4574 | BR-007QWEN332B-013 |
Qwen3 32B |
GDPval-AA |
Average Normalized Score |
0% |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |
| 4575 | BR-007QWEN332B-014 |
Qwen3 32B |
AA-LCR |
Overall |
0% |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |
| 3598 | BR-007QWEN332B-015 |
Qwen3 32B |
Artificial Analysis Intelligence Index |
Overall |
8.6 |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |
| 1202 | BR-007QWEN332B-016 |
Qwen3 32B |
GPQA Diamond |
Accuracy |
53.5% |
Unknown |
Primary source ↗
|
QWEN-QWEN332B |