BENCHMARK REGISTRY
Public Artificial Intelligence Benchmark Records Database
Search operators

brand: benchmark: record: model: metric: date: org:

Separate values with commas, or alternatives with uppercase OR. Example: brand:Meta, Anthropic benchmark:GPQA

IFBench

Benchmark Family
IFBench
Organization
Allen Institute for AI
Status
ACTIVE

Versions / Variants

Version or VariantReferenceStatusRecords
Unspecifiedifbench/defaultACTIVE358

Table may be scrolled horizontally on narrow displays.

Record No. Model Benchmark Metric Score Eval Date Source Model ID
BR-023HERMES4LLAMA31405B-010 Hermes 4 - Llama-3.1 405B IFBench Overall 32.7% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA31405B-021 Hermes 4 - Llama-3.1 405B IFBench Overall 34.8% Unknown Primary source NOUS-HERMES4LLAMA31405B
BR-023HERMES4LLAMA3170B-010 Hermes 4 - Llama-3.1 70B IFBench Overall 29% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-023HERMES4LLAMA3170B-021 Hermes 4 - Llama-3.1 70B IFBench Overall 31.3% Unknown Primary source NOUS-HERMES4LLAMA3170B
BR-024SOLAROPEN100B-010 Solar Open 100B IFBench Overall 57.7% Unknown Primary source UPSTG-SOLAROPEN100B
BR-024SOLARPRO2-010 Solar Pro 2 IFBench Overall 33.7% Unknown Primary source UPSTG-SOLARPRO2
BR-024SOLARPRO2-021 Solar Pro 2 IFBench Overall 37.1% Unknown Primary source UPSTG-SOLARPRO2
BR-024SOLARPRO3-012 Solar Pro 3 IFBench Overall 71.2% Unknown Primary source UPSTG-SOLARPRO3
BR-025JAMBA17LARGE-010 Jamba 1.7 Large IFBench Overall 35.2% Unknown Primary source AI21-JAMBA17LARGE
BR-025JAMBA17MINI-010 Jamba 1.7 Mini IFBench Overall 31.4% Unknown Primary source AI21-JAMBA17MINI
BR-025JAMBAREASONING3B-010 Jamba Reasoning 3B IFBench Overall 52.4% Unknown Primary source AI21-JAMBAREASONING3B
BR-026STEP35FLASH-010 Step 3.5 Flash IFBench Overall 64.6% Unknown Primary source STPFN-STEP35FLASH
BR-026STEP35FLASH2603-010 Step 3.5 Flash 2603 IFBench Overall 66.5% Unknown Primary source STPFN-STEP35FLASH2603
BR-026STEP37FLASH-012 Step 3.7 Flash IFBench Overall 67.3% Unknown Primary source STPFN-STEP37FLASH
BR-026STEP3VL10B-010 Step3 VL 10B IFBench Overall 50.2% Unknown Primary source STPFN-STEP3VL10B
BR-027PHI3MINIINSTRUCT38B-007 Phi-3 Mini Instruct 3.8B IFBench Overall 23.9% Unknown Primary source MSFT-PHI3MINIINSTRUCT38B
BR-027PHI4-010 Phi-4 IFBench Overall 23.5% Unknown Primary source MSFT-PHI4
BR-027PHI4MINIINSTRUCT-012 Phi-4 Mini Instruct IFBench Overall 21.1% Unknown Primary source MSFT-PHI4MINIINSTRUCT
BR-028K2THINKV2-012 K2 Think V2 IFBench Overall 62.8% Unknown Primary source MBZAI-K2THINKV2
BR-028K2V2-010 K2-V2 IFBench Overall 60.1% Unknown Primary source MBZAI-K2V2
BR-028K2V2-021 K2-V2 IFBench Overall 41% Unknown Primary source MBZAI-K2V2
BR-028K2V2-032 K2-V2 IFBench Overall 55.1% Unknown Primary source MBZAI-K2V2
BR-029JT35BFLASH-010 JT-35B-Flash IFBench Overall 42% Unknown Primary source CMOB-JT35BFLASH
BR-029JTMINI-010 JT-MINI IFBench Overall 36.7% Unknown Primary source CMOB-JTMINI
BR-030SARVAM105B-010 Sarvam 105B IFBench Overall 34.4% Unknown Primary source SRVM-SARVAM105B
BR-030SARVAM30B-010 Sarvam 30B IFBench Overall 26.5% Unknown Primary source SRVM-SARVAM30B
BR-030SARVAMM-010 Sarvam M IFBench Overall 31.8% Unknown Primary source SRVM-SARVAMM
BR-031MINICPM51B-010 MiniCPM5-1B IFBench Overall 49.3% Unknown Primary source OBMB-MINICPM51B
BR-031MINICPM51B-021 MiniCPM5-1B IFBench Overall 35.2% Unknown Primary source OBMB-MINICPM51B
BR-031MINICPMV4613B-012 MiniCPM-V 4.6 1.3B IFBench Overall 26.7% Unknown Primary source OBMB-MINICPMV4613B
BR-032APERTUS70BINSTRUCT-010 Apertus 70B Instruct IFBench Overall 25.9% Unknown Primary source SWAI-APERTUS70BINSTRUCT
BR-032APERTUS8BINSTRUCT-010 Apertus 8B Instruct IFBench Overall 22.4% Unknown Primary source SWAI-APERTUS8BINSTRUCT
BR-033DOUBAOSEEDCODE-010 Doubao Seed Code IFBench Overall 51.4% Unknown Primary source BDSD-DOUBAOSEEDCODE
BR-033SEEDOSS36BINSTRUCT-010 Seed-OSS-36B-Instruct IFBench Overall 41.9% Unknown Primary source BDSD-SEEDOSS36BINSTRUCT
BR-034TRI21BTHINK-010 Tri-21B-Think IFBench Overall 54.6% Unknown Primary source TRLN-TRI21BTHINK
BR-034TRI21BTHINKPREVIEW-010 Tri-21B-think Preview IFBench Overall 47.1% Unknown Primary source TRLN-TRI21BTHINKPREVIEW
BR-035HY3PREVIEW-010 Hy3-preview IFBench Overall 63.1% Unknown Primary source TCNT-HY3PREVIEW
BR-035HY3PREVIEW-021 Hy3-preview IFBench Overall 48% Unknown Primary source TCNT-HY3PREVIEW
BR-036ERNIE45300BA47B-010 ERNIE 4.5 300B A47B IFBench Overall 39.1% Unknown Primary source BAIDU-ERNIE45300BA47B
BR-036ERNIE50THINKINGPREVIEW-010 ERNIE 5.0 Thinking Preview IFBench Overall 41.4% Unknown Primary source BAIDU-ERNIE50THINKINGPREVIEW
BR-037APRIELV1515BTHINKER-010 Apriel-v1.5-15B-Thinker IFBench Overall 61.7% Unknown Primary source SVNW-APRIELV1515BTHINKER
BR-037APRIELV1615BTHINKER-010 Apriel-v1.6-15B-Thinker IFBench Overall 69.1% Unknown Primary source SVNW-APRIELV1615BTHINKER
BR-038REKAFLASH3-010 Reka Flash 3 IFBench Overall 30.4% Unknown Primary source REKA-REKAFLASH3
BR-039MIDMK25PRO-010 Mi:dm K 2.5 Pro IFBench Overall 49.3% Unknown Primary source KT-MIDMK25PRO
BR-039MIDMK25PROPREVIEW-009 Mi:dm K 2.5 Pro Preview IFBench Overall 45.6% Unknown Primary source KT-MIDMK25PROPREVIEW
BR-040KATCODERPROV1-012 KAT-Coder-Pro V1 IFBench Overall 68.4% Unknown Primary source KWAI-KATCODERPROV1
BR-040KATCODERPROV2-011 KAT Coder Pro V2 IFBench Overall 66.7% Unknown Primary source KWAI-KATCODERPROV2
BR-041MERCURY2-010 Mercury 2 IFBench Overall 69.8% Unknown Primary source INCPT-MERCURY2
BR-043HYPERCLOVAXSEEDTHINK32B-010 HyperCLOVA X SEED Think (32B) IFBench Overall 37.9% Unknown Primary source NAVER-HYPERCLOVAXSEEDTHINK32B
BR-044HYPERNOVA60B2605-012 HyperNova 60B 2605 IFBench Overall 66.5% Unknown Primary source MVSC-HYPERNOVA60B2605
BR-045INTELLECT3-010 INTELLECT-3 IFBench Overall 34% Unknown Primary source PRIME-INTELLECT3
BR-046NEXN2PRO-011 Nex-N2-Pro IFBench Overall 66.2% Unknown Primary source NEXAI-NEXN2PRO
BR-047LONGCATFLASHLITE-010 LongCat Flash Lite IFBench Overall 43.1% Unknown Primary source LCAT-LONGCATFLASHLITE
BR-048MOTIF2127BREASONING-010 Motif-2-12.7B-Reasoning IFBench Overall 57% Unknown Primary source MOTIF-MOTIF2127BREASONING
BR-049NANBEIGE413B-012 Nanbeige4.1-3B IFBench Overall 35.4% Unknown Primary source NANB-NANBEIGE413B
BR-051TRINITYLARGETHINKING-010 Trinity Large Thinking IFBench Overall 56.3% Unknown Primary source ARCEE-TRINITYLARGETHINKING
BR-052FALCONH1R7B-010 Falcon-H1R-7B IFBench Overall 54.4% Unknown Primary source TIIUA-FALCONH1R7B
BR-053COGITOV21-008 Cogito v2.1 IFBench Overall 46.3% Unknown Primary source DPCOG-COGITOV21