Models
|
Benchmarks
|
Organizations
|
Recent Records
|
Sources
|
Documentation
Muse Spark 1.1 on SWE-bench Verified Hard
BENCHMARK RECORD: BR-009MS11-001
Canonical URL: https://www.benchmarkregistry.org/records/BR-009MS11-001
Benchmark scores may depend on benchmark version, evaluation configuration, model snapshot, and evaluator. Records sharing a benchmark name are not necessarily directly comparable.
Record
Record Identifier BR-009MS11-001Record Status ACTIVE Created At 2026-07-12T17:12:04.202Z Updated At 2026-07-12T17:12:04.202Z Superseded By Not applicable Model
Official Model Name Muse Spark 1.1 Model Identifier META-MS11Organization Meta Model Family MS11 Model Number Unknown Tier Unknown Model Snapshot Unknown Snapshot Label Unknown Provider Model Identifier UnknownSnapshot Date Unknown Benchmark
Benchmark Family SWE-bench Benchmark Version or Variant Verified Hard Benchmark Version Reference swe-bench/verified-hardBenchmark Organization Princeton University Benchmark Status ACTIVE Result
Metric Resolved Score 24/42 Numeric Score 57.1 Evaluation Date Unknown Reported Date Unknown Evaluation Context
Configuration Reference Unspecified Shots Unknown Reasoning Mode Unknown Reasoning Effort Unknown Pass Count Unknown Agent Scaffold Unknown Evaluation Harness Unknown Temperature Unknown Top P Unknown Max Output Tokens Unknown System Prompt Description Unknown Additional Configuration None reported Source and Reporting
Primary Source Muse Spark 1.1 Evaluation Report ↗ Source Type SYSTEM_CARD Publisher Meta Source Published Date Unknown Source Accessed At 2026-07-12T17:11:42.808Z Report Type PROVIDER Evaluator Meta Evaluator Type MODEL_PROVIDER Provenance
Record Status
This record is ACTIVE . Registry identifiers remain reserved when record status changes.