Frontier Log

MetaModel

Muse Spark

Made by
Meta
Released
Announced in
Introducing Muse Spark: Scaling Towards Personal Superintelligenceai.meta.com
Event
Muse Spark
API record
/api/v1/models/muse-spark

Benchmark results

BenchmarkScoreSource check
Humanity's Last ExamNo tools · thinking mode; full 2,500-question set42.8%
CorroboratedThe same number is printed in 1 other lab document: 1
contemplating mode: multiple agents reasoning in parallel, refined and aggregated · parallel test-time compute50.2%
CheckedA person checked this number against its source on 20 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
Humanity's Last ExamWith tools · thinking mode; bash and browser tools50.4%
CorroboratedThe same number is printed in 2 other lab documents: 1 2
contemplating mode: multiple agents reasoning in parallel; bash and browser tools · parallel test-time compute58.4%
CheckedA person checked this number against its source on 20 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
SWE-bench Verifiedthinking mode; bash and file-edit tools; averaged over 15 attempts; tests fixed in 5 tasks77.4%
CheckedA person checked this number against its source on 20 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
SWE-bench Prothinking mode; public set; bash and file-edit tools; averaged over 4 attempts52.4%
CheckedA person checked this number against its source on 20 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
reported later, in Introducing Muse Spark 1.155.0%
CorroboratedThe same number is printed in 1 other lab document: 1
GPQA Diamondthinking mode; averaged over 4 runs89.5%
CheckedA person checked this number against its source on 20 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
ARC-AGI-2thinking mode; public set42.5%
CheckedA person checked this number against its source on 20 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
Terminal-Bench 2.0thinking mode; bash-only harness; averaged over 15 attempts; one task test script fixed59.0%
CorroboratedThe same number is printed in 1 other lab document: 1
DeepSWE v1.1reported later, in Introducing Muse Spark 1.110.0%
CorroboratedThe same number is printed in 1 other lab document: 1
Terminal-Bench 2.1reported later, in Introducing Muse Spark 1.167.3%
CorroboratedThe same number is printed in 1 other lab document: 1
OSWorld-Verifiedreported later, in Introducing Muse Spark 1.153.3%
CorroboratedThe same number is printed in 1 other lab document: 1
MCP Atlasrun by Scale AI · reported later, in Introducing Muse Spark 1.182.2%
CheckedA person checked this number against its source on 20 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
Sources

Reported by Meta

Events

Stories

All models