Frontier Log

LongCat-2.5 on Humanity’s Last Exam

Changed by Meituan on

Removed the old version

Meituan changed the footnote on LongCat-2.5’s 63.1 on Humanity’s Last Exam with tools. Its model card said the score was on the text-only subset until Nov 9. From Nov 10 it says the full set, and the launch post now says the same. The score stayed at 63.1, and neither page notes the edit.

LongCat-2.5’s HLE Footnote Changed. Humanity's Last Exam: LongCat-2.5 Text-only subset 63.1% before and Full set 63.1% after.

Download image

Before and after

Before Footnote 5 in LongCat-2.5’s model card, Nov 9
Before: Footnote 5 in LongCat-2.5’s model card, Nov 9
After Footnote 5 in LongCat-2.5’s model card, Nov 10
After: Footnote 5 in LongCat-2.5’s model card, Nov 10

All benchmark corrections