Frontier Log

Inkling on Humanity’s Last Exam

Changed by Thinking Machines on

Printed a new figureRemoved the old version

Thinking Machines’ model card for Inkling printed 30.0% on Humanity’s Last Exam, text only, on the day of release. About two hours after release the card printed 29.7%, the figure in the launch post. The same edit changed Inkling’s GPQA Diamond and Tau 3 Banking scores, and the card doesn’t note it.

Inkling’s HLE Score Changed After Release. Humanity's Last Exam: Inkling 30.0% before and 29.7% after.

Download image

Before and after

Before Inkling’s model card, Jul 15, 18:58 UTC
Before: Inkling’s model card, Jul 15, 18:58 UTC
After Inkling’s model card, Jul 15, 20:09 UTC
After: Inkling’s model card, Jul 15, 20:09 UTC

All benchmark corrections