Frontier Log

Inkling on GPQA Diamond

Changed by Thinking Machines on

Printed a new figureRemoved the old version

Thinking Machines’ model card for Inkling printed 87.9% on GPQA Diamond on the day of release. About two hours after release the card printed 87.2%, the figure in the launch post. The same edit changed Inkling’s Humanity’s Last Exam and Tau 3 Banking scores, and the card doesn’t note it.

Inkling’s GPQA Diamond Score Changed After Release. GPQA Diamond: Inkling 87.9% before and 87.2% after.

Download image

Before and after

Before Inkling’s model card, Jul 15, 18:58 UTC
Before: Inkling’s model card, Jul 15, 18:58 UTC
After Inkling’s model card, Jul 15, 20:09 UTC
After: Inkling’s model card, Jul 15, 20:09 UTC

All benchmark corrections