Frontier Log

Methodology

Sources

Every event and every score comes from the lab's own official announcement: its news or blog post, or a system or model card the launch post links. Each event links its source post. When a lab takes a post down, the event keeps the original link and adds an archived copy.

Labs covered

What counts as an event

An event is something a lab shipped or decided that changes what people can do with AI, or how the lab operates: a model, a capability, a product, or a policy or corporate move. Customer stories, tutorials, conferences, small feature or pricing changes and most research papers are left out.

Each event has one of three levels of importance:

Before ChatGPT (30 November 2022), the timeline holds milestones and major events only.

Dates

An event's date is the publication date shown on its source post. A post without a full date (day, month and year) is not used. An announcement and a later release are two events, each dated by its own post. A few older posts show only the date they were last updated; their events carry that date.

Benchmark scores

Each score is one a lab reports for its own model, in the launch post or a card it links. Scores a lab prints for other labs' models are left out, as are values that could only be read off a bar or an axis.

Verification

Every score is read from its source twice, independently, and published only when the two reads match exactly; a third read settles any mismatch. A person then checks each score against its source. The Human-verified column shows “yes” once they have, and “not yet” until then.

An event's source, date and lab come straight from its post. Its title, description, importance and tags are drafted from the post and checked by a person before publishing.

Corrections

Report a wrong date, title, source, tag or score through the API's feedback endpoint, or on X to @paradite_. A corrected event keeps its page address.

Citing

Cite the event page, with the lab's post alongside it:

Claude 3 family (Anthropic, 2024-03-04). Frontier Log. https://frontierlog.ai/event/2024-03-04-claude-3-family

© Frontier Log, all rights reserved. For rights or commercial use: zhuliangg11@gmail.com or @paradite_ on X.