Frontier Log

Who Makes the Benchmarks AI Labs Report

Data and evaluation companies made 24% of the benchmarks AI labs reported at launch in late 2026, up from 4% in early 2025.

Four 100% stacked columns, one per half-year from January–June 2025 to July–October 2026, showing who made the benchmarks in AI labs' launch posts. Data and evaluation companies, in violet at the bottom, grow from 4% to 7%, 17% and 24%. Math and coding competitions, in amber at the top, shrink from 17% to 13%, 4% and 1%. AI labs take 29%, 23%, 25% and 20%, universities 36%, 37%, 38% and 27%, nonprofits and institutes 3% to 14% and other companies 6% to 15%.
Data and evaluation companies made 24% of the benchmarks AI labs reported in launch posts from July to October 2026, up from 4% from January to June 2025. Competitions fell from 17% to 1%. Each column counts every benchmark at least three labs report, once per launch. Download

AI labs show what a new model can do with scores on benchmarks, and other organisations make most of those benchmarks. Across 65 launch posts from eight labs since January 2025, data and evaluation companies made a growing share of the benchmarks the labs reported. That share rose from 4% in the first half of 2025 to 24% from July to October 2026. Benchmarks run by math and coding competitions fell from 17% to 1% over the same time.

Data companies' benchmarks spread

Scale AI says it provides "high-quality data and full-stack technologies that power the world's leading models" on its about page. It released SWE-bench Pro and MCP Atlas on Sep 19, 2025, and it made Humanity's Last Exam with the Center for AI Safety. In 2026 the labs also reported DeepSWE from Datacurve, Chartography from Surge AI and FrontierSWE from Proximal. They reported benchmarks from the evaluation companies Artificial Analysis and Vals AI and from the data company Mercor too.

All 12 launch posts from July to October 2026 reported at least one benchmark that a data or evaluation company made.

Two lines over four half-years. The share of benchmarks in AI labs' launch posts made by data and evaluation companies rises from 4% to 7%, 17% and 24%. The share made by math and coding competitions falls from 17% to 13%, 4% and 1%. The lines cross between late 2025 and early 2026.
These are the two creator types whose share changed most. The figures come from the same count as the columns above. Download

Competition-run benchmarks dropped out

In the first half of 2025, 12 of the 16 launch posts reported a benchmark that a competition runs: the AIME and HMMT math contests or Codeforces programming rounds. From July 2026, only one launch post did. DeepSeek's post for DeepSeek-V4.1-Flash on Sep 10 reported Codeforces.

Other benchmarks also draw on contest problems, such as LiveCodeBench, MathArena Apex and Google DeepMind's IMO-AnswerBench. They count under the universities and labs that made them.

Universities kept the largest share

Universities' share stayed between 36% and 38% until mid-2026 and was 27% from July, still the largest of any type. The AI labs' share fell from 29% in the first half of 2025 to 20% from July 2026. OpenAI made BrowseComp, and it made SWE-bench Verified with the authors of SWE-bench.

How we counted

Frontier Log's reporting inventory records every benchmark in 65 flagship launch posts from OpenAI, Anthropic, Google, DeepSeek, Qwen, Moonshot, MiniMax and Mistral. It also records the cards and reports each post links. We counted 72 benchmarks with 91 versions in all. At least three labs report each of them, in these posts or in other launches our data holds. Each benchmark counts once per launch.

We took each benchmark's makers from its paper's author affiliations or its release post. A benchmark whose makers are of several types counts equally to each type. IFEval comes from Google and Yale University, so it counts half to AI labs and half to universities.

We typed each maker other than a university from its own description of itself. Argonne National Laboratory, the Max Planck Institute for Intelligent Systems and Thoughtful Lab don't describe themselves on a page we could read, so we left them out of the types.

We also left out authors listed as independent, Harbor, the Terminal-Bench team's own framework, and ExploitGym's industry partners. Its paper limits their role to feedback, model access and help running some experiments. Agents' Last Exam lists 88 affiliations. The makers table quotes at least one of them for each type they add. We couldn't find the OpenAGI Research Foundation's own site, and a high school among them fits none of the types.

SWE-bench Multilingual's page names its authors, and their affiliations come from the SWE-smith paper the page asks readers to cite.

CreatorJan–Jun 2025Jul–Dec 2025Jan–Jun 2026Jul–Oct 2026
Data and evaluation companies4%7%17%24%
Math and coding competitions17%13%4%1%
AI labs29%23%25%20%
Universities36%37%38%27%
Nonprofits and institutes3%10%10%14%
Other companies11%9%6%15%
Launch posts16181912

Launches

ModelSources
MiniMax-01 (MiniMax-Text-01, MiniMax-VL-01)Launch post
DeepSeek-R1 (+ 6 DeepSeek-R1-Distill models)Launch postgithub.com
Kimi k1.5Launch post
Qwen2.5-MaxLaunch post
Gemini 2.0 Pro ExperimentalLaunch post
Claude 3.7 SonnetLaunch post
GPT-4.5Launch post
DeepSeek-V3-0324Launch post
Gemini 2.5 Pro Experimental (03-25)Launch post
OpenAI o3Launch postdeploymentsafety.openai.com
Qwen3-235B-A22BLaunch post
Gemini 2.5 Pro Preview (I/O edition)Launch post
Claude Opus 4Launch post
DeepSeek-R1-0528Launch posthuggingface.co
Gemini 2.5 Pro Preview 06-05Launch post
MiniMax-M1 (MiniMax-M1-40k, MiniMax-M1-80k)Launch post
Kimi K2 (Kimi-K2-Instruct, Kimi-K2-Base)Launch post
Qwen3-235B-A22B-Instruct-2507Launch post
Qwen3-235B-A22B-Thinking-2507Launch post
Claude Opus 4.1Launch post
GPT-5Launch postdeploymentsafety.openai.com
DeepSeek-V3.1Launch post
Kimi K2-Instruct-0905Launch post
DeepSeek-V3.1-TerminusLaunch post
Qwen3-Max (Qwen3-Max-Instruct)Launch post
DeepSeek-V3.2-ExpLaunch post
MiniMax-M2Launch posthuggingface.co
Kimi K2 ThinkingLaunch post
GPT-5.1Launch post
Gemini 3 Pro (preview); also Gemini 3 Deep Think modeLaunch post
Claude Opus 4.5Launch postwww.anthropic.com
DeepSeek-V3.2 and DeepSeek-V3.2-SpecialeLaunch posthuggingface.co
GPT-5.2 (Thinking, Pro, Instant)Launch post
MiniMax-M2.1Launch post
Qwen3-Max-ThinkingLaunch post
Kimi K2.5Launch post
Claude Opus 4.6Launch postwww.anthropic.com
MiniMax-M2.5Launch post
Qwen3.5-397B-A17BLaunch post
Gemini 3.1 Pro (preview)Launch post
GPT-5.4 (and GPT-5.4 Pro)Launch post
MiniMax-M2.7Launch post
Qwen3.6-PlusLaunch post
Claude Opus 4.7Launch postwww.anthropic.com
Qwen3.6-Max-PreviewLaunch post
Kimi K2.6Launch post
GPT-5.5 (and GPT-5.5 Pro)Launch post
DeepSeek-V4-Pro and DeepSeek-V4-Flash (Preview)Launch post
Qwen3.7-MaxLaunch post
Mistral Medium 3.5Launch post
Claude Opus 4.8Launch postwww.anthropic.com
MiniMax M3Launch post
Claude Fable 5 (with Claude Mythos 5)Launch postwww.anthropic.com
GPT-5.6 Sol (with Sol Ultra; Terra and Luna also launched)Launch post
Kimi K3Launch post
Claude Opus 5Launch postwww.anthropic.com
Qwen3.8-MaxLaunch post
DeepSeek-V4-Pro-0813 (V4-Pro GA)Launch post
Claude Fable 5.1 (with Claude Mythos 5.1)Launch postwww.anthropic.com
GPT-6 AstraLaunch post
DeepSeek-V4.1-FlashLaunch posthuggingface.cohuggingface.co
Claude Opus 5.5Launch postwww.anthropic.com
Gemini 4 ArgonLaunch post
Mistral Large 4 (Preview)Launch post
DeepSeek-V4.1-Flash-1017Launch post

Creators

BenchmarkMade byTypes
AA-LCRAA-LCR was created through a rigorous multi-phase process involving several members of the Artificial Analysis research team and more than a dozen undergraduate students huggingface.coData and evaluation company
Agents' Last ExamAgents' Last Exam v1, Agents' Last Exam v1.11. University of California, Berkeley … 6. Snorkel AI 7. SciLifeLab 8. HubSpot … 43. Amazon … 54. Meta … 75. U.S. National Institutes of Health arxiv.orgUniversity, Data and evaluation company, Nonprofit, Other company, AI lab
Aider PolyglotDecember 21, 2024 o1 tops aider’s new polyglot leaderboard aider.chatOther company
AIMEAIME 2024, AIME 2025Mathematical Association of America … 2024-25 AIME Thresholds Are Available maa.orgCompetition
APEX-AgentsBertie Vidgen Austin Mann … Brendan Foody Osvald Nitski Mercor apex@mercor.com arxiv.orgData and evaluation company
ARC-AGI-1ARC-AGI-1François Chollet ∗ Google, Inc. fchollet@google.com arxiv.orgAI lab
ARC-AGI-2ARC-AGI-2By Greg Kamradt … Today we’re excited to launch ARC-AGI-2 … The ARC Prize Foundation adapts this into our definition for measuring AGI arcprize.orgNonprofit
AutomationBenchAutomationBench 1.0.6, AutomationBench, release not specifiedBy Anna Marie Clifton · April 20, 2026 Today we're releasing AutomationBench … We initially built AutomationBench for internal use, to help evaluate which models to deploy across Zapier zapier.comOther company
BabyVision1 UniPat AI 2 xbench 3 Alibaba Group 4 MoonShot AI 5 StepFun 6 Peking University 7 Tsinghua University 8 University of Wisconsin–Madison 9 Princeton University 10 Nanyang Technological University arxiv.orgOther company, AI lab, University
BrowseCompBrowseCompJason Wei∗ Zhiqing Sun∗ Spencer Papay … Amelia Glaese OpenAI arxiv.orgAI lab
BrowseComp-ZH1 Hong Kong University of Science and Technology (Guangzhou) 2 Peking University 3 Mindverse AI 4 Alibaba Group 5 Zhejiang University 6 Zhejiang University of Technology 7 MBZUAI 8 NIO 9 HSBC 10 Harvard T.H. Chan School of Public Health arxiv.orgUniversity, Other company, AI lab
ChartographyChartographyTHE SURGE AI BLOG … Chartography is our benchmark for professional chart understanding . surgehq.aiData and evaluation company
CharXiv ReasoningPrinceton Language and Intelligence (PLI), Princeton University … University of Wisconsin, Madison … The University of Hong Kong arxiv.orgUniversity
Chinese SimpleQAYancheng He∗ , Shilong Li∗ , Jiaheng Liu∗† … Bo Zheng Taobao & Tmall Group of Alibaba arxiv.orgAI lab
Claw-Eval1 State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University 2 The University of Hong Kong arxiv.orgUniversity
CodeforcesI focused on three areas, which are being developed to the present day: contests (rounds and championships), social network (communication: blogs, comments, votes) and trainings. codeforces.comCompetition
CyberGymCyberGymZhun Wang∗ , Tianneng Shi∗ , Jingxuan He, Matthew Cai, Jialin Zhang, Dawn Song University of California, Berkeley arxiv.orgUniversity
DeepSWEDeepSWE v1.1Wenqi Huang, Peter Jiang · June 14, 2026 … @misc{datacurve2026deepswev11, … © 2026 Datacurve deepswe.datacurve.aiData and evaluation company
ExploitGymExploitGym1 UC Berkeley 2 Max Planck Institute for Security and Privacy 3 UC Santa Barbara 4 Arizona State University 5 Anthropic 6 OpenAI 7 Google … The benchmark design and experimental methodology are developed by the academic authors. Industry partners provided feedback on the benchmark design, facilitated access to their models, and assisted with running select experiments. arxiv.orgUniversity, Nonprofit
Finance AgentRayan Krishnan Vals AI, Inc. … Shirley Wu Stanford University … Langston Nashold Vals AI, Inc. … Antoine Bigeard Vals AI, Inc. arxiv.orgData and evaluation company, University
FrontierCodeFrontierCode 1.1, FrontierCode 2.0FrontierCode 2.0 By The Cognition Team 2026.10.27 … We are excited to introduce FrontierCode 2.0 , a new generation of our coding benchmark series cognition.comAI lab
FrontierSWEFrontierSWE, release not specified, FrontierSWE v2FrontierSWE is developed by the Proximal team in collaboration with external collaborators. frontierswe.comData and evaluation company
GDPval-AAGDPval-AA v2.1 is Artificial Analysis' evaluation framework for OpenAI's GDPval dataset. … GDPval-AA v2.1 uses 220 tasks developed by OpenAI in collaboration with industry professionals artificialanalysis.aiData and evaluation company, AI lab
GPQA DiamondGPQA Diamond1 New York University 2 Cohere 3 Anthropic, PBC arxiv.orgUniversity, AI lab
GraphWalksGraphWalksopenai / graphwalks … GraphWalks: a multi hop reasoning long context benchmark … 4/12/2025: Initial dataset published huggingface.coAI lab
GSM8KGSM8KKarl Cobbe∗ … karl@openai.com … John Schulman joschu@openai.com arxiv.orgAI lab
HealthBenchRahul K. Arora Jason Wei … Karan Singhal∗ OpenAI arxiv.orgAI lab
HMMTHMMT February 2025HMMT February 2025 February 15, 2025 Team Round hmmt-archive.s3.amazonaws.comCompetition
Humanity's Last ExamHumanity's Last Exam, HLE-DiamondOrganizing Team … 1 Center for AI Safety, 2 Scale AI arxiv.orgNonprofit, Data and evaluation company
IFBenchIFBenchα Allen Institute for Artificial Intelligence β University of Washington arxiv.orgNonprofit, University
IFEvalIFEvalJeffrey Zhou§∗ Tianjian Lu♮ … Le Hou♮† ♮ Google § Yale University arxiv.orgAI lab, University
IMO-AnswerBench† Work previously conducted under Google DeepMind … © 2025 Google DeepMind. All rights reserved arxiv.orgAI lab
LiveCodeBenchLiveCodeBench v5, LiveCodeBench v6, LiveCodeBench, release not specified† UC Berkeley $ MIT ‡ Cornell arxiv.orgUniversity
LongBench v21 Tsinghua University 2 Zhipu.AI arxiv.orgUniversity, AI lab
LVBench1 Zhipu AI 2 Tsinghua University ‡ Peking University arxiv.orgAI lab, University
MATH-500Hunter Lightman∗ Vineet Kosaraju∗ Yura Burda∗ Harri Edwards … Karl Cobbe∗ OpenAI arxiv.orgAI lab
MathArena ApexCreated by SRI Lab at ETH Zurich , INSAIT matharena.aiUniversity
MathVista1 UCLA, 2 University of Washington, 3 Microsoft Research, Redmond arxiv.orgUniversity, AI lab
MCP AtlasMCP AtlasBy The Scale Research Team · September 19, 2025 … We introduce MCP-Atlas , an agentic leaderboard scale.comData and evaluation company
MCPMark1 TRAIL, National University of Singapore 2 EvalSys 3 LobeHub 4 Shanghai Jiao Tong University 5 Fudan University arxiv.orgUniversity, Nonprofit, Other company
MMLUDan Hendrycks UC Berkeley Collin Burns Columbia University Steven Basart UChicago Andy Zou UC Berkeley Mantas Mazeika UIUC Dawn Song UC Berkeley Jacob Steinhardt UC Berkeley arxiv.orgUniversity
MMLU-ProMMLU-Pro1 University of Waterloo, 2 University of Toronto, 3 Carnegie Mellon University arxiv.orgUniversity
MMMLUopenai / OpenAI … We translated the MMLU’s test set into 14 languages using professional human translators. huggingface.coAI lab
MMMU1 IN.AI Research, 2 University of Waterloo, 3 The Ohio State University, 4 Independent, 5 Carnegie Mellon University, 6 University of Victoria, 7 Princeton University arxiv.orgOther company, University
MMMU-ProMMMU-ProThis paper introduces MMMU-Pro, a robust version of the Massive Multi-discipline Multimodal Understanding and Reasoning (MMMU) benchmark … MMMU Team arxiv.orgOther company, University
MRCROpenAI MRCR … This eval is inspired by the MRCR eval first introduced by Gemini ( https://arxiv.org/pdf/2409.12640v2 ). huggingface.coAI lab
MultiChallengeVed Sirdeshmukh∗, Kaustubh Deshpande∗ … Summer Yue, Chen Xing Scale AI arxiv.orgData and evaluation company
NL2Repo1 ByteDance Seed China, 2 M-A-P, 3 2077AI, 4 Humanlaya Data, 5 Nanjing University, 6 Peking University, 7 Beijing University of Posts and Telecommunications, 8 Beihang University arxiv.orgAI lab, Nonprofit, Data and evaluation company, University
OfficeQAby The Databricks AI Research Team … we've created and are open-sourcing OfficeQA databricks.comOther company
OmniDocBench1 Shanghai AI Laboratory 2 Abaka AI 3 2077AI arxiv.orgAI lab, Data and evaluation company, Nonprofit
OSWorld 2.0OSWorld 2.0, release not specified, OSWorld 2.0 (v2026.08.08), OSWorld 2.1XLANG Lab and Collaborators … 1 XLANG Lab, University of Hong Kong 2 University of California, San Diego … 5 Mila – Québec AI Institute 6 Uniphore 7 Snorkel AI … 9 Alibaba Qwen … 11 Simular 12 NeoCognition arxiv.orgUniversity, Nonprofit, Other company, Data and evaluation company, AI lab
OSWorld-VerifiedOSWorld-VerifiedIntroducing OSWorld-Verified Author XLANG Lab Date Jul 28, 2025 xlang.aiUniversity
PaperBenchGiulio Starace * Oliver Jaffe * … Tejal Patwardhan * OpenAI arxiv.orgAI lab
PostTrainBench1 ELLIS Institute Tübingen 2 Max Planck Institute for Intelligent Systems 3 Tübingen AI Center 4 University of Tübingen 5 Thoughtful Lab. arxiv.orgNonprofit, University
SciCode1 University of Illinois Urbana-Champaign 2 Argonne National Laboratory 3 Carnegie Mellon University 4 University of North Carolina at Chapel Hill 5 Massachusetts Institute of Technology 6 Harvard University 7 University of Chicago 8 University of Texas at Austin 9 Stanford University 10 Princeton University 11 The NSF AI Institute for Artificial Intelligence and Fundamental Interactions arxiv.orgUniversity
ScreenSpot-Pro1 National University of Singapore 2 East China Normal University 3 Hong Kong Baptist University arxiv.orgUniversity
Seal-0Thinh Pham Nguyen Nguyen Weiyuan Chen Pratibha Zunjare Yu-Min Tseng Tu Vu Virginia Tech arxiv.orgUniversity
SEC-bench ProSEC-bench Pro 260505, SEC-bench Pro, release not specifiedHwiwon Lee Jiawei Liu Dongjun Kim Ziqi Zhang Chunqiu Steven Xia Lingming Zhang University of Illinois Urbana-Champaign arxiv.orgUniversity
SimpleQAJason Wei∗ Nguyen Karina∗ … John Schulman William Fedus OpenAI arxiv.orgAI lab
SWE-bench MultilingualKabir Khandpur, Kilian Lieret, Carlos E. Jimenez, Ofir Press, John Yang swebench.comUniversity
SWE-bench ProSWE-bench ProXiang Deng*, Jeff Da* … Bing Liu, Brad Kenstler Scale AI arxiv.orgData and evaluation company
SWE-bench VerifiedSWE-bench VerifiedWe’ve collaborated with the authors of SWE-bench to address those issues in a new release of the benchmark openai.comAI lab, University
Terminal-BenchTerminal-Bench 1.0, Terminal-Bench 2.0, Terminal-Bench 2.1, Terminal-Bench 4.0Today we are releasing the first version of Terminal-Bench … Written by Mike Merrill , Alex Shaw , Chris Rytting , Ludwig Schmidt , and Andy Konwinski … Hosted by Stanford / Harbor / Laude Institute tbench.aiUniversity, Nonprofit
Terminal-Bench-ScienceTerminal-Bench Science 0.1Terminal-Bench-Science is a benchmark led by researchers at Stanford University and built by the team behind Terminal-Bench in collaboration with domain experts from a range of scientific disciplines and research institutions around the world. … Hosted by Stanford / Harbor / Laude Institute tbench.aiUniversity, Nonprofit
Toolathlon1 The Hong Kong University of Science and Technology 2 All Hands AI 3 Carnegie Mellon University 4 Duke University arxiv.orgUniversity, Other company
Video-MME1 USTC, 2 XMU, 3 HKU, 4 PKU, 5 CUHK, 6 ECNU arxiv.orgUniversity
Video-MMMU1 S-Lab, Nanyang Technological University 2 Carnegie Mellon University arxiv.orgUniversity
WideSearchRyan Wong∗ , Jiawei Wang∗ … Ke Wang† ByteDance Seed arxiv.orgAI lab
ZebraLogic1 University of Washington 2 Allen Institute for AI 3 Stanford University arxiv.orgUniversity, Nonprofit
ZeroBench1 University of Cambridge, 2 University of Alberta, Independent Researcher, 4 The University of Hong Kong, 5 University of Tübingen, 6 University of Oxford, 7 Auburn University. arxiv.orgUniversity
τ-benchShunyu Yao∗ Noah Shinn Pedram Razavi Karthik Narasimhan Sierra arxiv.orgOther company
τ²-benchτ²-benchVictor Barres ∗ Sierra … Honghua Dong ∗ † Sierra & University of Toronto & Vector Institute … Xujie Si University of Toronto & Vector Institute … Soham Ray Sierra … Karthik Narasimhan Sierra arxiv.orgOther company, University, Nonprofit

Makers other than universities

MakerIn its own wordsType
Abaka AIAbaka AI provides comprehensive data processing support, covering the whole AI data lifecycle abaka.aiData and evaluation company
Artificial AnalysisArtificial Analysis is the independent benchmarking company for AI. artificialanalysis.aiData and evaluation company
DatacurveDatacurve is pioneering the research and data collection infrastructure that will teach AI how to shoulder the work humanity has long endured. datacurve.aiData and evaluation company
Humanlaya DataHumanlaya AI | The Standard in AI Benchmarking humanlaya.comData and evaluation company
MercorMercor is organizing human intelligence to power the AI economy. mercor.comData and evaluation company
ProximalProximal is a new data company. proximal.aiData and evaluation company
Scale AIWe provide high-quality data and full-stack technologies that power the world's leading models scale.comData and evaluation company
Snorkel AISnorkel AI builds specialized training data, benchmarks, and evaluation environments that help frontier models and agents perform in high-stakes domains. snorkel.aiData and evaluation company
Surge AIThe RLHF data we generate embodies the richnesses and subtleties of the world … surgehq.aiData and evaluation company
Vals AIThe independent evaluator of artificial intelligence. vals.aiData and evaluation company
AlibabaAlibaba Cloud provides Qwen models, a series of large language models (LLMs) and multimodal models (MLLMs), to the open-source community. alibabacloud.comAI lab
Alibaba QwenAlibaba Cloud provides Qwen models, a series of large language models (LLMs) and multimodal models (MLLMs), to the open-source community. alibabacloud.comAI lab
AmazonAmazon Nova is a family of foundation models and services that delivers frontier intelligence and industry-leading price performance. aws.amazon.comAI lab
AnthropicAnthropic is an AI safety and research company anthropic.comAI lab
ByteDance SeedAdvancing the frontier of intelligence, in service of humanity seed.bytedance.comAI lab
CognitionLearn about Cognition, the applied AI lab behind Devin, and our mission to expand human capacity through autonomous software engineering. cognition.comAI lab
CohereCohere builds foundational models and AI solutions that help teams turn everyday effort into extraordinary impact. cohere.comAI lab
GoogleOur mission is to organize the world’s information and make it universally accessible and useful about.googleAI lab
Google DeepMindGoogle DeepMind brings together two of the world's leading AI labs — Google Brain and DeepMind — into a single, focused team led by our CEO Demis Hassabis. deepmind.googleAI lab
MetaBuild with Meta's AI models and tools. dev.meta.aiAI lab
Microsoft ResearchMicrosoft Research conducts fundamental science and technology research that benefits humanity, advances AI and state-of-the-art computing, and creates new foundations and breakthroug… microsoft.comAI lab
Moonshot AIWelcome to Moonshot AI. Our mission is to seek the optimal conversion from energy to intelligence. moonshot.aiAI lab
NeoCognitionNeoCognition is an AI agent lab for specialized intelligence. neocognition.ioAI lab
OpenAIOpenAI is an AI research and deployment company. Our mission is to ensure that artificial general intelligence benefits all of humanity. openai.comAI lab
Shanghai AI Laboratory上海人工智能实验室是我国人工智能领域的新型科研机构 shlab.org.cnAI lab
StepFun阶跃星辰坚定自研超级模型 stepfun.comAI lab
Zhipu AIWith the mission of 'Teach machines to think like humans, benefit humanity with reliable AI', Zhipu is committed to pioneering the next generation of cognitive intelligence models, with a strong focus on innovation in China. zhipuai.cnAI lab
2077AIThe 2077AI Foundation, is at the forefront of AI data standardization and progression. 2077ai.comNonprofit
Ai2We are a Seattle based non-profit AI research institute founded in 2014 by the late Paul Allen. allenai.orgNonprofit
ARC Prize FoundationThe ARC Prize Foundation is a non-profit dedicated to accelerating the development of Artificial General Intelligence (AGI). arcprize.orgNonprofit
Center for AI SafetyOur mission is to reduce societal-scale risks from artificial intelligence. safe.aiNonprofit
ELLIS Institute TübingenFounded in 2023, the ELLIS Institute Tübingen has established itself as a leading center for foundational AI research … institute-tue.ellis.euNonprofit
EvalSysEvalSys is an evolving open-source community on a mission to track and advance model agentic capabilities. evalsys.orgNonprofit
Laude InstituteBuilt by and for impact researchers, Laude Institute operates at the intersection of academia and industry to catalyze research that reaches people's hands. laude.orgNonprofit
M-A-PMultimodal Art Projection (M-A-P) is an open-source AI research community. m-a-p.aiNonprofit
Max Planck Institute for Security and PrivacyOur mission is to design, build, and analyze security and privacy technologies from foundations through systems to society. mpi-sp.orgNonprofit
Mila – Québec AI InstituteMila acquired the status of non-profit organization in 2018 mila.quebecNonprofit
National Institutes of HealthA part of the U.S. Department of Health and Human Services, NIH is the largest biomedical research agency in the world. nih.govNonprofit
SciLifeLabSciLifeLab is an institution for the advancement of molecular biosciences in Sweden, funded as a national research infrastructure by the Swedish government. scilifelab.seNonprofit
Vector InstituteVector is an independent not-for-profit corporation that works closely with its partner universities … vectorinstitute.aiNonprofit
AiderAI pair programming in your terminal aider.chatOther company
All Hands AIWe build AI software development agents for everyone, in the open. github.comOther company
DatabricksDatabricks is the data and AI company databricks.comOther company
HSBCHeadquartered in London, HSBC is one of the largest banking and financial services organisations in the world. hsbc.comOther company
HubSpotHubSpot's customer platform includes all the marketing, sales, customer service, and CRM software you need to grow your business. hubspot.comOther company
IN.AI ResearchWe focus on developing and evaluating intelligent agents. in.aiOther company
LobeHubLobeHub brings Super-Agents onto your team. lobehub.comOther company
Mindverse AIWe Create AI as Your Digital Self mindverse.aiOther company
NIOWe are more than an automotive company. nio.comOther company
SierraSierra helps the great companies of the world show up at their best. sierra.aiOther company
SimularSimular is a research-driven company chasing one goal: full machine autonomy. simular.aiOther company
UniPat AIOur mission is to accelerate AI's evolution towards real-world automation. The next leap—from capable models to productive and trustworthy systems—comes from training AI in realistic scenarios. unipat.aiOther company
UniphoreUniphore | The Business AI Company uniphore.comOther company
xbenchxbench is HSG’s evergreen benchmark for AI agents. hsgcap.comOther company
ZapierAs the leader in easy automation, Zapier empowers businesses to automate workflows and move data across 9,000+ apps . zapier.comOther company
CodeforcesI focused on three areas, which are being developed to the present day: contests (rounds and championships), social network (communication: blogs, comments, votes) and trainings. codeforces.comCompetition
Harvard-MIT Mathematics TournamentTo engage a diverse community of students and support them in reaching beyond traditional math curriculums hmmt.orgCompetition
Mathematical Association of AmericaYou may learn more about the AIME and our invitational competitions here. maa.orgCompetition

Sources

Models

Related

Tags