Frontier Log

GoogleModelMajor

Vision Transformer (ViT)

Google Research's ViT applies the Transformer to image patches, beating comparable CNNs with four times less compute.

Posted by Neil Houlsby and Dirk Weissenborn, Research Scientists, Google Research While convolutional neural networks (CNNs) have been used in comp...

From the announcement

Official source

Transformers for Image Recognition at Scaleresearch.google · published

Tags

See it on the timeline