Frontier Log

GoogleCapabilityMilestone

Transformer: Attention Is All You Need

Google Brain's self-attention network beats recurrent and convolutional models on translation.

Posted by Jakob Uszkoreit, Software Engineer, Natural Language Understanding Neural networks, in particular recurrent neural networks (RNNs), are n...

From the announcement

Official source

Transformer: A Novel Neural Network Architecture for Language Understandingresearch.google · published

See it on the timeline