T5Gemma
Open encoder-decoder models adapted from Gemma 2 2B and 9B, plus new T5-sized Small to XL models.
Today, we revisit this architecture and introduce T5Gemma, a new collection of encoder-decoder LLMs developed by converting pretrained decoder-only models into the encoder-decoder architecture through a technique called adaptation.
Official source
T5Gemma: A new collection of encoder-decoder Gemma modelsdevelopers.googleblog.com · published