GLaM
Google Brain's trillion-weight sparse mixture-of-experts (MoE) model; competitive with GPT-3, more efficiently.
Posted by Andrew M Dai and Nan Du, Research Scientists, Google Research, Brain Team Large language models (e.g., GPT-3) have many significant capab...
Official source
More Efficient In-Context Learning with GLaMresearch.google · published