Hyung Won Chung, Le Hou, S. Longpre, Barret Zoph, Yi Tay, William Fedus, Yiwei Li, Xinpeng Wang, Mostafa Dehghani, Siddhartha Brahma, A. Webson, Shixiang Shane Gu, Z. Dai, Mirac Suzgun, X. Chen, Aakanksha Chowdhery, A. C. Ros, M. Pellat, K. Robinson, D. Valter, S. Narang, Gaurav Mishra, A. Yu, V. Zhao, Y. Huang, Andrew Dai, H. Yu, Slav Petrov, Ed H. Chi, Jeffrey Dean, Jacob Devlin, A. Roberts, Denny Zhou, Quoc V. Le, Jason Wei