Hyung Won Chung, L. Hou, S. Longpre, Barret Zoph, Yi Tay, William Fedus, Yiwei Li, Xinpeng Wang, Mostafa Dehghani, S. Brahma, A. Webson, Shixiang Shane Gu, Z. Dai, Mirac Suzgun, X. Chen, Aakanksha Chowdhery, A. C. Ros, M. Pellat, K. Robinson, D. Valter, S. Narang, Gaurav Mishra, A. Yu, V. Zhao, Y. Huang, Andrew Dai, H. Yu, Slav Petrov, Ed H. Chi, Jeffrey Dean, Jacob Devlin, A. Roberts, Denny Zhou, Quoc V. Le, Jason Wei