%0 Conference Proceedings %T Efficient Large Scale Language Modeling with Mixtures of Experts %A Artetxe, Mikel %A Bhosale, Shruti %A Goyal, Naman %A Mihaylov, Todor %A Ott, Myle %A Shleifer, Sam %A Lin, Xi Victoria %A Du, Jingfei %A Iyer, Srinivasan %A Pasunuru, Ramakanth %A Anantharaman, Giridharan %A Li, Xian %A Chen, Shuohui %A Akin, Halil %A Baines, Mandeep %A Martin, Louis %A Zhou, Xing %A Koura, Punit Singh %A O’Horo, Brian %A Wang, Jeffrey %A Zettlemoyer, Luke %A Diab, Mona %A Kozareva, Zornitsa %A Stoyanov, Veselin %Y Goldberg, Yoav %Y Kozareva, Zornitsa %Y Zhang, Yue %S Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing %D 2022 %8 December %I Association for Computational Linguistics %C Abu Dhabi, United Arab Emirates %F artetxe-etal-2022-efficient %R 10.18653/v1/2022.emnlp-main.804 %U https://aclanthology.org/2022.emnlp-main.804/ %U https://doi.org/10.18653/v1/2022.emnlp-main.804 %P 11699-11732