Understanding the RoPE Extensions of Long-Context LLMs: An Attention Perspective

Understanding the RoPE Extensions of Long-Context LLMs: An Attention Perspective Meizhi Zhong author Chen Zhang author Yikun Lei author Xikai Liu author Yan Gao author Yao Hu author Kehai Chen author Min Zhang author 2025-01 text Proceedings of the 31st International Conference on Computational Linguistics Owen Rambow editor Leo Wanner editor Marianna Apidianaki editor Hend Al-Khalifa editor Barbara Di Eugenio editor Steven Schockaert editor Association for Computational Linguistics Abu Dhabi, UAE conference publication zhong-etal-2025-understanding https://aclanthology.org/2025.coling-main.600/ 2025-01 8955 8962