Quantong Qiu | Homepage

📝 Biography

- I am a 1st-year Master student at the Institute of Artificial Intelligence, Soochow University, under the supervision of Assoc. Prof. Juntao Li.

- Before that, I obtained the Bachelor's degree in Software Engineering from Jiangxi University of Finance and Economics. During my undergraduate studies, I won more than ten national-level awards in Computer Science Category A competitions recognized by the Ministry of Education, and received honors including Outstanding Undergraduate Thesis and Outstanding Student Pacesetter.

- Currently, my research focuses on Efficient Inference for Large Language Models, including but not limited to KV Cache Optimization, Sparse Attention, and Model Optimization.

Check my publications and CV (PDF) for more information!

Last Update: 2025-06-25 (github.io) 2025-05-26 (online CV)

📚 Research Interests

KV Cache Optimization

Quantization: OTT (ACL 2025 Long Main)
KV Cache Eviction: CaliDrop (NIPS 2025)

AI Infrastructure

Long Sequence Infrastructure: LOOM-Scope

Efficient Model Architectures

Sparse Attention: Wait~~~~~ (ICML 2026)

📖 Education & Internship

Ms Student, Software Engineering, 2025-current
School of Computer Science and Technology, Soochow University

B.Eng., Software Engineering, 2021-2025
School of Software and Internet of Things Engineering, Jiangxi University of Finance and Economics

📒 Selected Publications

Check my Google Scholar for more information! (* stands for equal contribution)

[ACL 2025 Long (CCF A)] OTT: Accurate KV Cache Quantization with Outlier Tokens Tracing
Yi Su*, Yuechi Zhou*, Quantong Qiu, Juntao Li, Qingrong Xia, Ping Li, Xinyu Duan, Zhefeng Wang, Min Zhang

📜 Selected Preprints

LOOM-Scope: a comprehensive and efficient LOng-cOntext Model evaluation framework
Zecheng Tang, Haitian Wang, Quantong Qiu, Baibei Ji, Ruoxi Sun, Keyan Zhou, Juntao Li, Min Zhang
CaliDrop: KV Cache Compression with Calibration
Yi Su, Quantong Qiu, Yuechi Zhou, Qingrong Xia, Ping Li, Xinyu Duan, Zhefeng Wang, Juntao Li, Min Zhang

🎖️ Scholarship & Honors

The 25th China Robot and Artificial Intelligence Competition First Prize (National Level, Team Leader)

June 2023

Chinese Collegiate Computing Competition Second Prize (National Level, Team Leader)

The 17th (August 2024) & the 16th (August 2023)

Outstanding Student Pacesetter, JUFE University Honor (Top 10 Students)

2025

Outstanding Undergraduate Thesis, JUFE University Honor