Lu, Xudong

Xudong Lu (陆徐东)

Multimedia Laboratory (MMLab)

The Chinese University of Hong Kong

Email: luxudong@link.cuhk.edu.hk, luxudong2001@sjtu.edu.cn

About Me

I am currently a Ph.D. student at the Multimedia Laboratory (MMLab), The Chinese Univerty of Hong Kong. My research advisor is Prof. Hongsheng Li.

I received the B. E. degree from the Department of Computer Science and Engineering, Shanghai Jiao Tong University in 2023, ranking 2/119 in the major, and awarded with the National Scholarship (top 0.2%) in 2020, 2021 and 2022.

During my undergraduate studies, I worked closely with Prof. Junchi Yan and my research focused on AI4Science. Now my research interests include model compression, (multimodal) large language models.

News

July 2024: One paper on video generation is accepted by ECCV 2024.
May 2024: One paper (first author) on MoE LLM pruning is accepted by ACL 2024.
May 2024: One paper (first author) on LLaMA-alike LLM pruning is accepted by ICML 2024.
Feburary 2024: One paper on Human Action Understanding is accepted by CVPR 2024.
August 2023: I am joining the MMLab of CUHK as a Ph.D. student.
June 2023: I am honored to have the opportunity to speak as the student representative at the undergraduate commencement ceremony of the college.
April 2023: Two papers (one first author) on Quantum Machine Learning are accepted by ICML 2023.
March 2023: I am awarded with HKPFS (Hong Kong PhD Fellowship Scheme).

Selected Publications

TerDiT: Ternary Diffusion Models with Transformers
Xudong Lu, Aojun Zhou, Ziyi Lin, Qi Liu, Yuhui Xu, Renrui Zhang, Yafei Wen, Ren Shuai, Peng Gao, Junchi Yan, Hongsheng Li
Arxiv Preprint
[Paper]

Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
Xudong Lu∗, Qi Liu∗, Yuhui Xu, Aojun Zhou, Siyuan Huang, Bo Zhang, Junchi Yan, Hongsheng Li
Annual Meeting of the Association for Computational Linguistics (ACL, CCF A), 2024
[Paper]

SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
Xudong Lu∗, Aojun Zhou∗, Yuhui Xu∗, Renrui Zhang, Peng Gao, Hongsheng Li
International Conference on Machine Learning (ICML, CCF A), 2024
[Paper]

QuantumDARTS: Differentiable Quantum Architecture Search for Variational Quantum Algorithms
Wenjie Wu, Ge Yan, Xudong Lu, Kaisen Pan, Junchi Yan
International Conference on Machine Learning (ICML, CCF A), 2023
[Paper]

QAS-Bench: Rethinking Quantum Architecture Search and A Benchmark
Xudong Lu, Kaisen Pan, Ge Yan, Jiaming Shan, Wenjie Wu, Junchi Yan
International Conference on Machine Learning (ICML, CCF A), 2023
[Paper]

Internship and Cooperation

Academic Service

Journal Reviewer

IEEE TCSVT

Conference Reviewer

CVPR 2024, NeurIPS 2024