Lu, Xudong

Xudong Lu (陆徐东)

Multimedia Laboratory (MMLab)

The Chinese University of Hong Kong

Email: luxudong@link.cuhk.edu.hk, luxudong2001@sjtu.edu.cn

About Me

I am currently a Ph.D. student at the Multimedia Laboratory (MMLab), The Chinese Univerty of Hong Kong. My research advisor is Prof. Hongsheng Li.

I received the B. E. degree from the Department of Computer Science and Engineering, Shanghai Jiao Tong University in 2023, ranking 2/119 in the major, and awarded with the National Scholarship (top 0.2%) in 2020, 2021 and 2022.

During my undergraduate studies, I worked closely with Prof. Junchi Yan and my research focused on AI4Science. Now my research interests include model compression, (multimodal) large language models.

News

July 2024: One paper on video generation is accepted by ECCV 2024.
May 2024: One paper (first author) on MoE LLM pruning is accepted by ACL 2024.
May 2024: One paper (first author) on LLaMA-alike LLM pruning is accepted by ICML 2024.
Feburary 2024: One paper on Human Action Understanding is accepted by CVPR 2024.
August 2023: I am joining the MMLab of CUHK as a Ph.D. student.
June 2023: I am honored to have the opportunity to speak as the student representative at the undergraduate commencement ceremony of the college.
April 2023: Two papers (one first author) on Quantum Machine Learning are accepted by ICML 2023.
March 2023: I am awarded with HKPFS (Hong Kong PhD Fellowship Scheme).

Selected Publications

BlueLM-V-3B: Algorithm and System Co-Design for Multimodal Large Language Models on Mobile Devices

Xudong Lu*, Yinghao Chen*, Cheng Chen*, Hui Tan*, Boheng Chen, Yina Xie, Rui Hu, Guanxin Tan, Renshou Wu, Yan Hu, Yi Zeng, Lei Wu, Liuyang Bian, Zhaoxiong Wang, Long Liu, Yanzhou Yang, Han Xiao, Aojun Zhou, Yafei Wen, Xiaoxin Chen, Shuai Ren, Hongsheng Li
Technical Report
[Paper]

TerDiT: Ternary Diffusion Models with Transformers
Xudong Lu, Aojun Zhou, Ziyi Lin, Qi Liu, Yuhui Xu, Renrui Zhang, Yafei Wen, Ren Shuai, Peng Gao, Junchi Yan, Hongsheng Li
Arxiv Preprint
[Paper]

Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
Xudong Lu*, Qi Liu*, Yuhui Xu, Aojun Zhou, Siyuan Huang, Bo Zhang, Junchi Yan, Hongsheng Li
Annual Meeting of the Association for Computational Linguistics (ACL, CCF A), 2024
[Paper]

SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
Xudong Lu*, Aojun Zhou*, Yuhui Xu*, Renrui Zhang, Peng Gao, Hongsheng Li
International Conference on Machine Learning (ICML, CCF A), 2024
[Paper]

QuantumDARTS: Differentiable Quantum Architecture Search for Variational Quantum Algorithms
Wenjie Wu, Ge Yan, Xudong Lu, Kaisen Pan, Junchi Yan
International Conference on Machine Learning (ICML, CCF A), 2023
[Paper]

QAS-Bench: Rethinking Quantum Architecture Search and A Benchmark
Xudong Lu, Kaisen Pan, Ge Yan, Jiaming Shan, Wenjie Wu, Junchi Yan
International Conference on Machine Learning (ICML, CCF A), 2023
[Paper]

Internship and Cooperation

Academic Service

Journal Reviewer

IEEE TCSVT

Conference Reviewer

CVPR 2024, NeurIPS 2024, ICLR 2025, CVPR 2025