Xudong Lu (陆徐东)

 

Email: luxudong@link.cuhk.edu.hk

Multimedia Laboratory (MMLab)

The Chinese University of Hong Kong

 

          

About Me

I am currently a Ph.D. student at the Multimedia Laboratory (MMLab), The Chinese Univerty of Hong Kong. My research advisor is Prof. Hongsheng Li.

I received the B. E. degree from the Department of Computer Science and Engineering, Shanghai Jiao Tong University in 2023, ranking 2/119 in the major, and awarded with the National Scholarship (top 0.2%) in 2020, 2021 and 2022.

During my undergraduate studies, I worked closely with Prof. Junchi Yan and my research focused on AI4Science. Now my research interests include model compression, (multimodal) large language models.

News

  • May 2024: One paper (first author) on MoE LLM pruning is accepted by ACL 2024.
  • May 2024: One paper (first author) on LLaMA-alike LLM pruning is accepted by ICML 2024.
  • Feburary 2024: One paper on Human Action Understanding is accepted by CVPR 2024.
  • August 2023: I am joining the MMLab of CUHK as a Ph.D. student.
  • June 2023: I am honored to have the opportunity to speak as the student representative at the undergraduate commencement ceremony of the college.
  • April 2023: Two papers (one first author) on Quantum Machine Learning are accepted by ICML 2023.
  • March 2023: I am awarded with HKPFS (Hong Kong PhD Fellowship Scheme).

Selected Publications

TerDiT: Ternary Diffusion Models with Transformers
Xudong Lu, Aojun Zhou, Ziyi Lin, Qi Liu, Yuhui Xu, Renrui Zhang, Yafei Wen, Ren Shuai, Peng Gao, Junchi Yan, Hongsheng Li
Arxiv Preprint
[Paper]
Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
Xudong Lu∗, Qi Liu∗, Yuhui Xu, Aojun Zhou, Siyuan Huang, Bo Zhang, Junchi Yan, Hongsheng Li
Annual Meeting of the Association for Computational Linguistics (ACL, CCF A), 2024
[Paper]
SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
Xudong Lu∗, Aojun Zhou∗, Yuhui Xu∗, Renrui Zhang, Peng Gao, Hongsheng Li
International Conference on Machine Learning (ICML, CCF A), 2024
[Paper]
QuantumDARTS: Differentiable Quantum Architecture Search for Variational Quantum Algorithms
Wenjie Wu, Ge Yan, Xudong Lu, Kaisen Pan, Junchi Yan
International Conference on Machine Learning (ICML, CCF A), 2023
[Paper]
QAS-Bench: Rethinking Quantum Architecture Search and A Benchmark
Xudong Lu, Kaisen Pan, Ge Yan, Jiaming Shan, Wenjie Wu, Junchi Yan
International Conference on Machine Learning (ICML, CCF A), 2023
[Paper]

Academic Service

    Journal Reviewer

    IEEE TCSVT


    Conference Reviewer

    CVPR 2024