Lu, Xudong

News

February 2025: Two papers on MLLMs (one first author) are accepted by CVPR 2025.
February 2025: Two papers (one on KV Cache pruning, another on autoformalization) are accepted by ICLR 2025 (both Spotlight).
November 2024: We are happy to introduce BlueLM-V-3B, an algorithm and system co-design method for multimodal large language models on mobile devices.🔥🔥🔥
July 2024: One paper on video generation is accepted by ECCV 2024 (Oral).
May 2024: One paper (first author) on MoE LLM pruning is accepted by ACL 2024.
May 2024: One paper (first author) on LLaMA-alike LLM pruning is accepted by ICML 2024.
February 2024: One paper on Human Action Understanding is accepted by CVPR 2024 (Highlight).
August 2023: I am joining the MMLab of CUHK as a Ph.D. student.
June 2023: I am honored to have the opportunity to speak as the student representative at the undergraduate commencement ceremony of the college.
April 2023: Two papers (one first author) on Quantum Machine Learning are accepted by ICML 2023.
March 2023: I am awarded with HKPFS (Hong Kong PhD Fellowship Scheme).

Preprint

GenieBlue: Integrating both Linguistic and Multimodal Capabilities for Large Language Models on Mobile Devices
Xudong Lu*, Yinghao Chen*, Renshou Wu*, Haohao Gao, Xi Chen, Xue Yang, Xiangyu Zhao, Aojun Zhou, Fangyuan Li, Yafei Wen, Xiaoxin Chen, Shuai Ren, Hongsheng Li
Arxiv Preprint 2025
[Paper]

Rethinking Video Tokenization: A Conditioned Diffusion-based Approach
Nianzu Yang*, Pandeng Li*, Liming Zhao, Yang Li, Chen-Wei Xie, Yehui Tang, Xudong Lu, Zhihang Liu, Yun Zheng, Yu Liu, Junchi Yan
Arxiv Preprint 2025
[Paper]

SmartBench: Is Your LLM Truly a Good Chinese Smartphone Assistant?
Xudong Lu*, Haohao Gao*, Renshou Wu*, Shuai Ren, Xiaoxin Chen, Hongsheng Li, Fangyuan Li
Arxiv Preprint 2025
[Paper]

PointOBB-v3: Expanding Performance Boundaries of Single Point-Supervised Oriented Object Detection
Peiyuan Zhang*, Junwei Luo*, Xue Yang*, Yi Yu, Qingyun Li, Yue Zhou, Xiaosong Jia, Xudong Lu, Jingdong Chen, Xiang Li, Junchi Yan, Yansheng Li
Arxiv Preprint 2025
[Paper]

TerDiT: Ternary Diffusion Models with Transformers
Xudong Lu, Aojun Zhou, Ziyi Lin, Qi Liu, Yuhui Xu, Renrui Zhang, Xue Yang, Junchi Yan, Peng Gao, Hongsheng Li
Arxiv Preprint 2024
[Paper]

Selected Publications

BlueLM-V-3B: Algorithm and System Co-Design for Multimodal Large Language Models on Mobile Devices

Xudong Lu*, Yinghao Chen*, Cheng Chen*, Hui Tan*, Boheng Chen, Yina Xie, Rui Hu, Guanxin Tan, Renshou Wu, Yan Hu, Yi Zeng, Lei Wu, Liuyang Bian, Zhaoxiong Wang, Long Liu, Yanzhou Yang, Han Xiao, Aojun Zhou, Yafei Wen, Xiaoxin Chen, Shuai Ren, Hongsheng Li

The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025
[Paper][机器之心 (Synced China)]

Rethinking and Improving Autoformalization: Towards a Faithful Metric and a Dependency Retrieval-based Approach
Qi Liu, Xinhao Zheng, Xudong Lu, Qinxiang Cao, Junchi Yan
International Conference on Learning Representations (ICLR), 2025, (Spotlight)
[Paper]

ThinK: Thinner Key Cache by Query-Driven Pruning
Yuhui Xu, Zhanming Jie, Hanze Dong, Lei Wang, Xudong Lu, Aojun Zhou, Amrita Saha, Caiming Xiong, Doyen Sahoo
International Conference on Learning Representations (ICLR), 2025, (Spotlight)
[Paper]

ZoLA: Zero-Shot Creative Long Animation Generation with Short Video Model
Fu-Yun Wang, Zhaoyang Huang, Qiang Ma, Guanglu Song, Xudong Lu, Weikang Bian, Yijin Li, Yu Liu, Hongsheng Li
European Conference on Computer Vision (ECCV), 2024, (Oral)
[Paper]

Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
Xudong Lu*, Qi Liu*, Yuhui Xu, Aojun Zhou, Siyuan Huang, Bo Zhang, Junchi Yan, Hongsheng Li
Annual Meeting of the Association for Computational Linguistics (ACL), 2024
[Paper]

SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
Xudong Lu*, Aojun Zhou*, Yuhui Xu*, Renrui Zhang, Peng Gao, Hongsheng Li
International Conference on Machine Learning (ICML), 2024
[Paper]

From isolated islands to pangea: Unifying semantic space for human action understanding
Yong-Lu Li*, Xiaoqian Wu*, Xinpeng Liu, Zehao Wang, Yiming Dou, Yikun Ji, Junyi Zhang, Yixing Li, Xudong Lu, Jingru Tan, Cewu Lu
The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, (Highlight)
[Paper]

QuantumDARTS: Differentiable Quantum Architecture Search for Variational Quantum Algorithms
Wenjie Wu, Ge Yan, Xudong Lu, Kaisen Pan, Junchi Yan
International Conference on Machine Learning (ICML), 2023
[Paper]

QAS-Bench: Rethinking Quantum Architecture Search and A Benchmark
Xudong Lu, Kaisen Pan, Ge Yan, Jiaming Shan, Wenjie Wu, Junchi Yan
International Conference on Machine Learning (ICML), 2023
[Paper]