Post title here
A short excerpt or description goes here.
Leave your curiosity for the world, and let time deliver the answers.
Bio: PhD Candidate at Beihang University (School of Computer Science and Engineering) & Nanyang Technological University (College of Computing and Data Science) (joint programme). Supervised by Prof. Xianglong Liu and Prof. Dacheng Tao. Research focus: Efficient foundation-model inference and deployment. PhD Expected Graduation: Dec 2026.
ๅจ่ฟ้่ฎฐๅฝไธไบ้ถๆฎตๆง็ๆ่ไธๆๅ๏ผๆฌข่ฟ้ๆถๆพๆไบคๆตใ
A short excerpt or description goes here.
This work structurally compresses MoE models by pruning channels rather than whole experts, using attribution-guided coverage maximization to better preserve important expert information. On DeepSeek and Qwen MoEs, it maintains accuracy under 50%/25% pruning with 4-bit quantization and reduces Qwen3-30B-A3B memory by 5.27ร.
SPA-Cache accelerates diffusion language model decoding with a low-dimensional singular proxy for identifying update-critical tokens and an adaptive layer-wise update budget. It delivers up to 8ร throughput improvement over vanilla decoding and 2-4ร speedup over existing caching baselines.
MoDES accelerates multimodal LLM inference with training-free expert skipping driven by modality heterogeneity.
A Triton-based MXFP mixed-precision attention kernel for efficient and accurate low-bit attention inference on NVIDIA B200.
QVGen enables extremely low-bit quantization-aware training for video diffusion models. It stabilizes QAT by reducing gradient norms with auxiliary modules, then removes inference overhead via rank-decay. Shows near full-precision quality at 4-bit.
This survey reviews low-bit quantization for large language models, covering core principles, data formats, system support, and algorithmic methods. It highlights how low-bit techniques reduce memory and computation costs while preserving performance.
As graduation approaches, life has become busier than ever. Several projects that I co-lead or participate in are still ongoing, as listed on my Research page. Some are coming soon, while others have been continuously explored for more than two years and are still in the darkness before dawn.
I feel fortunate to always have frontier research topics to work on and excellent teammates to work with. There has never been a dull moment in my Ph.D. life. As this chapter gradually comes to a close, I am excited and looking forward to embracing my upcoming journey in industry.
Beyond research, I also enjoy travel and photography. If you are interested, you can find my portfolio here.