I’m a first year PhD student @GeorgiaTech, co-advised by Bo Dai and Chao Zhang. Before this, I graduated with a Bachelor’s degree from Tsinghua University.
My research interest includes LLM, Modular Learning and AI Agents.
🔥 News
- 2025.04: Stay tuned!
📝 Publications and Preprints
- AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning, Ruiyi Zhang*, Rushi Qiang*, Sai Ashish Somayajula, Pengtao Xie. NAACL 2024
- HYDRA: Model Factorization Framework for Black-Box LLM Personalization, Yuchen Zhuang, Haotian Sun, Yue Yu, Rushi Qiang, Qifan Wang, Chao Zhang, Bo Dai. NeurIPS 2024
- BiLoRA: A Bi-level Optimization Framework for Overfitting-Resilient Low-Rank Adaptation of Large Pre-trained Models, Rushi Qiang*, Ruiyi Zhang*, Pengtao Xie.
- Matryoshka: Learning to Drive Black-Box LLMs with LLMs, Changhao Li*, Yuchen Zhuang*, Rushi Qiang, Haotian Sun, Hanjun Dai, Chao Zhang, Bo Dai.
- Language Model Uncertainty Quantification with Attention Chain, Yinghao Li, Rushi Qiang, Lama Moukheiber, Chao Zhang.
📖 Educations
- 2024.08 - present, Georgia Tech Machine Learning PhD student.
- 2020.09 - 2024.06, B.Eng. in Automation, Tsinghua University..