👨💻 About Me
I am now a third-year PhD student in Beijing Jiaotong University, advised by Prof. Yufeng Chen and Prof. Jinan Xu. Before that, I started my master’s degree in 2020 and transferred to the doctoral program in 2022. I am now interning at WeChat, Tencent, working on LLM safety.
My research interest is mainly on training algorithms for LLMs, especially the ones that enhance the model capacity with the fixed model size, like knowledge distillation and RL techniques. Now I am also interested in LLM safety, seeking the balance between model safety and model intelligence.
🔥 News
- 2025.05: 🎉🎉 Two papers have been accepted by ACL2025! See you in Vienna.
- 2025.03: DSKDv2 has been released on arxiv.
- 2024.09: 🎉🎉 DSKD has been accepted by EMNLP2024!
📝 Selected Papers [Full]
Preprint
-
A Dual-Space Framework for General Knowledge Distillation of Large Language Models
Xue Zhang*, Songming Zhang*, Yunlong Liang, Fandong Meng, Yufeng Chen, Jinan Xu, Jie Zhou
Publications
-
AlignDistil: Token-Level Language Model Alignment as Adaptive Policy Distillation (ACL 2025 Main)
Songming Zhang, Xue Zhang, Tong Zhang, Bojie Hu, Yufeng Chen, Jinan Xu
-
Dual-Space Knowledge Distillation for Large Language Models (EMNLP 2024 Main)
Songming Zhang, Xue Zhang, Zengkui Sun, Yufeng Chen, Jinan Xu
-
Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation (ACL 2023 Main)
Songming Zhang, Yunlong Liang, Shuaibo Wang, Yufeng Chen, Wenjuan Han, Jian Liu, Jinan Xu
-
Conditional Bilingual Mutual Information Based Adaptive Training for Neural Machine Translation (ACL 2022 Main)
Songming Zhang*, Yijin Liu*, Fandong Meng, Yufeng Chen, Jinan Xu, Jian Liu, Jie Zhou
📖 Educations
- 2022.09 - Now, Beijing Jiaotong University, PhD Student.
- 2020.09 - 2022.06, Beijing Jiaotong University, Master.
- 2016.09 - 2020.06, Beijing University of Chemical Technology, Bachelor.
💻 Internships
- 2024.07 - Now, WeChat, Tencent.
- 2022.02 - 2024.03, TI Cloud Inc.
- 2021.01 - 2022.01, WeChat AI, Tencent.
🔖 Services
- ACL 2023, Reviewer
- ACL ARR 2023-2025, Reviewer