Academic Qualification

Ph.D. in Electrical and Computer Engineering, University of Alberta, Canada, 2025

M.Eng in Electrical and Computer Engineering, University of Toronto, Canada, 2021

B.Eng in Electrical and Computer Engineering, Western University, Canada, 2019

Teaching Area

Computer Programming

Software Engineering

Machine Learning

Research Area

Quality Assurance for Trustworthy AI Systems

Multimodal Foundation Models

AI-enabled Cyber-physical Systems

Embodied AI

Professional Services

Reviewer for journals and conferences, including:

IEEE Transactions on Software Engineering (TSE)

Empirical Software Engineering (EMSE)

IEEE Robotics and Automation Letters (RA‑L)

International Journal of Human‑Computer Interaction (IJHCI)

IEEE Transactions on Reliability (ToR)

IEEE International Conference on Robotics and Automation (ICRA)

Conference on Neural Information Processing Systems (NeurIPS)

International Conference on Learning Representations (ICLR)

International Conference on Machine Learning (ICML)

Annual AAAI Conference on Artificial Intelligence (AAAI)

International Conference on Artificial Intelligence and Statistics (AISTATS)

Working Experience

Sep. 2025 ~ present, Assistant Professor, Faculty of Innovation Engineering, MUST

Academic Publication (selected)

1.      IEEE Transactions on Artificial Intelligence (TAI), 2025.

[TAI’25] Online Safety Analysis for LLMs: a Benchmark, an Assessment, and a Path Forward

Xuan Xie, Jiayang Song, Zhehua Zhou, Yuheng Huang, Da Song, and Lei Ma

2.      In Proceedings of the ACM International Conference on the Foundations of Software Engineering (FSE), 2025. (CCF-A)

[FSE’25] VLATest: Testing and Evaluating Vision-Language-Action Models for Robotic Manipulation

Zhijie Wang, Zhehua Zhou, Jiayang Song, Yuheng Huang, Zhan Shu, and Lei Ma

3.      The Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics (NAACL), 2025. (CCF-B)

[NAACL’25] Multilingual Blending: LLM Safety Alignment Evaluation with Language Mixture

Jiayang Song, Yuheng Huang, Zhehua Zhou, and Lei Ma

4.      ACM Transactions on Software Engineering and Methodology (TOSEM), 2025. (CCF-A)

[TOSEM’25] AcTracer: Active Testing of Large Language Model via Multi-Stage Sampling

Yuheng Huang, Jiayang Song, Qiang Hu, Felix Juefei-Xu, Lei Ma

5.      IEEE Transactions on Software Engineering (TSE), 2025. (CCF-A)

[TSE’25] Look Before You Leap: An Exploratory Study of Uncertainty Analysis for Large Language Models

Yuheng Huang, Jiayang Song, Zhijie Wang, Shengming Zhao, Huaming Chen, Felix Juefei-Xu, Lei Ma

6.      IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2024. (CCF-B)

[TNNLS’ 24] GenSafe: A Generalizable Safety Enhancer for Safe Reinforcement Learning Algorithms Based on Reduced Order Markov Decision Process Model

Zhehua Zhou, Xuan Xie, Jiayang Song, Zhan Shu, and Lei Ma

7.      IEEE Transactions on Software Engineering (TSE), 2024. (CCF-A)

[TSE’24] Luna: A model-based universal analysis framework for large language models

Da Song, Xuan Xie, Jiayang Song, Derui Zhu, Yuheng Huang, Felix Juefei-Xu, Lei Ma

8.      IEEE International Conference on Robotics and Automation (ICRA), 2024. (CCF-B)

[ICRA’24] ISR-LLM: Iterative Self-Refined Large Language Model for Long-Horizon Sequential Task Planning

Zhehua Zhou, Jiayang Song, Kunpeng Yao, Zhan Shu, Lei Ma

9.      In Proceedings of the IEEE/ACM International Conference on Software Engineering (ICSE), 2024. (CCF-A)

[ICSE’24] Towards Building AI-CPS with NVIDIA Isaac Sim: An Industrial Benchmark and Case Study for Robotics Manipulation

Zhehua Zhou, Jiayang Song, Kunpeng Yao, Zhan Shu, Lei Ma

10.  IEEE Transactions on Software Engineering (TSE), 2023. (CCF-A)

[TSE’23] SIEGE: A Semantics-Guided Safety Enhancement Framework for AI-Enabled Cyber-Physical Systems

Jiayang Song, Xuan Xie, Lei Ma

11.  In Proceedings of the IEEE/ACM International Conference on Software Engineering (ICSE), 2022. (CCF-A)

[ICSE’22] When Cyber-Physical Systems Meet AI: A Benchmark, an Evaluation, and a Way Forward

Jiayang Song, Deyun Lyu, Zhenya Zhang, Zhijie Wang, Tianyi Zhang, Lei Ma

Professional Society Membership

Member, Institute of Electrical and Electronics Engineers (IEEE)

Member, Association for Computing Machinery (ACM)