profile_picture
Yuheng Huang
Ph.D. Student, The University of Tokyo
{First Name} dot {Last Name} {42} at {gmail} dot com

Short Bio I’m currently a Ph.D. student at Momentum Lab, Dept. of Computer Science at The University of Tokyo, working under the supervision of Prof. Lei Ma. I chose to “master out” and have graduated from University of Alberta. During my stay at UofA, I was fortunate to be funded by AMII for my M.Sc. study. My research interests primarily focus on the quality assurance of complex systems, with a particular emphasis on testing, analysis, monitoring, and verification techniques. In addition, I am also interested in exploring the robustness of AI models and developing Human-Computer Interaction (HCI) solutions for machine learning (ML) development. I also possess experience in AI stack and blockchain technologies. Before joining Momentum Lab, I was fortunate to work with Prof. Haoyu Wang, Prof. Dan Pei and Prof. Yuanchun Li.

Interests

  • Quality Assurance of Complex AI Systems. This involves the exploration of how we can interpret, analyze, enhance, and safeguard AI systems in this direction.
  • Robustness of AI Models. This involves a special focus on standalone AI modules such as CNN, RNN, and Transformers (LLMs).
  • Machine Learning Operations. This involves designing interactive tools to alleviate the burdens of different stakeholders in leveraging, developing, and operating state-of-the-art AI techniques.

Academia

The University of Tokyo
2024 - present
Ph.D. Student Computer Science
Supervised by Prof. Lei Ma
University of Alberta
2021 - 2023
M.Sc. Electrical and Computer Engineering
Supervised by Prof. Lei Ma
Beijing University of Posts and Telecommunications
2017 - 2021
B.Sc. Computer Science
Supervised by Prof. Haoyu Wang and Prof. Yuanchun Li

Recent Publications

Look Before You Leap: An Exploratory Study of Uncertainty Measurement for Large Language Models, 2025, (TSE'25) Transactions on Software Engineering
Yuheng Huang , Jiayang Song , Zhijie Wang , Shengming Zhao , Huaming Chen , Felix Juefei-Xu , Lei Ma
pdf

Multilingual Blending: Large Language Model Safety Alignment Evaluation with Language Mixture, 2025, (NAACL'25 Findings) 2025 Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics
Jiayang Song , Yuheng Huang , Zhehua Zhou , Lei Ma
pdf

TESTEVAL: Benchmarking Large Language Models for Test Case Generation, 2025, (NAACL'25 Findings) 2025 Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics
Wenhan Wang* , Chenyuan Yang* , Zhijie Wang* , Yuheng Huang , Zhaoyang Chu , Da Song , Lingming Zhang , An Ran Chen , Lei Ma
pdf

Are LLMs Correctly Integrated into Software Systems?, 2025, (ICSE'25) 47th IEEE/ACM International Conference on Software Engineering
Yuchen Shao , Yuheng Huang , Jiawei Shen , Lei Ma , Ting Su , Chengcheng Wan
pdf

Towards Understanding the Characteristics of Code Generation Errors Made by Large Language Models, 2025, (ICSE'25) 47th IEEE/ACM International Conference on Software Engineering
Zhijie Wang* , Zijie Zhou* , Da Song* , Yuheng Huang , Shengmai Chen , Lei Ma , Tianyi Zhang
pdf

PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement, 2024, (CHI'24) The ACM CHI Conference on Human Factors in Computing Systems
Zhijie Wang , Yuheng Huang , Da Song , Lei Ma , Tianyi Zhang
pdf

LUNA: A Model-Based Universal Analysis Framework for Large Language Models, 2023, (TSE'24) Transactions on Software Engineering
Da Song , Xuan Xie , Jiayang Song , Derui Zhu , Yuheng Huang , Felix Juefei-Xu , Lei Ma
pdf

Generation-Based Differential Fuzzing for Deep Learning Libraries, 2023, (TOSEM'23) ACM Transactions on Software Engineering and Methodology
Jiawei Liu , Yuheng Huang , Zhijie Wang , Lei Ma , Chunrong Fang , Mingzheng Gu , Xufan Zhang , Zhenyu Chen
pdf

PatchCensor: Patch Robustness Certification for Transformers via Exhaustive Testing, 2023, (TOSEM'23) ACM Transactions on Software Engineering and Methodology
Yuheng Huang , Lei Ma , Yuanchun Li
pdf

DeepLens: Interactive Out-of-distribution Data Detection in NLP Models, 2023, (CHI'23) The ACM CHI Conference on Human Factors in Computing Systems
Da Song* , Zhijie Wang* , Yuheng Huang , Lei Ma , Tianyi Zhang
pdf

DeepSeer: Interactive RNN Explanation and Debugging via State Abstraction, 2023, (CHI'23) The ACM CHI Conference on Human Factors in Computing Systems
Zhijie Wang , Yuheng Huang , Da Song , Lei Ma , Tianyi Zhang
pdf

An Exploratory Study of AI System Risk Assessment from the Lens of Data Distribution and Uncertainty, 2022, Preprint
Zhijie Wang , Yuheng Huang , Lei Ma , Haruki Yokoyama , Susumu Tokumoto , Kazuki Munakata
pdf

Understanding (mis) behavior on the eosio blockchain, 2020, (SIGMETRICS'20) Proceedings of the ACM on Measurement and Analysis of Computing Systems
Yuheng Huang , Haoyu Wang , Lei Wu , Gareth Tyson , Xiapu Luo , Run Zhang , Xuanzhe Liu , Gang Huang , Xuxian Jiang
pdf video

Service and Talks

[Review] Conference reviewer for Neurips 2023, 2024 Dataset and Benchmark Track
[Review] Conference subreviewer for RADAS 2021, ISSRE 2022
[Review] Committee Member in ICSE'25 Artifact Evaluation
[Review] Journal reviewer for Computers & Security, IEEE Transactions on Reliability
[Talk] Tutorial on AI Quality Assurance at SEMLA'22, Oct., 2022
[Talk] Tutorial on AI Quality Assurance at ASE'22, Oct., 2022
[Teaching] Till Feb 1, 2025, I have helped 8+ students with their research projects, including five undergraduates' and one master's thesis.
[Teaching] TA of 「Software Engineering」(ソフトウェア工学@the University of Tokyo)
[Teaching] TA of 「Trustworthiness Assurance for Data-Driven AI Software Systems」(AI ソフトウェアの信頼性保証特論@the University of Tokyo)
[Teaching] Laboratory TA of 「the Introduction to the Basics of Intelligent Software Engineering」(初ゼミ@the University of Tokyo)
[Volunteer] Student volunteer at MODELS 2021

Hobby

When I'm free, I like to play video games, watch anime, and read books. Most of them are about fiction (especially Sci-Fi). For anime, I particularly like Cowboy Bebop , Ghost In The Shell , and Made in Abyss . For Sci-Fi, I'm a big fan of Cixin Liu , Vernor Steffen Vinge , Hannu Rajaniemi , and Isaac Asimov . I would say Sci-Fi shapes my dream, and those brilliant ideas are one of the biggest motivations for my research. They, together with the help of my supvervisors and friends, help me go through the hardest time.

In the second year of my undergraduate study, I was lost and in complete despair. One day I left all my work and spent the whole day writing a Sci-Fi novel with over 10,000 Chinese words. That novel, entitled Under the Tide (Chinese: 浪潮之下), received the first prize in a nationwide competition . Although I would say that was more a fluke, it still successfully conveyed an idea that I was trying to express. However, as I am unsatisfied with my writing skills, I have stopped writing for years. I hope to write something that can also encourage a kid like me in the future.