Jiahao Ying

Jiahao Ying

Examiner of Language Models · Fudan University

About Me

I am a postdoctoral research fellow at Fudan University, working with Yixin Cao. I received my Ph.D. from Singapore Management University, supervised by Yixin Cao and Qianru Sun. My research focuses on developing generalizable, reliable, and effective methods for the evaluation and self-improvement of Large Language Model (LLM) systems.

Research Interests

LLMs Evaluation

  • Automated evaluation data generation
  • Reliable evaluator development

LLMs Improvement

  • Adaptive learning strategies

News

Publications

Jiahao Ying, Wei Tang, Boxian Ai, Yaoning Wang, Haotian Chen, Wenhe Sun, Caijun Xu, Haozhan Cai, Changyi Xiao, Yixin Cao
Preprint Project
A belief climbs the layers; how much it is revised on the way up is the measurement.
Jiahao Ying, Boxian Ai, Wei Tang, Siyuan Liu, Yixin Cao
EMNLP 2026 · Findings PDF Code Project
An auditor sweeps the open-skill shelf — most pass, one gets flagged.
Shibo Hong, Jiahao Ying, Haiyuan Liang, Mengdi Zhang, Jun Kuang, Jiazheng Zhang, Yixin Cao
ICLR 2026 · Oral PDF Code Project
Text, images, or both interleaved — one judge grades them all, aspect by aspect.
Yixin Cao, Jiahao Ying, Yaoning Wang, Xipeng Qiu, Xuanjing Huang, Yugang Jiang
Preprint PDF Code
Great score — but peek inside, and only a few neurons are doing the work.
Jiahao Ying, Wei Tang, Yiran Zhao, Yixin Cao, Yu Rong, Wenxuan Zhang
ACL 2025 · Main PDF Code Project
One question, untangled into two axes — language and culture — then graded cell by cell.
Jiahao Ying, Yixin Cao, Yushi Bai, Qianru Sun, Bo Wang, Wei Tang, Zhaojun Ding, Yizhe Yang, Xuanjing Huang, Shuicheng Yan
NeurIPS 2024 · Poster PDF Code Project
Benchmarks go stale; this one refreshes itself to v2, automatically.
Jiahao Ying, Mingbao Lin, Yixin Cao, Wei Tang, Bo Wang, Qianru Sun, Xuanjing Huang, Shuicheng Yan
EMNLP 2024 · Findings PDF Code Project
Mistakes loop back as lessons — until the ✗ turns into a ✓.
Jiahao Ying, Yixin Cao, Kai Xiong, Yidong He, Long Cui, Yongbin Liu
ACL 2024 · Main PDF Code
Trust its own memory, or follow the prompt? A tug-of-war in slow motion.
Wei Tang, Yixin Cao, Jiahao Ying, Bo Wang, Yuyue Zhao, Yong Liao, Pengyuan Zhou
ACL 2024 · Findings PDF
A generator writes, a reader reads — together they climb above the solo baseline.
Yushi Bai*, Jiahao Ying*, Yixin Cao, Xin Lv, Yuze He, Xiaozhi Wang, Jifan Yu, Kaisheng Zeng, Yijia Xiao, Haozhe Lyu, Jiayin Zhang, Juanzi Li, Lei Hou
NeurIPS 2023 · Poster PDF
A language model sets the exam, grades the answer, and stamps the score.

Services

Conference Reviewer

  • Association for Computational Linguistics (ACL) 2023, 2024, 2025
  • Empirical Methods in Natural Language Processing (EMNLP) 2023, 2024
  • International Conference on Learning Representations (ICLR) 2024, 2025
  • Conference on Language Modeling (COLM) 2024