Xi Xiao at Harvard University

Hello, I'm Xi Xiao.

I am an AI Researcher

I am a Ph.D. Candidate in Computer Science at the University of Alabama at Birmingham, co-advised by Prof. Tianyang Wang and Prof. Min Xu. I'm also a student researcher at Oak Ridge National Laboratory working with Dr. Xiao Wang since May 2025.

I am actively seeking Research Internship opportunities in Summer 2027. If your team is hiring researchers in MLLM / Agentic post-training-related areas, or if you know of relevant opportunities, please feel free to reach out. Thank you!

Experience


Research Scientist Intern @ Oak Ridge National Laboratory
Knoxville, Tennessee, USA
Working with Dr. Xiao Wang and Dr. Dan Lu. Co-Lead the Foundation Model Team. Contributing to the “Genesis Mission” to advance AI4Science discovery through the pre-training and post-training of Foundation Model.
Applied Scientist Intern @ Amazon AGI Foundations
Seattle, Washington, USA
Working with Dr. Eric Zhao and Dr. Youngeun Kim on MLLM / Agentic Reasoning / RL.
Research Scientist Intern @ Oak Ridge National Laboratory
Knoxville, Tennessee, USA
Working with Dr. Xiao Wang on MLLM post-training and exascale distributed pretraining.

Education


Ph.D. in Computer Science
University of Alabama at Birmingham
Birmingham, Alabama, USA ยท Expected Fall 2027
Bachelor's Degree in Artificial Intelligence
Sichuan University Jincheng College
Chengdu, Sichuan, China

Research Interest


My earlier research focused on understanding and shaping the intelligence and behavior of foundation models through post-training techniques. I'm currently extending this focus to agents, exploring how reinforcement learning (RL) and other post-training techniques can improve their capabilities and behavior, with a particular focus on agent memory, harness engineering, recursive self-improvement (RSI), and reasoning.

News


Scroll for earlier updates

2026
  • [10] Recognized as a CVPR 2026 Outstanding Reviewer.
  • [10] Two papers accepted by WACV 2027! See you in Orlando!
  • [09] Four papers accepted by NeurIPS 2026! See you in Atlanta!
  • [09] One paper accepted by TMLR!
  • [08] We are organizing the 1st Latent Visual Reasoning (LVR) Workshop at WACV 2027. See you in Orlando!
  • [08] Two papers accepted by EMNLP 2026 Findings!
  • [08] Join Oak Ridge National Laboratory as a Research Scientist Intern again!
  • [08] We are organizing the Scale to See: Scalable AI for Scientific Imaging and Spatiotemporal Data Workshop at SC 2026!
  • [07] One paper accepted by TMLR!
  • [07] One paper accepted by ACM MM 2026!
  • [06] Five papers accepted by ECCV 2026!
  • [05] New preprint is out: Agent Harness Engineering: A Survey.
  • [05] Recognized as an ICML 2026 Silver Reviewer.
  • [05] One paper accepted by MICCAI 2026 Spotlight ๐Ÿ†!
  • [05] Join Amazon AGI as an Applied Scientist Intern!
  • [04] One paper accepted by ICML 2026!
  • [04] Two papers accepted by ACL 2026 (one Main conference, one Findings)! See you in San Diego!
  • [03] One paper accepted by ICME 2026!
  • [02] Three papers accepted by CVPR 2026! See you in Denver!
  • [01] One paper accepted by TMLR!
  • [01] Two papers accepted by ICASSP 2026 Oral ๐Ÿ†!
2025
  • [12] ๐ŸŽ‰ Received a Tinker Research Grant ($5,000) from Thinking Machines Lab to support my post-training related research!
  • [11] One paper accepted by SC 2025 โ€” Best Paper Award ๐Ÿ† Deeply honored to be the only student author.
  • [11] ๐ŸŽ‰ Big News: Our Work Was Featured by AMD! Read the story
  • [11] Two papers accepted by WACV 2026!
  • [11] One paper accepted by AAAI 2026!
  • [09] One paper accepted by NeurIPS 2025! See you in San Diego!
  • [09] One paper accepted by WACV 2026! Round 1 Acceptance (85/1329 โ‰ˆ 6.4%)
  • [08] One paper accepted by EMNLP 2025 (Findings)!
  • [07] Our work selected as a finalist for the ACM Gordon Bell Prize ๐Ÿ†
  • [07] One paper accepted by COLM 2025!
  • [07] One paper accepted by ACM MM 2025!
  • [06] One paper accepted by ICCV 2025!
  • [05] One paper accepted by ECML-PKDD 2025!
  • [05] Join Oak Ridge National Laboratory as a Research Scientist Intern!
2024
  • [12] One paper accepted by ICASSP 2025!
  • [01] Started Ph.D. in Computer Science at the University of Alabama at Birmingham!

Preprints

MLLM Reasoning | Scaling Law | Post-training

Rethinking Latent Visual Reasoning: Grounding Latent Reasoning in Visual Evidence

Xi Xiao, Tianchen Zhao, Youngeun Kim, Zhuowei Li, Linghan Xu, Jiaye Wu, Zheng Zhang, Xiang Xu, Xuanbai Chen, Farhan Tejani, Jakub Zablocki, Julia Xu, Yifan Xing
Preprint 2026PaperProject

We expose an evidence-credit gap in latent visual reasoning and train continuous latent trajectories with explicit visual supervision, grounding reasoning without changing inference.

Work done during an internship at Amazon AGI.
Ranked #1 on Hugging Face Daily Papers.

Agentic Reasoning | Adaptive Reasoning | Agentic Routing

FORGE: Form-Optimal Routing of Grounded Evidence for Frozen LLM Agents

Xi Xiao, Yunbei Zhang, Chen Liu, Lin Zhao, Jialin Chen, Tianchen Zhao, Xiang Xu, Youngeun Kim, Tianyang Wang, Min Xu
Preprint 2026PaperProject

A lightweight router jointly selects evidence form and reasoning depth for each query, improving quality-cost trade-offs around frozen language models without changing their weights.

Selected Publications Selected work; see the full list on Google Scholar. * indicates equal contribution.


2026

Post-training | Foundation Model Adaptation

Adapting Vision Foundation Models with Cascaded Semantics

Xi Xiao, Xingjian Li, Cheng Han, Tianyang Wang, Lin Zhao, Yunbei Zhang, Guosheng Hu, Runmin Jiang, Xi Li, Xiao Wang, Min Xu

Color, texture, shape, and attention-derived priors guide visual prompts across transformer layers, enabling efficient adaptation of frozen vision models to diverse recognition tasks.


Post-Training | MLLM Reasoning | Visual Alignment

Staying VIGILant: Mitigating Visual Laziness via Counterfactual Visual Alignment in MLLMs

Xi Xiao, Chen Liu, Chih-Ting Liao, Yunbei Zhang, Qizhen Lan, Yuxiang Wei, Lin Zhao, Janet Wang, Jianyang Gu, Muchao Ye, Tianyang Wang, Hao Xu

By contrasting seeing and counterfactually blind responses, VIGIL discourages reliance on language priors and improves visual grounding during multimodal preference-based post-training.


Post-training | Foundation Model Adaptation

Layer-Specific Prompt Fusion Discovery via Differentiable Search in Vision Foundation Models

Xi Xiao, Xingjian Li, Yunbei Zhang, Cheng Han, Tianming Liu, Tianyang Wang, Runmin Jiang, Jihun Hamm, Xiao Wang, Min Xu

Differentiable architecture search discovers how each transformer layer should fuse prompts with image tokens, improving adaptation over a single fixed prompt-injection rule.


Post-training | Foundation Model Adaptation

Not All Directions Matter: Towards Structured and Task-Aware Low-Rank Model Adaptation

Xi Xiao, Chenrui Ma, Yunbei Zhang, Chen Liu, Yanshu Li, Lin Zhao, Guosheng Hu, Tianyang Wang, Hao Xu

Information-bottleneck filtering removes task-irrelevant low-rank directions, while a training-only graph coordinates layer updates to improve adaptation without adding inference overhead.


Post-training | Foundation Model Adaptation

Rethinking Layer-Wise Information Allocation for Vision Foundation Model Adaptation

Yuqi Li*, Xi Xiao*, Yunbei Zhang, Lin Zhao, Yu Li, Aiden Zhao, Tianyang Wang, Hao Xu, Yingli Tian

Prompted Information Bottlenecks regulate what representations retain and suppress across layers, promoting task-relevant evidence, reduced shortcut reliance, and more robust frozen-model adaptation.


Language Model Pretraining | Representation Learning

Dispersion Loss Counteracts Embedding Condensation and Improves Generalization in Small Language Models

Chen Liu*, Xingzhi Sun*, Xi Xiao*, Alexandre Van Tassel*, Ke Xu, Kristof Reimann, Danqi Liao, Mark Gerstein, Tianyang Wang, Xiao Wang, Smita Krishnaswamy

We identify token embeddings collapsing into narrow cones in smaller language models and introduce dispersion loss to preserve representational diversity and improve generalization.


Post-training | Foundation Model Adaptation | Survey

Prompt-based Adaptation in Large-scale Vision Models: A Survey

Xi Xiao, Yunbei Zhang, Lin Zhao, Yiyang Liu, Xiaoying Liao, Zheda Mai, Xingjian Li, Xiao Wang, Hao Xu, Jihun Hamm, Xue Lin, Min Xu, Qifan Wang, Tianyang Wang, Cheng Han

A unified framework distinguishes pixel-level visual prompting from token-level prompt tuning, organizing methods, applications, benchmarks, and open challenges in adapting large-scale vision models.


2025

Post-training | Foundation Model Adaptation

Visual Instance-aware Prompt Tuning

Xi Xiao, Yunbei Zhang, Xingjian Li, Tianyang Wang, Xiao Wang, Yuxiang Wei, Jihun Hamm, Min Xu

Image-conditioned prompt generation combines instance-aware and dataset-level prompts, while PCA-based propagation preserves useful prompting information as it moves through frozen transformer layers.


Post-training | Personalized Video Generation

MagicID: Hybrid Preference Optimization for ID-Consistent and Dynamic-Preserved Video Customization

Hengjia Li*, Lifan Jiang*, Xi Xiao*, Tianyang Wang, Hongwei Yi, Boxi Wu, Deng Cai

Hybrid preference optimization balances identity preservation and motion quality, learning from paired customized videos to produce identity-consistent outputs with richer natural dynamics.


AI for Science | Exascale Pretraining | Foundation Model

ORBIT-2: Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling

Xiao Wang, Jong-Youl Choi, Takuya Kurihaya, Isaac Lyngaas, Hong-Jun Yoon, Xi Xiao, David Pugmire, Ming Fan, Nasik M. Nafi, Aristeidis Tsaris, Ashwin M. Aji, Maliha Hossain, Mohamed Wahib, Dali Wang, Peter Thornton, Prasanna Balaprakash, Moetasim Ashfaq, Dan Lu

A scalable vision foundation model combines efficient residual prediction and tile-wise sequence processing to enable high-resolution climate downscaling on exascale computing systems.

Best Paper Award, Gordon Bell Prize Finalist
Work conducted during an internship at ORNL
In collaboration with ORNL, RIKEN, AMD, and NVIDIA

Awards & Honors


Miscellanea


Talks & Media

Academic Service

Conference Reviewer
  • International Conference on Learning Representations (ICLR) 2027
  • IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2027
  • AAAI Conference on Artificial Intelligence (AAAI) 2026, 2027
  • International Conference on Machine Learning (ICML) 2026 Silver Reviewer
  • International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2026
  • IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2026
  • European Conference on Computer Vision (ECCV) 2026
  • Annual Conference on Neural Information Processing Systems (NeurIPS) 2025, 2026
  • ACM Multimedia (MM) 2025, 2026
  • International Conference on Artificial Neural Networks (ICANN) 2025, 2026
  • International Joint Conference on Neural Networks (IJCNN) 2025, 2026
  • International Conference on Neural Information Processing (ICONIP) 2024, 2025
Journal Reviewer
  • Transactions on Machine Learning Research (TMLR)
  • Information Fusion
  • Information Sciences
  • Information Processing & Management (IPM)
  • IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
  • IEEE Transactions on Multimedia (TMM)
  • IEEE Transactions on Systems, Man, and Cybernetics: Systems
  • npj Digital Medicine
  • Remote Sensing of Environment (RSE)
  • ISPRS Journal of Photogrammetry and Remote Sensing (ISPRS JPRS)
  • Mechanical Systems and Signal Processing (MSSP)
  • Engineering Applications of Artificial Intelligence
  • ISPRS Open Journal of Photogrammetry and Remote Sensing
  • Frontiers in Imaging
  • International Journal of Human-Computer Interaction
  • Journal of Magnetic Resonance Imaging
Workshop Reviewer
  • Multi-modal Foundation Models and Large Language Models for Life Sciences (FM4LS), ICML 2025, 2026; NeurIPS 2025
  • Multi-Turn Interactions in Large Language Models (MTI-LLM), NeurIPS 2025
  • Multimodal Foundation Models for Spatial Intelligence (MFMSI), ACM Multimedia 2025
  • Meta-Agents: Managing Agents that Manage Agents, NeurIPS 2026
  • Women in Computer Vision (WiCV), ECCV 2024
Professional Activities