Xiteng Yao
PhD Candidate, Electrical and Computer Engineering, Boston University
I am a PhD candidate in Computer Engineering at Boston University, advised by Prof. Martin Herbordt in the CAAD Lab (Computer Architecture and Automated Design), expecting to graduate in May 2027.
My research is on systems for large language models: where computation, state, and coordination should live in distributed LLM training and inference. I work across the stack, from programmable switches and SmartNIC datapaths, through collective communication and RDMA, to GPU performance modeling and LLM serving runtimes. I also build FPGA accelerators for secure machine learning, and ask how to measure what really helps LLM agents that optimize code.
I have interned at Arm as an AI Research Scientist Intern, building an attention–FFN disaggregated LLM inference runtime that, on models of up to 2.4T parameters across 36 GB200 GPUs, reached up to 67% higher throughput than vLLM, and at Amazon Web Services as an Applied Scientist Intern, where I built KernelSight-LM, a kernel-level LLM inference simulator. More in experience and the CV.
Research interests: LLM training and inference systems · SmartNIC/FPGA acceleration · programmable and stateful switches · collective communication · GPU performance modeling · AI for performance engineering · privacy-preserving computation.
news
| Sep 2026 | Three papers at IEEE HPEC 2026: ACBench, PoolStateLens, and RL-guided GPU compiler optimization on Blackwell. Research |
|---|---|
| Jun 2026 | KernelSight-LM, a kernel-level LLM inference simulator from my AWS internship, is on arXiv. Research page |
| Jun 2026 | Presented SmartFuse-LLM at HEART 2026: fusing computation into collectives projects 50.5% lower per-boundary latency. Research page |
| May 2026 | Started as an AI Research Scientist Intern at Arm in Seattle, working on attention–FFN disaggregated LLM inference. Experience |
| Sep 2025 | Our paper Accelerating Multi-Party Computation Using Heterogeneous Systems received the Outstanding Student Paper Award at IEEE HPEC 2025. Research page |
| Aug 2025 | Started as an Applied Scientist Intern at Amazon Web Services in Santa Clara. Experience |
selected publications
- Accelerating Multi-Party Computation Using Heterogeneous SystemsOutstanding Student Paper AwardIn 2025 IEEE High Performance Extreme Computing Conference (HPEC), 2025