Lei Gao

I am a PhD candidate at the Ming Hsieh Department of Electrical and Computer Engineering at USC working with Prof. Murali Annavaram. I obtained my Bachelor’s degree from UC Santa Barbara and my Master’s degree from USC.

My research interests are centered around LLM inference and training systems, efficient machine learning algorithms, and responsible AI. Here is a copy of my CV.

Check out my daily arXiv paper tracker for recent research in machine learning systems.

News

Teaching Assistant

Professional Service

  • Reviewer: ICML (2026), ARR (Mar 2026, Feb/May/Oct 2025, Dec 2024), ICLR SCOPE Workshop (2025), NeurIPS ENLSP Workshop (2024), IEEE Computer Architecture Letters (2023)

Volunteer Service

  • Mentorship: USC CURVE (Fall 2024, Spring 2025), USC VGSA (Fall 2025)
  • Talks: KVPR for Efficient LLM Batched Inference (Salesforce 2025, AMD 2025); vLLM for Efficient LLM Online Serving (Palo Alto Networks 2025)