Lei Gao

I am a PhD student at the Ming Hsieh Department of Electrical and Computer Engineering at USC working with Prof. Murali Annavaram. I obtained my Bachelor’s degree from UC Santa Barbara and my Master’s degree from USC.

My research interests are centered around efficient LLM inference and adaptation, machine learning systems, and responsible AI. Here is a copy of my CV.

News

Teaching Assistant

Professional Service

  • Reviewer: ARR (2025, 2024), ICLR SCOPE Workshop (2025), NeurIPS ENLSP Workshop (2024), IEEE Computer Architecture Letters (2023)

Volunteer Service

  • Mentorship: USC CURVE (Fall 2024, Spring 2025), USC VGSA (Fall 2025)
  • Talks: KVPR for Efficient LLM Batched Inference (Salesforce 2025, AMD 2025); vLLM for Efficient LLM Online Serving (Palo Alto Networks 2025)