I am a PhD candidate at the Ming Hsieh Department of Electrical and Computer Engineering at USC working with Prof. Murali Annavaram. I obtained my Bachelor’s degree from UC Santa Barbara and my Master’s degree from USC.

My research interests are centered around efficient LLM inference and adaptation, machine learning systems, and AI-driven system architecture design. Here is a copy of my CV.

News

• 04/30/2026: Our paper DuetServe: Harmonizing Prefill and Decode for LLM Serving via Adaptive GPU Multiplexing has been accepted to ICML 2026.
• 04/06/2026: Our paper DELTA: Dynamic Layer-Aware Token Attention for Efficient Long-Context Reasoning has been accepted to ACL Findings 2026.
• 03/23/2026: Our USC team launched ClawGang — infrastructure for making agent memory valuable, tradable, and verifiable. Every API token an agent spends becomes certifiable wealth that can be resold.
• 10/02/2025: Our paper DistilLock: Safeguarding LLMs from Unauthorized Knowledge Distillation on the Edge, led by my mentees Asmita Mohanty and Gezheng Kang, has been accepted to the NeurIPS Lock-LLM Workshop 2025.
• 08/20/2025: Our paper MobiZO: Enabling Efficient LLM Fine-Tuning at the Edge via Inference Engines has been accepted to EMNLP Main 2025.
• 07/07/2025: Our paper DEL: Context-Aware Dynamic Exit Layer for Efficient Self-Speculative Decoding has been accepted to CoLM 2025.
• 05/19/2025: Joined Microsoft as a Research Intern in Azure’s Strategic Planning and Architecture group, AI System Architecture team, working on performance modeling for LLM serving systems. Grateful to be mentored by Vinay Gangadhar and Mark Hill.
• 05/15/2025: Our paper KVPR: Efficient LLM Inference with I/O-Aware KV Cache Partial Recomputation has been accepted to ACL Findings 2025.
• 12/10/2024: Our paper Efficient LLM Inference with I/O-Aware Partial KV Cache Recomputation has been accepted to the AAAI SEAS Workshop 2025.
• 10/15/2024: Our paper Enabling Resource-Efficient On-Device Fine-Tuning of LLMs Using Only Inference Engines has been accepted to the NeurIPS ENLSP Workshop 2024.
• 03/13/2024: Our paper Ethos: Rectifying Language Models in Orthogonal Parameter Space has been accepted to NAACL Findings 2024.
• 12/18/2023: Our paper Ethos: Rectifying Language Models in Orthogonal Parameter Space has been accepted to the AAAI ReLM Workshop 2024 (spotlight presentation).

Teaching Assistant

• EE508/599: Systems for Machine Learning (Fall 2023, Spring 2024, Spring 2025). I created slides and final project for our class.
• EE109: Introduction to Embedded Systems (Fall 2024)

Professional Service

• Reviewer: ICML (2026), ARR (Mar 2026, Feb/May/Oct 2025, Dec 2024), ICLR SCOPE Workshop (2025), NeurIPS ENLSP Workshop (2024), IEEE Computer Architecture Letters (2023)

Volunteer Service

• Mentorship: USC CURVE (Fall 2024, Spring 2025), USC VGSA (Fall 2025)
• Talks: KVPR for Efficient LLM Batched Inference (Salesforce 2025, AMD 2025); vLLM for Efficient LLM Online Serving (Palo Alto Networks 2025)