Shutian Luo

Assistant Professor at the University of Macau

newHomepage.jpg
Email: shutianluo Email address

I am a tenure-track Assistant Professor in the Department of Computer Science at the University of Macau. I received my Ph.D. from the University of Chinese Academy of Sciences in 2023, advised by Prof. Chengzhong Xu and working closely with Prof. Huanle Xu. Before joining the University of Macau, I conducted research at ByteDance in Seattle and held postdoctoral positions at the University of Virginia, working with Prof. Haiying Shen, and Yale University, working with Prof. Lin Zhong and Prof. Anurag Khandelwal.

My research interests lie broadly in AI systems, cloud computing, and distributed systems, with an emphasis on building efficient AI infrastructure over emerging heterogeneous computing architectures. I lead the AI Infra Group at the University of Macau. Current focus: Efficient LLM Systems · CPU–GPU Superchips · Physical AI

I am recruiting 2–3 self-motivated Ph.D. students for Fall 2027. Prospective students interested in AI systems, AI infrastructure and distributed systems are encouraged to get in touch.

News

Mar 26, 2026 DirectKV was accepted to OSDI ’26! The first work on LLM KV-cache offloading using NVIDIA Superchips. The code is now available on GitHub.
Oct 15, 2025 Alibaba trace analysis about diffusion model was accepted by SoCC’25! Congrats to Yanyin!
Feb 15, 2025 Grad was accepted by HPCA’25! Congrats to Chenliao!
Jan 15, 2025 Imbres was accepted by ASPLOS’25!

Selected Publications

  1. OSDI’26
    No Buffer, No Bottleneck: Efficient Zero-Copy KV Cache Offloading for Long-Context LLMs
    Shutian Luo and Haiying Shen
    In Proceedings of the 20th USENIX Symposium on Operating Systems Design and Implementation (OSDI ’26), 2026
    Code
  2. HPDC’26
    Cremes: Cost-Efficient and Reliable Microservice Execution on Spot Instances
    Liao Chen, Chenyu Lin, Junlin Chen, and 3 more authors
    In Proceedings of the 35th ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC ’26), 2026
  3. ASPLOS’25
    Embracing Imbalance: Dynamic Load Shifting among Microservice Containers in Shared Clusters
    Shutian Luo, Jianxiong Liao, Huanle Xu, and 2 more authors
    In Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS ’25), 2025
  4. SoCC’25
    Understanding Diffusion Model Serving in Production: A Top-Down Analysis of Workload, Scheduling, and Resource Efficiency
    Yanying Lin, Shuaipeng Wu, Shutian Luo, and 8 more authors
    In Proceedings of the 16th ACM Symposium on Cloud Computing (SoCC ’25), 2025
  5. ISCA’24
    Derm: SLA-aware Resource Management for Highly Dynamic Microservices
    Liao Chen, Shutian Luo, Chenyu Lin, and 4 more authors
    In Proceedings of the 51st Annual IEEE/ACM International Symposium on Computer Architecture (ISCA ’24), 2024
  6. ASPLOS’23
    Erms: Efficient Resource Management for Shared Microservices with SLA Guarantees
    Shutian Luo, Huanle Xu, Kejiang Ye, and 5 more authors
    In Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS ’23), 2023
  7. SoCC’22
    The Power of Prediction: Microservice Auto Scaling via Workload Learning
    Shutian Luo, Huanle Xu, Kejiang Ye, and 4 more authors
    In Proceedings of the 13th ACM Symposium on Cloud Computing (SoCC ’22), 2022
  8. SoCC’21
    Characterizing Microservice Dependency and Performance: Alibaba Trace Analysis
    Shutian Luo, Huanle Xu, Chengzhi Lu, and 6 more authors
    In Proceedings of the 12th ACM Symposium on Cloud Computing (SoCC ’21), 2021
  9. TOCS
    Optimizing Resource Management for Shared Microservices: A Scalable System Design
    Shutian Luo, Chenyu Lin, Kejiang Ye, and 5 more authors
    ACM Transactions on Computer Systems, 2024