Siyuan Zhuang (庄思源)

(He is also known as Ryans, Ryan, SIY.Z, suquark.)

I am a graduated CS PhD at UC Berkeley, advised by Professor Ion Stoica and Dawn Song. I am affiliated to Berkeley’s Sky Computing Lab, and LMSYS Org.

Previously, I graduated from University of Science and Technology of China with a Bachelor’s degree in Computer Science (Honors Program).

My current work focuses on large language models, machine learning system, and distributed system.

recent news

June 10, 2024 Ph.D. graduation
Mar 30, 2023 We release Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality

selected publications

    Starburst: A Cost-aware Scheduler for Hybrid Cloud
    Michael Luo, Siyuan Zhuang, Suryaprakash Vengadesan, Romil Bhardwaj, Justin Chang, Eric Friedman, Scott Shenker, Ion Stoica
    In Proceedings of the 2024 USENIX Annual Technical Conference, 2024
  2. ICLR
    LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset
    Lianmin Zheng*, Wei-Lin Chiang*, Ying Sheng, Tianle Li, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zhuohan Li, Zi Lin, Eric P. Xing, Joseph E. Gonzalez, Ion Stoica, Hao Zhang
    In The Twelfth International Conference on Learning Representations, 2024
  3. SOSP
    Efficient Memory Management for Large Language Model Serving with PagedAttention
    Woosuk Kwon*, Zhuohan Li*, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph E. Gonzalez, Hao Zhang, Ion Stoica
    In Proceedings of the 29th Symposium on Operating Systems Principles (pp. 611-626), 2023
  4. NeurIPS
    Judging LLM-as-a-judge with MT-Bench and Chatbot Arena
    Lianmin Zheng*, Wei-Lin Chiang*, Ying Sheng*, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric Xing, Hao Zhang, Joseph E. Gonzalez, Ion Stoica
    Advances in Neural Information Processing Systems, 36, 2023
  5. OSDI
    ExoFlow: A Universal Workflow System for Exactly-Once DAGs.
    Siyuan Zhuang, Stephanie Wang, Eric Liang, Yi Cheng, Ion Stoica
    In 17th USENIX Symposium on Operating Systems Design and Implementation (pp. 269-286), 2023
  6. ICML
    TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models
    Zhuohan Li, Siyuan Zhuang, Shiyuan Guo, Danyang Zhuo, Hao Zhang, Dawn Song, Ion Stoica
    In International Conference on Machine Learning (pp. 6543- 6552). PMLR., 2021
    Hoplite: Efficient Collective Communication for Task-Based Distributed Systems
    Siyuan Zhuang*, Zhuohan Li*, Danyang Zhuo, Stephanie Wang, Eric Liang, Robert Nishihara, Philipp Moritz, Ion Stoica
    Proceedings of the 2021 ACM SIGCOMM 2021 Conference, Pages 641-656, August 2021