Faculty

Email:Rvince@sjtu.edu.cn
Address:电信群楼3-501
Institute:Institute of Advanced Network
Brief Introduction
Dr. Chaoyue Niu is currently a tenure-track assistant professor at Shanghai Jiao Tong University. His research interests mainly include large generative models for mobile devices, collaborative learning between large and small models across mobile devices and cloud, and their applications in industrial scenarios, such as agents, recommender systems, natural language processing, and multimodal content understanding. He has published high-quality papers at top international conferences including ACM MobiCom, USENIX OSDI, NeurIPS, and ACM KDD, and have held multiple granted patents. He has received several honors, including the First Prize of the Shanghai Science and Technology Progress Award (2023, ranked 2nd), the First Prize of the CCF Science and Technology Progress Award (2023, ranked 2nd), the CCF Outstanding Doctoral Dissertation Award (2021), the Excellent Award of the Tencent WeChat Industry–Academia–Research Collaboration Program (2025, Top 5%, project lead), and the Alibaba Group Outstanding Academic Collaboration Project Award (2022, project lead), among others.
Education
Sep 2017 – Jun 2021, Shanghai Jiao Tong University, Ph.D. in Computer Science and Technology
Sep 2013 – Jun 2017, Shanghai Jiao Tong University, IEEE Honor Class, B.S. in Computer Science and Technology
Professional Experience
Jun 2023 – Present, Shanghai Jiao Tong University, Assistant Professor
Jun 2021 – May 2023, Shanghai Jiao Tong University, Postdoctoral Researcher
Teaching Assignment
Undergraduate Course: EE0503 Engineering Practice and Technological Innovation II (Practical Development and Deployment of Deep Learning Models and Algorithms for Mobile Devices)
Graduate Course: CS7316 Mining of Massive Data
Publications
[1] Chaoyue Niu, Fan Wu, Shaojie Tang, Lifeng Hua, Rongfei Jia, Chengfei Lv, Zhihua Wu, and Guihai Chen, "Billion-Scale Federated Learning on Mobile Clients: A Submodel Design With Tunable Privacy," in Proceedings of the 26th Annual International Conference on Mobile Computing and Networking (MobiCom), London, United Kingdom, Sep. 21-25, 2020, pp. 405-418.
[2] Chengfei Lv, Chaoyue Niu (Corresponding Author), Renjie Gu, Xiaotang Jiang, Zhaode Wang, Bin Liu, Ziqi Wu, Qiulin Yao, Congyu Huang, Panos Huang, Tao Huang, Hui Shu, Jinde Song, Bin Zou, Peng Lan, Guohuan Xu, Fei Wu, Shaojie Tang, Fan Wu, and Guihai Chen, "Walle: An End-to-End, General-Purpose, and Large-Scale Production System for Device-Cloud Collaborative Machine Learning," in Proceedings of 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI), Carlsbad, CA, USA, Jul. 11-13, 2022, pp. 249-265.
[3] Tiancheng Fang, Chaoyue Niu (Corresponding Author), Yujie Sun, Chengfei Lv, Xiaotang Jiang, Ben Xue, Fan Wu, and Guihai Chen, "An End-to-End, Low-Cost, and High-Fidelity 3D Video Pipeline for Mobile Devices," in Proceedings of the 30th Annual International Conference on Mobile Computing and Networking (MobiCom), Washington D.C., DC, USA, Nov. 18-22, 2024, pp. 1162-1176.
[4] Yikai Yan, Chaoyue Niu (Corresponding Author), Renjie Gu, Fan Wu, Shaojie Tang, Lifeng Hua, Chengfei Lv, and Guihai Chen, "On-Device Learning for Model Personalization With Large-Scale Cloud-Coordinated Domain Adaptation," in Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), Washington, DC, USA, Aug. 14-18, 2022, pp. 2180-2190.
[5] Yucheng Ding, Chaoyue Niu (Corresponding Author), Fan Wu, Shaojie Tang, Chengfei Lv, and Guihai Chen, "Enhancing On-Device LLM Inference with Historical Cloud-Based LLM Interactions," in Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), Barcelona, Spain, Aug. 25-29, 2024, pp. 597-608.
[6] Yucheng Ding, Yangwenjian Tan, Xiangyu Liu, Chaoyue Niu (Corresponding Author), Fandong Meng, Jie Zhou, Ning Liu, Fan Wu, and Guihai Chen, "Personalized Language Model Learning on Text Data Without User Identifiers", in Proceedings of ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), Toronto, ON, Canada, Aug. 3-7, 2025.
[7] Hang Zeng, Xiangyu Liu, Yong Hu, Chaoyue Niu (Corresponding Author), Fan Wu, Shaojie Tang, and Guihai Chen, "Automated Privacy Information Annotation in Large Language Model Interactions", in Proceedings of ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), Jeju, Korea, Aug. 9-13, 2026.
[8] Gucongcong Fan, Chaoyue Niu (Corresponding Author), Chengfei Lyu, Fan Wu, and Guihai Chen, "CORE: Reducing UI Exposure in Mobile Agents via Collaboration Between Cloud and Local LLMs," in Proceedings of Annual Conference on Neural Information Processing Systems (NeurIPS), San Diego, CA, USA, Dec. 2-7, 2025.
[9] Jiarui Zhang, Xiangyu Liu, Yong Hu, Chaoyue Niu (Corresponding Author), Fan Wu, and Guihai Chen, "RAGRouter: Learning to Route Queries to Multiple Retrieval-Augmented Language Models", in Proceedings of Annual Conference on Neural Information Processing Systems (NeurIPS), San Diego, CA, USA, Dec. 2-7, 2025.
[10] Zewei Xin, Qinya Li, Chaoyue Niu (Co-Corresponding Author), Fan Wu, and Guihai Chen, "Adaptive Routing of Text-to-Image Generation Requests Between Large Cloud Model and Light-Weight Edge Model", in Proceedings of IEEE/CVF International Conference on Computer Vision (ICCV), Honolulu, Hawai'i, USA, Oct. 19-23, 2025.
[11] Hang Zeng, Chaoyue Niu (Corresponding Author), Fan Wu, Chengfei Lv, and Guihai Chen, "Querier-Aware LLM: Generating Personalized Responses to the Same Query from Different Queriers", in Proceedings of ACM International Conference on Information and Knowledge (CIKM), Seoul, Korea, Nov. 10-14, 2025.
Please refer to Google Scholar for more recent work.
Project Fund
NSFC General Program, Key Technologies for Personalized Intelligent Services with Large Generative Models on Mobile Devices, Jan 1, 2026 – Dec 31, 2029, Ongoing, PI
NSFC Young Scientists Fund (C-Class) , Key Technologies for Device-Cloud Collaborative Distributed Intelligent Computing, Jan 1, 2023 – Dec 31, 2025, Completed, PI