With the rise of large language models, service providers offer language models as a service, enabling users to fine-tune customized models via uploaded private datasets. However, this raises concerns about sensitive data leakage. Prior methods, relying on differential privacy within device-cloud collaboration frameworks, struggle to balance privacy and utility, exposing users to inference attacks or degrading fine-tuning performance. To address this, we propose PrivTune, an efficient and privacy-preserving fine-tuning framework via Split Learning (SL). The key idea of PrivTune is to inject crafted noise into token representations from the SL bottom model, making each token resemble the $n$-hop indirect neighbors. PrivTune formulates this as an optimization problem to compute the optimal noise vector, aligning with defense-utility goals. On this basis, it then adjusts the parameters (i.e., mean) of the $d_χ$-Privacy noise distribution to align with the optimization direction and scales the noise according to token importance to minimize distortion. Experiments on five datasets (covering both classification and generation tasks) against three embedding inversion and three attribute inference attacks show that, using RoBERTa on the Stanford Sentiment Treebank dataset, PrivTune reduces the attack success rate to 10% with only a 3.33% drop in utility performance, outperforming state-of-the-art baselines.
Federated Learning for Cross-Domain Data Privacy: A Distributed Approach to Secure Collaboration
Cornell University(康奈尔大学);University of Minnesota(明尼苏达大学);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);University of California, Berkeley(加利福尼亚大学伯克利分校);Illinois Institute of Technology(伊利诺伊理工大学)
Federated Inference: Toward Privacy-Preserving Collaborative and Incentivized Model Serving
Department of Electrical Engineering and Computer Science, University of Stavanger(电子工程与计算机科学系,斯塔万格大学);Department of Data Science, The Catholic University of Korea(数据科学系,韩国天主大学)
Federated Learning-Based Data Collaboration Method for Enhancing Edge Cloud AI System Security Using Large Language Models
College of Computing and Information Science(计算与信息科学学院);Siebel School of Computing and Data Science(计算与数据科学学院);Cornell University(康奈尔大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);New York, USA(美国纽约);Champaign, Illinois, USA(美国伊利诺伊州香槟)
Empowering Digital Agriculture: A Privacy-Preserving Framework for Data Sharing and Collaborative Research
Department of Computer and Data Sciences(计算机与数据科学系);Case Western Reserve University(凯斯西储大学);School of Computer Science(计算机科学学院);Georgia Institute of Technology(佐治亚理工学院);Department of Planning and Landscape Architecture(规划与景观建筑系);University of Wisconsin–Madison(威斯康星大学麦迪逊分校)
Empowering Edge Agents: A Systematic Analysis of Edge-Cloud Collaboration in LLM Agent Execution
School of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);China Mobile Online Services Co., Ltd.(中移在线服务有限公司)
Federated Learning in Chemical Engineering: A Tutorial on a Framework for Privacy-Preserving Collaboration Across Distributed Data Sources
SVKM's Dwarkadas J. Sanghvi College of Engineering(SVKM's 德瓦卡达斯·J.桑格维工程学院);Davidson School of Chemical Engineering, Purdue University(普渡大学戴维森化学工程学院);Federal University of Rio de Janeiro(里约热内卢联邦大学)
Auditing and Mitigating Privacy Leakage in Cloud-Edge Collaborative Decoding
The Hong Kong Polytechnic University(香港理工大学);Institute for AI Industry Research, Tsinghua University(清华大学人工智能产业研究院);School of Software, Tsinghua University(清华大学软件学院)
FairFML: Fair Federated Machine Learning with a Case Study on Reducing Gender Disparities in Cardiac Arrest Outcome Prediction
Duke-NUS Medical School(杜克-新加坡国立大学医学院);Duke University(杜克大学);Kyoto University(京都大学);Singapore Health Services(新加坡保健服务);Singapore General Hospital(新加坡中央医院);NUS Artificial Intelligence Institute(新加坡国立大学人工智能研究所);National University of Singapore(新加坡国立大学)
Privacy-Preserving Generation Fraud Detection for Distributed Photovoltaic Systems: A Solar Irradiance-Fused Federated Learning Framework
School of Computer Science and Technology, University of Electronic Science and Technology of China(电子科技大学计算机科学与技术学院);Department of Data Science and AI, Faculty of IT, Monash University(墨尔本大学信息技术学院数据科学与人工智能系);Monash Energy Institute, Monash University(墨尔本大学莫纳什能源研究所);Shenzhen Institute for Advanced Study of UESTC(电子科技大学深圳研究院)
PDSL: Privacy-Preserved Decentralized Stochastic Learning with Heterogeneous Data Distribution
School of Computer Science and Technology, Shandong University(山东大学计算机科学与技术学院);Shandong Computer Science Center (National Supercomputer Center in Jinan)(山东省计算中心(国家超级计算济南中心));Qilu University of Technology (Shandong Academy of Sciences)(齐鲁工业大学(山东省科学院));Shandong Fundamental Research Center for Computer Science(山东省计算机科学基础研究中心)
From Isolation to Collaboration: Federated Class-Heterogeneous Learning for Chest X-Ray Classification
University of Maryland School of Medicine(马里兰大学医学院);University of Maryland Institute for Health Computing(马里兰大学健康计算研究所);St. Jude Children’s Research Hospital(圣犹大儿童研究医院)
Agglomerative Federated Learning: Empowering Larger Model Training via End-Edge-Cloud Collaboration
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Zhongguancun Laboratory(中关村实验室);Beijing Jiaotong University(北京交通大学)