Task-Feature Collaborative Learning with Application to Personalized Attribute Prediction
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);University of Chinese Academy of Sciences(中国科学院大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Peng Cheng Laboratory(鹏城实验室)
As an effective learning paradigm against insufficient training samples, Multi-Task Learning (MTL) encourages knowledge sharing across multiple related tasks so as to improve the overall performance. In MTL, a major challenge springs from the phenomenon that sharing the knowledge with dissimilar and hard tasks, known as negative transfer, often results in a worsened performance. Though a substantial amount of studies have been carried out against the negative transfer, most of the existing methods only model the transfer relationship as task correlations, with the transfer across features and tasks left unconsidered. Different from the existing methods, our goal is to alleviate negative transfer collaboratively across features and tasks. To this end, we propose a novel multi-task learning method called Task-Feature Collaborative Learning (TFCL). Specifically, we first propose a base model with a heterogeneous block-diagonal structure regularizer to leverage the collaborative grouping of features and tasks and suppressing inter-group knowledge sharing. We then propose an optimization method for the model. Extensive theoretical analysis shows that our proposed method has the following benefits: (a) it enjoys the global convergence property and (b) it provides a block-diagonal structure recovery guarantee. As a practical extension, we extend the base model by allowing overlapping features and differentiating the hard tasks. We further apply it to the personalized attribute prediction problem with fine-grained modeling of user behaviors. Finally, experimental results on both simulated dataset and real-world datasets demonstrate the effectiveness of our proposed method
Attributed Graph Clustering in Collaborative Settings
School of Mathematical Sciences, Zhejiang University(浙江大学数学科学学院);School of Cyber Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);antgroup(蚂蚁集团)
Semantic Communication in Dynamic Channel Scenarios: Collaborative Optimization of Dual-Pipeline Joint Source-Channel Coding and Personalized Federated Learning
Beijing Institute of Technology(北京理工大学);Institute of Computer Application Technology Norinco Groups(中国兵器工业集团计算机应用技术研究所)
FedAGHN: Personalized Federated Learning with Attentive Graph HyperNetworks
Tsinghua University(清华大学);Fuyao University of Science and Technology(福耀科技大学);Hong Kong University of Science and Technology(香港科技大学);Shenzhen University(深圳大学);Southern University of Science and Technology(南方科技大学)
Learning Personalized Attribute Preference via Multi-task AUC Optimization
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);University of Chinese Academy of Sciences(中国科学院大学)
Personalized Federated Learning on Heterogeneous and Long-Tailed Data via Expert Collaborative Learning
Xiamen University(厦门大学);University College London(伦敦大学学院);A*STAR Institute of High Performance Computing(新加坡高性能计算研究院);Guangdong University of Technology(广东工业大学);Guangdong Laboratory of Artificial Intelligence and Digital Economy(广东省人工智能与数字经济实验室)
A Novel TSK Fuzzy System Incorporating Multi-view Collaborative Transfer Learning for Personalized Epileptic EEG Detection
School of Artificial Intelligence and Computer Science, Jiangnan University and Engineering Research Center of Intelligent Technology for Healthcare, Ministry of Education(江南大学人工智能与计算机科学学院,智能医疗技术工程研究中心,教育部);School of Computer and Information Engineering, Institute for Artificial Intelligence, Shanghai Polytechnic University(上海理工大学计算机与信息工程学院,人工智能研究院);School of Internet of Things Engineering, Wuxi University(无锡大学物联网工程学院)
Harnessing Data from Clustered LQR Systems: Personalized and Collaborative Policy Optimization
Department of Electrical and Computer Engineering(电气与计算机工程系);North Carolina State University(北卡罗来纳州立大学);The Elmore Family School of Electrical and Computer Engineering(埃尔莫尔家族电气与计算机工程学院);Purdue University(普渡大学)
Communication-Efficient Personalized Federated Learning via Layer-Wise Multi-Threshold Random Sketching
School of Artificial Intelligence, Xidian University(西安电子科技大学人工智能学院);School of Automation, Northwestern Polytechnical University(西北工业大学自动化学院);Faculty of Infor-X, Xidian University(西安电子科技大学Infor-X学院);College of Artificial Intelligence, Inner Mongolia Normal University(内蒙古师范大学人工智能学院)
Pairwise and Attribute-Aware Decision Tree-Based Preference Elicitation for Cold-Start Recommendation
KU Leuven, Campus Kulak, Department of Public Health and Primary Care(KU莱顿大学);Itec, imec research group at KU Leuven(Itec);KU Leuven, Department of Mathematics(KU莱顿大学)
FedAH: Aggregated Head for Personalized Federated Learning
College of Computer Science Chongqing University Chongqing, China;School of Computer Science;Technology Beijing Institute of Technology Beijing, China;Technology Xi'an Jiaotong University Xi'an, China