Agents operating in unstructured environments often produce negative side effects (NSE), which are difficult to identify at design time. While the agent can learn to mitigate the side effects from human feedback, such feedback is often expensive and the rate of learning is sensitive to the agent's state representation. We examine how humans can assist an agent, beyond providing feedback, and exploit their broader scope of knowledge to mitigate the impacts of NSE. We formulate this problem as a human-agent team with decoupled objectives. The agent optimizes its assigned task, during which its actions may produce NSE. The human shapes the environment through minor reconfiguration actions so as to mitigate the impacts of the agent's side effects, without affecting the agent's ability to complete its assigned task. We present an algorithm to solve this problem and analyze its theoretical properties. Through experiments with human subjects, we assess the willingness of users to perform minor environment modifications to mitigate the impacts of NSE. Empirical evaluation of our approach shows that the proposed framework can successfully mitigate NSE, without affecting the agent's ability to complete its assigned task.
LBR: Towards Mitigating Length Bias in Large Language Models for Recommendation
Zhejiang University(浙江大学);The Chinese University of Hong Kong(香港中文大学);University of Science and Technology of China(中国科学技术大学);Bangsun Technology(Bangsun科技)
HARMONY: Bridging the Personalization-Generalization Gap by Mitigating Representation Skew in Heterogeneous Split Federated Learning
Department of ECE and INMC, Seoul National University, Seoul, South Korea(首尔国立大学电子与信息科学系及网络信息中心,首尔,韩国);Graduate School of Data Science, Seoul National University, Seoul, South Korea(首尔国立大学数据科学研究生院,首尔,韩国);Department of Computer Science, University of Colorado Boulder, CO, USA(科罗拉多大学博尔德分校计算机科学系,科罗拉多州,美国)
Multiple Kronecker RLS fusion-based link propagation for drug-side effect prediction
University of Electronic Science and Technology of China(电子科技大学);University of Nottingham Ningbo(宁波诺丁汉大学);Halmstad University(哈尔姆斯塔德大学);Yangtze Delta Region Institute (Quzhou), University of Electronic Science and Technology of China(电子科技大学长三角研究院(衢州))