While artificial intelligence (AI) holds promise for addressing societal challenges, issues of exactly which tasks to automate and to what extent to do so remain understudied. We approach this problem of task delegability from a human-centered perspective by developing a framework on human perception of task delegation to AI. We consider four high-level factors that can contribute to a delegation decision: motivation, difficulty, risk, and trust. To obtain an empirical understanding of human preferences in different tasks, we build a dataset of 100 tasks from academic papers, popular media portrayal of AI, and everyday life, and administer a survey based on our proposed framework. We find little preference for full AI control and a strong preference for machine-in-the-loop designs, in which humans play the leading role. Among the four factors, trust is the most correlated with human preferences of optimal human-machine delegation. This framework represents a first step towards characterizing human preferences of AI automation across tasks. We hope this work encourages future efforts towards understanding such individual attitudes; our goal is to inform the public and the AI research community rather than dictating any direction in technology development.
Mind What You Ask For: Emotional and Rational Faces of Persuasion by Large Language Models
Warsaw University of Technology(华沙理工大学);Wrocław University of Science and Technology(弗罗茨瓦夫理工大学);University of Warsaw(华沙大学);Lincoln University College(林肯大学学院)
Modeling What-to-ask and How-to-ask for Answer-unaware Conversational Question Generation
Institute for Infocomm Research (I2R), A*STAR(新加坡科技研究局资讯通信研究院(I2R));Nanyang Technological University, Singapore(新加坡南洋理工大学);Salesforce AI(赛富时人工智能研究院);ByteDance(字节跳动);University of California, Santa Barbara(加州大学圣巴巴拉分校)
Don't Ask: Understanding What Numeric Self-Reports Measure in Language Models
Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales. Departamento de Computación(布宜诺斯艾利斯大学。精确与自然科学学院。计算机系);CONICET-Universidad de Buenos Aires. Instituto de Ciencias de la Computación (ICC)(国家科学与技术研究理事会-布宜诺斯艾利斯大学。计算机科学研究所)
Only Ask What You Don't Know: Grounded Delta Planning for Efficient Multi-step RAG
Dept. of Computer Science and Information Engineering, National Taiwan University(国立台湾大学资讯工程学系);Graduate Institute of Communication Engineering, National Taiwan University(国立台湾大学电信工程学研究所);Department of Economics, National Taiwan University(国立台湾大学经济学系);Department of Information Management, National Taiwan University(国立台湾大学资讯管理学系);NTU Artificial Intelligence Center of Research Excellence (NTU AI-CoRE)(国立台湾大学人工智能卓越研究中心)
Ask What Your Country Can Do For You: Towards a Public Red Teaming Model
Oxford Internet Institute(牛津互联网研究所);University of Oxford(牛津大学);Amazon(亚马逊);Department of Computer Science(计算机科学系);University of Wisconsin - Eau Claire(威斯康星大学欧克莱尔分校);Carnegie Mellon University(卡内基梅隆大学);Harvard University(哈佛大学)
It is AI's Turn to Ask Humans a Question: Question-Answer Pair Generation for Children's Story Books
Rensselaer Polytechnic Institute(伦斯勒理工学院);IBM Research(IBM研究院);University of Washington(华盛顿大学);University of Notre Dame(圣母大学);WeChat AI, Tencent(腾讯微信人工智能);University of California Irvine(加州大学欧文分校)