People are increasingly turning to generative AI (e.g., ChatGPT, Gemini, Copilot) for emotional support and companionship. While trust is likely to play a central role in enabling these informal and unsupervised interactions, we still lack an understanding of how people develop and experience it in this context. Seeking to fill this gap, we recruited 24 frequent users of generative AI for emotional support and conducted a qualitative study consisting of diary entries about interactions, transcripts of chats with AI, and in-depth interviews. Our results suggest important novel drivers of trust in this context: familiarity emerging from personalisation, nuanced mental models of generative AI, and awareness of people's control over conversations. Notably, generative AI's homogeneous use of personalised, positive, and persuasive language appears to promote some of these trust-building factors. However, this also seems to discourage other trust-related behaviours, such as remembering that generative AI is a machine trained to converse in human language. We present implications for future research that are likely to become critical as the use of generative AI for emotional support increasingly overlaps with therapeutic work.
LLMs can persuade only psychologically susceptible humans on societal issues, via trust in AI and emotional appeals, amid logical fallacies
organization= CogNosco Lab, Department of Psychology;Cognitive Science, University of Trento , city= Rovereto , country= Italy;organization= Institute of Information Science;Technologies ``Alessandro Faedo", National Research Council , country= Italy;organization= Thomas Lord Department of Computer Science, University of Southern California , city= Los Angeles , state= California , country= USA;organization= Department of Sociology;Social Research, University of Trento , city= Trento , country= Italy;organization= Centre for Behavioural;Implementation Sciences in Medicine (BISI), National University of Singapore , city= Singapore , country= Singapore
Mapping Caregiver Needs to AI Chatbot Design: Strengths and Gaps in Mental Health Support for Alzheimer's and Dementia Caregivers
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Indiana University Indianapolis(印第安纳大学印第安纳波利斯分校);University of Massachusetts Amherst(马萨诸塞大学阿姆赫斯特分校)
"Law at Your Fingertips": Understanding Legal Information Seeking on Video-Sharing Platforms in China
City University of Hong Kong(香港城市大学);Xi’an Jiaotong University(西安交通大学);Carnegie Mellon University(卡内基梅隆大学);University of Maryland(马里兰大学);George Mason University(乔治梅森大学)
"Watch My Health, Not My Data": Understanding Perceptions, Barriers, Emotional Impact, & Coping Strategies Pertaining to IoT Privacy and Security in Health Monitoring for Older Adults
Advancing User-Voice Interaction: Exploring Emotion-Aware Voice Assistants Through a Role-Swapping Approach
University of Bergen(卑尔根大学);KTH Royal Institute of Technology(瑞典皇家理工学院);University of Surrey(萨里大学);Chalmers University of Technology(查尔姆斯理工大学);Norwegian University of Science and Technology(挪威科技大学)
"Everyone Says Them": Deception Typologies, Probabilistic Trust, and Grassroots Safety Knowledge Among Gay Dating App Users in China
Tsinghua University(清华大学);Shanghai Jiao Tong University(上海交通大学);Politecnico di Milano(米兰理工大学);University of Michigan(密歇根大学);University of Oxford(牛津大学);North China University of Science and Technology(华北理工大学)