Generative AI and Large Language Models (LLMs) hold promise for automating spreadsheet formula creation. However, due to hallucinations, bias and variable user skill, outputs obtained from generative AI cannot be assumed to be accurate or trustworthy. To address these challenges, a trustworthiness framework is proposed based on evaluating the transparency and dependability of the formula. The transparency of the formula is explored through explainability (understanding the formula's reasoning) and visibility (inspecting the underlying algorithms). The dependability of the generated formula is evaluated in terms of reliability (consistency and accuracy) and ethical considerations (bias and fairness). The paper also examines the drivers to these metrics in the form of hallucinations, training data bias and poorly constructed prompts. Finally, examples of mistrust in technology are considered and the consequences explored.
Fly Away: Evaluating the Impact of Motion Fidelity on Optimized User Interface Design via Bayesian Optimization in Automated Urban Air Mobility Simulations
Multimodal Attention-Aware Fusion for Diagnosing Distal Myopathy: Evaluating Model Interpretability and Clinician Trust
Information Systems Group, Eindhoven University of Technology, The Netherlands(埃因霍温技术大学信息系统组);Eindhoven Artificial Intelligence Systems Institute, The Netherlands(埃因霍温人工智能系统研究所);Department of Computer Science and Technology, University of Cambridge, United Kingdom(剑桥大学计算机科学与技术系);Department of Medicine - DIMED, Padua University Hospital, Italy(帕多瓦大学医院医学部-DIMED);Department of Environmental Sciences, Informatics, and Statistics, Ca’ Foscari University of Venice, Italy(威尼斯卡弗里大学环境科学、信息学与统计学系)
Improving understanding and trust in AI: How users benefit from interval-based counterfactual explanations
Department of Bioengineering, Imperial College London(伦敦帝国理工学院生物工程系);Institute of Artificial and Human Intelligence, University of Bayreuth(拜罗伊特大学人工智能与人类智能研究所)