GPT-4 Generated Narratives of Life Events using a Structured Narrative Prompt: A Validation Study
Virginia Modeling, Analysis, and Simulation Center(弗吉尼亚建模、分析与仿真中心);Old Dominion University(奥多明尼昂大学);College of Engineering, Montana State University(蒙大拿州立大学工程学院)
Christopher J. Lynch, Erik Jensen, Madison H. Munro, Virginia Zamponi, Joseph Martinez, Kevin O'Brien, Brandon Feldhaus, Katherine Smith, Ann Marie Reinhold, Ross Gore
Large Language Models (LLMs) play a pivotal role in generating vast arrays of narratives, facilitating a systematic exploration of their effectiveness for communicating life events in narrative form. In this study, we employ a zero-shot structured narrative prompt to generate 24,000 narratives using OpenAI's GPT-4. From this dataset, we manually classify 2,880 narratives and evaluate their validity in conveying birth, death, hiring, and firing events. Remarkably, 87.43% of the narratives sufficiently convey the intention of the structured prompt. To automate the identification of valid and invalid narratives, we train and validate nine Machine Learning models on the classified datasets. Leveraging these models, we extend our analysis to predict the classifications of the remaining 21,120 narratives. All the ML models excelled at classifying valid narratives as valid, but experienced challenges at simultaneously classifying invalid narratives as invalid. Our findings not only advance the study of LLM capabilities, limitations, and validity but also offer practical insights for narrative generation and natural language processing applications.
Reframe Your Life Story: Interactive Narrative Therapist and Innovative Moment Assessment with Large Language Models
Beijing Key Laboratory of Traffic Data Mining and Embodied Intelligence(北京交通大数据挖掘与具身智能重点实验室);Beijing Jiaotong University(北京交通大学);CoAI Group(CoAI集团);DCST(国防科技大学);IAI(人工智能院);BNRIST(北航机器人与智能技术研究院);Tsinghua University(清华大学);Tencent Jarvis Lab(腾讯Jarvis实验室);Singapore University of Technology and Design(新加坡科技与设计大学);Central South University(中南大学);Lingxin AI(灵犀AI)
LitVISTA: A Benchmark for Narrative Orchestration in Literary Text
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院);University of Science and Technology of China(中国科学技术大学);University of Melbourne(墨尔本大学)
Whose Story Gets Told? Positionality and Bias in LLM Summaries of Life Narratives
Department of Computer Science, Columbia University(哥伦比亚大学计算机科学系);Department of Applied Physics and Applied Mathematics, Columbia University(哥伦比亚大学应用物理与应用数学系);Department of Psychology, Northwestern University(西北大学心理学系)
Growing Perspectives: Modelling Embodied Perspective Taking and Inner Narrative Development Using Large Language Models
Department of Psychology, University of Milan-Bicocca(心理学系,米兰-比科卡大学);Department of Psychology, University of Essex(心理学系,埃塞克斯大学);School of Social Sciences and Technology, Technical University of Munich(社会科学与技术学院,慕尼黑技术大学);Department of Electrical Engineering and Information Technology, University of Naples Federico II(电气工程与信息技术系,那不勒斯费德里科二世大学)
SemioLLM: Evaluating Large Language Models for Diagnostic Reasoning from Unstructured Clinical Narratives in Epilepsy
University of Tübingen(蒂宾根大学);Technical University of Munich(慕尼黑工业大学);University Clinic Tübingen(蒂宾根大学医院);Hertie Institute for Clinical Brain Research(赫蒂临床脑研究所);Excellence Cluster Machine Learning, Tübingen University(蒂宾根大学机器学习卓越集群);Hertie Institute for AI in Brain Health (Hertie AI)(赫蒂人工智能脑健康研究所)
Evaluating GPT-5 as a Multimodal Clinical Reasoner: A Landscape Commentary
Department of Radiation Oncology, Winship Cancer Institute, Emory University School of Medicine(放射肿瘤科,Winship癌症研究所,埃默里大学医学院);Department of Biomedical Engineering, Georgia Institute of Technology(生物医学工程系,佐治亚理工学院)
Can LLM Agents Stick to the Script? A Benchmark for Long-Horizon Consistency in Interactive Narratives
University of Macau(澳门大学);Westlake University(西湖大学);Harbin Institute of Technology(哈尔滨工业大学);University of Cambridge(剑桥大学);University of Aberdeen(阿伯丁大学)
AD-AutoGPT: An Autonomous GPT for Alzheimer's Disease Infodemiology
University of Georgia(佐治亚大学);University of Texas at Arlington(德克萨斯大学阿灵顿分校);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);University of Virginia(弗吉尼亚大学);Clemson University(克莱姆森大学);New York University(纽约大学)
Detecting HIV-Related Stigma in Clinical Narratives Using Large Language Models
Department of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida(佛罗里达大学医学院健康结果与生物医学信息学系);Department of Epidemiology, College of Public Health and Health Professions, University of Florida(佛罗里达大学公共卫生与健康专业学院流行病学系);Preston A. Wells, Jr. Center for Brain Tumor Therapy, Lillian S. Wells Department of Neurosurgery, University of Florida(佛罗里达大学莉莉安·S·威尔斯神经外科系普雷斯顿·A·威尔斯脑肿瘤治疗中心)
How LLMs Build Fictional Worlds: Setting and Narrative Space in AI-Generated Creative Storytelling
FAU Erlangen-Nürnberg(埃尔朗根-纽伦堡大学);Munich Center for Machine Learning(慕尼黑机器学习中心);LMU München(慕尼黑大学);Institute of AI for Health, Helmholtz Zentrum München(慕尼黑亥姆霍兹中心人工智能健康研究所);University of Birmingham(伯明翰大学)
Agenda-based Narrative Extraction: Steering Pathfinding Algorithms with Large Language Models
Department of Computing and Systems Engineering, Universidad Católica del Norte, Antofagasta, Chile(智利天主教大学北部校区计算与系统工程系,安托法加斯塔,智利);Department of Industrial Engineering, Universidad Católica del Norte, Antofagasta, Chile(智利天主教大学北部校区工业工程系,安托法加斯塔,智利);Department of Chemical and Environmental Engineering, Universidad Católica del Norte, Antofagasta, Chile(智利天主教大学北部校区化学与环境工程系,安托法加斯塔,智利)
Is It Bad to Work All the Time? Cross-Cultural Evaluation of Social Norm Biases in GPT-4
Department of Computer Science, University of British Columbia(不列颠哥伦比亚大学计算机科学系);Vector Institute for AI(人工智能矢量研究所);Department of Linguistics, University of British Columbia(不列颠哥伦比亚大学语言学系);Mila – Quebec AI Institute(魁北克人工智能研究所);School of Computer Science, McGill University(麦吉尔大学计算机科学学院);Department of Sociology, University of British Columbia(不列颠哥伦比亚大学社会学系)
Information Sciences Institute, University of Southern California(南加州大学信息科学研究所);Department of Computer Science, University of Southern California(南加州大学计算机科学系);Department of Computer Science, Vrije Universiteit Amsterdam(阿姆斯特丹自由大学计算机科学系);Computational Linguistics & Text Mining Lab, Vrije Universiteit Amsterdam(阿姆斯特丹自由大学计算语言学与文本挖掘实验室)