This study consists of qualitative empirical research, conducted through exploratory tests with two different Large Language Models (LLMs) chatbots: ChatGPT and Gemini. The methodological procedure involved exploratory tests based on prompts designed with a probability question. The "Linda Problem", widely recognized in cognitive psychology, was used as a basis to create the tests, along with the development of a new problem specifically for this experiment, the "Mary Problem". The object of analysis is the dataset with the outputs provided by each chatbot interaction. The purpose of the analysis is to verify whether the chatbots mainly employ logical reasoning that aligns with probability theory or if they are more frequently affected by the stereotypical textual descriptions in the prompts. The findings provide insights about the approach each chatbot employs in handling logic and textual constructions, suggesting that, while the analyzed chatbots perform satisfactorily on a well-known probabilistic problem, they exhibit significantly lower performance on new tests that require direct application of probabilistic logic.
A Computational Approach to Modeling Conversational Systems: Analyzing Large-Scale Quasi-Patterned Dialogue Flows
Software Engineering and Mathematics Department(软件工程与数学系);National Institute of Applied Science and Technology(应用科学和技术国家研究院);Computer Science Department(计算机科学系);University of Tunis El Manar(突尼斯艾尔曼纳大学)
Quriosity: Analyzing Human Questioning Behavior and Causal Inquiry through Curiosity-Driven Queries
EPFL(苏黎世联邦理工学院);ETH Zürich(苏黎世联邦理工学院);University of Washington(华盛顿大学);University of Toronto(多伦多大学);Vector Institute(向量研究所);University of Michigan(密歇根大学);MPI for Intelligent Systems, Tübingen, Germany(图宾根智能系统研究所)
CallNavi, A Challenge and Empirical Study on LLM Function Calling and Routing
University of Luxembourg(卢森堡大学);Luxembourg Institute of Science and Technology(卢森堡科学与技术研究所);Department of Information and Computer Science(信息与计算机科学系);BGL BNP PARIBAS;Interdisciplinary Research Center for Intelligent Manufacturing and Robotics(智能制造与机器人跨学科研究中心)
Creation Of A ChatBot Based On Natural Language Proccesing For Whatsapp
Faculty of Systems Engineering and Informatics, National University of San Marcos(圣马科斯国立大学系统工程与信息学院);Professional School of Systems Engineering, National Technological University of South Lima(南利马国立科技大学系统工程专业学院)
Leveraging Large Language Models for Patient Engagement: The Power of Conversational AI in Digital Health
IBM T. J. Watson Research Center(IBM TJ沃森研究中心);Morehouse School of Medicine(莫尔豪斯医学院);Cleveland Clinic Foundation(克利夫兰诊所基金会);Queen’s University(女王大学);Red Hat(红帽公司)
Formulation of probability theory problem with subtle condition
American University of Armenia(亚美尼亚美国大学);L. A. Orbeli Institute of Physiology, National Academy of Sciences of the Republic of Armenia(亚美尼亚共和国国家科学院L. A. 奥尔别利生理学研究所)
本文通过四个含微妙条件的概率论难题,强调精确理解题意的重要性,并结合数值估计、Python 逻辑语句及对 GPT-4o 与 Claude 3.5 Sonnet 的测试展开分析。