LLMs are ideal for decision-making thanks to their ability to reason over long contexts. However, challenges arise when processing speech transcripts that describe complex scenarios, as they are verbose and include repetition, hedging, and vagueness. E.g., during a company's earnings call, an executive might project a positive revenue outlook to reassure investors, despite uncertainty regarding future earnings. It is crucial for LLMs to incorporate this uncertainty systematically when making decisions. In this paper, we introduce \textsc{DeFine}, a modular framework that constructs probabilistic factor profiles from complex scenarios. It then integrates these profiles with analogical reasoning, leveraging insights from similar past experiences to guide LLMs in making critical decisions in new situations. Our framework separates the tasks of quantifying uncertainty and incorporating it into LLM decision-making. This approach is particularly useful in areas such as consulting and financial deliberation, where making decisions under uncertainty is vital.
ANALOGYKB: Unlocking Analogical Reasoning of Language Models with A Million-scale Knowledge Base
School of Data Science, Fudan University(复旦大学数据科学学院);Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University(复旦大学计算机科学学院上海市数据科学重点实验室);ByteDance AI Lab(字节跳动人工智能实验室);East China Normal University(华东师范大学)
E-KAR: A Benchmark for Rationalizing Natural Language Analogical Reasoning
Fudan University(复旦大学);Brain Technologies, Inc.(脑技术公司);South China University of Technology(华南理工大学);ByteDance AI Lab(字节跳动人工智能实验室);University of California Santa Barbara(加州大学圣巴巴拉分校);Fudan-Aishu Cognitive Intelligence Joint Research Center(复旦-爱数认知智能联合研究中心)
Can Multimodal Large Language Model Think Analogically?
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Shandong Institutes of Industrial Technology(山东产业技术研究院)
Information Sciences Institute, University of Southern California(南加州大学信息科学研究所);Department of Computer Science, University of Southern California(南加州大学计算机科学系);Department of Computer Science, Vrije Universiteit Amsterdam(阿姆斯特丹自由大学计算机科学系);Computational Linguistics & Text Mining Lab, Vrije Universiteit Amsterdam(阿姆斯特丹自由大学计算语言学与文本挖掘实验室)
Relevant or Random: Can LLMs Truly Perform Analogical Reasoning?
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Princeton University(普林斯顿大学);Nanyang Technological University(南洋理工大学);Salesforce Research(Salesforce 研究);Institute of High Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR), Singapore(高性能计算研究所,新加坡科技研究局)
CHAIRO: Contextual Hierarchical Analogical Induction and Reasoning Optimization for LLMs
National Engineering Laboratory for Big Data System Computing Technology(国家大数据系统计算技术工程实验室);Shenzhen University(深圳大学);Tsinghua University(清华大学);National University of Singapore(新加坡国立大学)
CARO: Chain-of-Analogy Reasoning Optimization for Robust Content Moderation
National Engineering Laboratory for Big Data System Computing Technology(大数据系统计算技术国家工程实验室);Shenzhen University(深圳大学);Tsinghua University(清华大学);National University of Singapore(新加坡国立大学)
RAVEN: A Dataset for Relational and Analogical Visual rEasoNing
UCLA Center for Vision, Cognition, Learning and Autonomy(加州大学洛杉矶分校视觉、认知、学习与自主性中心);International Center for AI and Robot Autonomy (CARA)(人工智能与机器人自主性国际中心(CARA))
Elucidating STEM Concepts through Generative AI: A Multi-modal Exploration of Analogical Reasoning
Carnegie Learning(卡内基学习公司);University of Sheffield(谢菲尔德大学);Microsoft Research(微软研究院);University of Maryland, College Park(马里兰大学帕克分校);University of Georgia(佐治亚大学);New York University(纽约大学);Carnegie Mellon University(卡内基梅隆大学)
VIS Lab, University of Amsterdam(阿姆斯特丹大学VIS实验室);FunAI Lab, University of Technology Nuremberg(纽伦堡技术大学FunAI实验室);CSAIL, Massachusetts Institute of Technology(麻省理工学院计算机科学与人工智能实验室)
IRONIC: Coherence-Aware Reasoning Chains for Multi-Modal Sarcasm Detection
College of Information Sciences and Technology(信息科学与技术学院);The Pennsylvania State University(宾夕法尼亚州立大学);Department of Computer Science and Engineering(计算机科学与工程系);National Institute of Technology, Tiruchirappalli(特里奇里帕利理工学院)
Modelling Analogies and Analogical Reasoning: Connecting Cognitive Science Theory and NLP Research
Computation, Cognition & Language Group, Idiap Research Institute(计算、认知与语言组,Idiap研究所);NLP Lab, EPFL(NLP实验室,EPFL);Psychological Methods, University of Amsterdam(心理方法,阿姆斯特丹大学);Faculty of Communication, Culture and Society and Faculty of Informatics Università della Svizzera italiana(传播、文化与社会学院和信息学院,瑞士大学)