Large language models (LLMs) have demonstrated impressive performance on many tasks. However, to achieve optimal performance, specially designed prompting methods are still needed. These methods either rely on task-specific few-shot examples that require a certain level of domain knowledge, or are designed to be simple but only perform well on a few types of tasks. In this work, we attempt to introduce the concept of generalist prompting, which operates on the design principle of achieving optimal or near-optimal performance on a wide range of tasks while eliminating the need for manual selection and customization of prompts tailored to specific problems. Furthermore, we propose MeMo (Mental Models), an innovative prompting method that is simple-designed yet effectively fulfills the criteria of generalist prompting. MeMo distills the cores of various prompting methods into individual mental models and allows LLMs to autonomously select the most suitable mental models for the problem, achieving or being near to the state-of-the-art results on diverse tasks such as STEM, logical reasoning, and commonsense reasoning in zero-shot settings. We hope that the insights presented herein will stimulate further exploration of generalist prompting methods for LLMs.
Detecting Conversational Mental Manipulation with Intent-Aware Prompting
The University of Sydney(悉尼大学);University of Technology Sydney(悉尼科技大学);Xi’an Jiaotong-Liverpool University(西交利物浦大学);Harvard University(哈佛大学);University of New South Wales(新南威尔士大学)
Cognitive-Mental-LLM: Evaluating Reasoning in Large Language Models for Mental Health Prediction via Online Text
Ira A. Fulton Schools of Engineering Arizona State University Tempe, USA(伊拉·A·福林工程学校亚利桑那州立大学Tempe分校);Department of Psychology Santa Clara University Santa Clara, USA(心理学系圣克拉拉大学Santa Clara分校)
TAGS: A Test-Time Generalist-Specialist Framework with Retrieval-Augmented Reasoning and Verification
Mohamed bin Zayed University of Artificial Intelligence(莫莫德·本·扎耶德人工智能大学);Monash University(墨尔本大学);Xi’an Jiaotong-Liverpool University(西安交通大学利物浦大学);University of Southampton(南安普顿大学)
Enhancing Depression Detection with Chain-of-Thought Prompting: From Emotion to Reasoning Using Large Language Models
College of Information Science and Engineering, Ritsumeikan University(立命馆大学信息科学与工程学院);Fujita Health University(藤田医科大学);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)
Large Language Models for Mental Health Diagnostic Assessments: Exploring The Potential of Large Language Models for Assisting with Mental Health Diagnostic Assessments -- The Depression and Anxiety Case
Indian Institute of Research and Science, Bhopal(博帕尔印度研究与科学学院);Indian Institute of Technology, Kharagpur(克勒格布尔印度理工学院)
PsychAdapter: Adapting LLM Transformers to Reflect Traits, Personality and Mental Health
Stony Brook University(石溪大学);New York University(纽约大学);University of Melbourne(墨尔本大学);University of Texas at Dallas(德克萨斯大学达拉斯分校);University of Pennsylvania(宾夕法尼亚大学);Stanford University(斯坦福大学)
Towards Interpretable Mental Health Analysis with Large Language Models
The University of Manchester(曼彻斯特大学);University of Helsinki(赫尔辛基大学);Yale University(耶鲁大学);Artificial Intelligence Research Center, AIST(日本国立研究开发法人产业技术综合研究所人工智能研究中心);Jiangxi Normal University(江西师范大学)
Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data
Massachusetts Institute of Technology(麻省理工学院);University of Washington(华盛顿大学);Rensselaer Polytechnic Institute(伦斯勒理工学院);Stanford University(斯坦福大学);University of Massachusetts Lowell(马萨诸塞大学洛厄尔分校);Northeastern University(东北大学)
Guiding Language Models to Be More Empathetic: Culturally Sensitive Mental Health Advice Generation Through Human-LLM Collaboration
Ahsanullah University of Science and Technology(阿山努拉科技大学);Bangladesh University of Business and Technology(孟加拉国商业与技术大学);The University of New South Wales(新南威尔士大学);Jashore University of Science and Technology(贾绍尔科技大学);American International University - Bangladesh(孟加拉国美国国际大学)
Are LLMs effective psychological assessors? Leveraging adaptive RAG for interpretable mental health screening through psychometric practice
Euler Institute, Università della Svizzera italiana(欧拉研究所,瑞士大学);National Institute of Informatics(国家信息研究所);Brown University(布朗大学);University of Tübingen(图宾根大学);Insubria University(因斯布里亚大学)
Unveiling and Mitigating Bias in Mental Health Analysis with Large Language Models
Stanford University(斯坦福大学);Meta Platforms, Inc.(元平台公司);ETH Zürich(苏黎世联邦理工学院);University Medical Center Utrecht(乌得勒支大学医学中心);Leiden University Medical Center(莱顿大学医学中心)
Boosting Large Language Models for Mental Manipulation Detection via Data Augmentation and Distillation
Zhejiang University(浙江大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(深圳先进技术研究院,中国科学院);Institute of Artificial Intelligence (TeleAI), China Telecom(人工智能研究所(TeleAI),中国电信)
DreamerNLplus: Interpretable Modeling of Mental Health Dynamics from Social Media Timelines using Hybrid Rule-Based and RAG Methods
Leiden Institute of Advanced Computer Science (LIACS), Leiden University(莱顿高级计算机科学研究所(LIACS),莱顿大学);School of Computing and Communications (SCC), Lancaster University(计算与通信学院(SCC),兰卡斯特大学);Department of Medical Informatics, Erasmus University Medical Center Rotterdam(医学信息学系,埃因霍温医学中心鲁特万分校);Biomedical Data Sciences, Leiden University Medical Center(生物医学数据科学,莱顿大学医学中心)
SELF-PERCEPT: Introspection Improves Large Language Models' Detection of Multi-Person Mental Manipulation in Conversations
Manipal University Jaipur, India(马普尔大学斋普尔,印度);Manipal Institute of Technology, India(马普尔理工学院,印度);AryaXAI Alignment Lab, AryaXAI.com, India(AryaXAI对齐实验室,AryaXAI.com,印度);National Institute of Technology Karnataka, Surathkal, India(卡纳塔克国家理工学院,苏拉塔卡尔,印度);IISER Kolkata, India(印度科钦IISER)
Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models Aligned with Human Cognitive Principles
Indian Institute of Technology Kharagpur(印度理工学院Khargapur分校);Rochester Institute of Technology(罗切斯特理工学院);Researcher, Fatima Fellowship(研究员,Fatima fellowship);AI Institute, University of South Carolina(人工智能研究所,南卡罗来纳大学);Amazon GenAI(亚马逊生成人工智能);Stanford University(斯坦福大学);James Silberrad Brown Center for AI, San Diego State University(詹姆斯·西伯拉德·布朗人工智能中心,圣地亚哥州立大学)
Virginia Tech(弗吉尼亚理工大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Wisconsin-Madison(威斯康星大学麦迪逊分校);University of California, Berkeley(加州大学伯克利分校)
Belief Coevolution in a Social Network of Generalist and Specialist Large Language Models: A Controlled Study
Khoury College of Computer Sciences, Northeastern University(东北大学库尔计算机科学学院);Network Science Institute, Northeastern University(东北大学网络科学研究所);Santa Fe Institute(圣塔菲研究所)
Specialty-Oriented Generalist Medical AI for Chest CT Screening
Rensselaer Polytechnic Institute(伦斯勒理工学院);Wake Forest University School of Medicine(维克森林大学医学院);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院)
WeatherGFM: Learning A Weather Generalist Foundation Model via In-context Learning
Shanghai AI Laboratory(上海人工智能实验室);The Hong Kong Polytechnic University(香港理工大学);Shanghai Jiao Tong University(上海交通大学);Shanghai Meteorological Service(上海市气象局)
K-Bench: a clinically calibrated benchmark for evaluating large language models in high-risk mental health conversations
University of Roehampton(罗汉普顿大学);Kivira Health;University of Hertfordshire(赫特福德大学);University of Surrey(萨里大学);University of Bedfordshire(贝德福德大学);Tavistock Relationships(塔维斯托克关系中心);InsideOut
AI Hallucination from Students' Perspective: A Thematic Analysis
Department of Computer and Information Engineering, Center for Cyber Physical Systems, Khalifa University(计算机与信息工程系,跨物理系统中心,哈利法大学);Department of Psychology, University Malaysia Sabah(心理学系,马来西亚Sabah大学)
BASIS: Evaluating Belief-Aware Solutions in Interactive Settings beyond Instructions
Dept. of Comp. Sci. \& Tech., Institute for AI, Tsinghua University, Beijing, China;Institute for AI Industry Research (AIR), Tsinghua University, Beijing, China