Dual-Cluster Memory Agent: Resolving Multi-Paradigm Ambiguity in Optimization Problem Solving
School of Computer Science and Technology, Xi’an Jiaotong University(西安交通大学计算机科学与技术学院);Ministry of Education Key Laboratory of Intelligent Networks and Network Security, China(教育部智能网络与网络security重点实验室);Shaanxi Province Key Laboratory of Big Data Knowledge Engineering, China(陕西省大数据知识工程重点实验室)
Xinyu Zhang, Yuchen Wan, Boxuan Zhang, Zesheng Yang, Lingling Zhang, Bifan Wei, Jun Liu
Large Language Models (LLMs) often struggle with structural ambiguity in optimization problems, where a single problem admits multiple related but conflicting modeling paradigms, hindering effective solution generation. To address this, we propose Dual-Cluster Memory Agent (DCM-Agent) to enhance performance by leveraging historical solutions in a training-free manner. Central to this is Dual-Cluster Memory Construction. This agent assigns historical solutions to modeling and coding clusters, then distills each cluster's content into three structured types: Approach, Checklist, and Pitfall. This process derives generalizable guidance knowledge. Furthermore, this agent introduces Memory-augmented Inference to dynamically navigate solution paths, detect and repair errors, and adaptively switch reasoning paths with structured knowledge. The experiments across seven optimization benchmarks demonstrate that DCM-Agent achieves an average performance improvement of 11%- 21%. Notably, our analysis reveals a ``knowledge inheritance'' phenomenon: memory constructed by larger models can guide smaller models toward superior performance, highlighting the framework's scalability and efficiency.
The Gray Zone of Faithfulness: Taming Ambiguity in Unfaithfulness Detection
Key Lab of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences (CAS)(中国科学院信息处理重点实验室);State Key Lab of Al Safety(人工智能安全国家重点实验室);University of Chinese Academy of Sciences(中国科学院大学)
Small Language Model Helps Resolve Semantic Ambiguity of LLM Prompt
School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);Department of Electronic Engineering, Kyung Hee University(庆熙大学电子工程系)
Teaching Vision-Language Models to Ask: Resolving Ambiguity in Visual Questions
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Wuhan AI Research(武汉人工智能研究院)
DERA: Enhancing Large Language Model Completions with Dialog-Enabled Resolving Agents
Curai Health(Curai健康)
大语言模型(LLM)已经成为许多自然语言理解任务的有价值的工具。在医疗保健等安全关键型应用中,这些模型的实用性取决于它们生成真实准确和完整的输出的能力。在这项工作中,我们提出了对话使能解析代理(DERA)。DERA是一个范例,通过LLM的会话能力的增加而成为可能,即GPT-4。它为模型提供了一个简单的、可解释的论坛,以交流反馈并迭代地改进输出。我们框架我们的对话作为两个代理类型之间的讨论-一个研究员,谁处理信息,并确定关键的问题组件,和一个决策者,谁拥有自主权,以整合研究员的信息,并作出判断的最终输出。我们测试DERA对三个临床重点任务。对于医疗会话摘要和护理计划生成,DERA在人类专家偏好评估和定量指标方面都显示出比基本GPT-4性能的显着改进。在一项新的发现中,我们还表明,GPT-4在MedQA问答(QA)数据集(Jin et al. 2021,USMLE)的开放式版本上的性能(70%)远高于及格水平(60%),DERA表现出类似的性能。我们在https://github.com/curai/curai-research/tree/main/DERA上发布开放式MEDQA数据集。
Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm
University of Connecticut(康涅狄格大学);Penn State University(宾夕法尼亚州立大学);Moffett AI(莫菲特人工智能公司);Northeastern University(东北大学);Stevens Institute of Technology(史蒂文斯理工学院);University of Texas at San Antonio(德克萨斯大学圣安东尼奥分校)