arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.16030cs.CLcs.AIcs.DBcs.LG
收藏

增强 LLMs 对半结构化表格的时间理解

Enhancing Temporal Understanding in LLMs for Semi-structured Tables

University of Pennsylvania(宾夕法尼亚大学)

Irwin Deng, Kushagra Dixit, Vivek Gupta, Dan Roth

AI总结:

针对LLMs在表格数据时间推理上的挑战,本研究通过全面分析时间数据集改进了TempTabQA,并提出新方法C.L.E.A.R,结合辅助数据的间接监督显著提升了模型基于证据的推理能力。

摘要:

如近期研究表明,表格数据的时间推理对大型语言模型(LLMs)构成了巨大挑战。在本研究中,我们对时间数据集进行了全面分析,以精准定位 LLMs 的具体局限性。我们的研究促成了 TempTabQA 的改进,这是一个专为表格时间问答设计的数据集。我们为提升 LLMs 在表格数据时间推理任务中的表现提供了关键见解。此外,我们引入了一种新方法 C.L.E.A.R 来增强 LLMs 在该领域的能力。研究结果表明,我们的方法显著提升了各种模型的基于证据的推理能力。另外,实验结果显示,使用辅助数据的间接监督大幅提升了模型在这些任务中的表现。这项工作有助于加深对 LLMs 表格时间推理能力的理解,并推动其在不同领域的应用进展。

英文摘要:

Temporal reasoning over tabular data presents substantial challenges for large language models (LLMs), as evidenced by recent research. In this study, we conduct a comprehensive analysis of temporal datasets to pinpoint the specific limitations of LLMs. Our investigation leads to enhancements in TempTabQA, a dataset specifically designed for tabular temporal question answering. We provide critical insights for improving LLM performance in temporal reasoning tasks with tabular data. Furthermore, we introduce a novel approach, C.L.E.A.R to strengthen LLM capabilities in this domain. Our findings demonstrate that our method significantly improves evidence-based reasoning across various models. Additionally, our experimental results reveal that indirect supervision with auxiliary data substantially boosts model performance in these tasks. This work contributes to a deeper understanding of LLMs' temporal reasoning abilities over tabular data and promotes advancements in their application across diverse fields.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑