CF-RAG:用于碳足迹问答的检索增强生成数据集与方法
CF-RAG: A Dataset and Method for Carbon Footprint QA Using Retrieval-Augmented Generation
AI总结:
针对PDF可持续性报告中碳足迹问答的挑战,本文提出CarbonPDF-QA数据集和基于Llama 3微调的CarbonPDF方法,其性能优于现有最先进技术。
摘要:
产品可持续性报告提供了关于产品环境影响的宝贵见解,且通常以PDF格式分发。这些报告往往包含表格和文本的组合,这使它们的分析变得复杂。缺乏标准化以及报告格式的多样性进一步加剧了从大量文档中提取和解释相关信息的难度。在本文中,我们应对在PDF格式的可持续性报告中回答与碳足迹相关问题的挑战。与以往方法不同,我们的重点是解决PDF解析提取的文本的非结构化和不一致性所带来的困难。为促进这一分析,我们引入了CarbonPDF-QA,一个开源数据集,包含1735份产品报告文档的问答对,以及人工标注的答案。我们的分析表明,GPT-4o在回答数据不一致的问题时表现不佳。为解决这一局限,我们提出了CarbonPDF,一种专门设计用于在此类数据集上回答碳足迹问题的基于LLM的技术。我们通过使用我们的训练数据微调Llama 3来开发CarbonPDF。我们的结果表明,我们的技术优于当前最先进的技术,包括在表格和文本数据上微调的问答(QA)系统。
英文摘要:
Product sustainability reports provide valuable insights into the environmental impacts of a product and are often distributed in PDF format. These reports often include a combination of tables and text, which complicates their analysis. The lack of standardization and the variability in reporting formats further exacerbate the difficulty of extracting and interpreting relevant information from large volumes of documents. In this paper, we tackle the challenge of answering questions related to carbon footprints within sustainability reports available in PDF format. Unlike previous approaches, our focus is on addressing the difficulties posed by the unstructured and inconsistent nature of text extracted from PDF parsing. To facilitate this analysis, we introduce CarbonPDF-QA, an open-source dataset containing question-answer pairs for 1735 product report documents, along with human-annotated answers. Our analysis shows that GPT-4o struggles to answer questions with data inconsistencies. To address this limitation, we propose CarbonPDF, an LLM-based technique specifically designed to answer carbon footprint questions on such datasets. We develop CarbonPDF by fine-tuning Llama 3 with our training data. Our results show that our technique outperforms current state-of-the-art techniques, including question-answering (QA) systems finetuned on table and text data.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。