arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.01425cs.HC
收藏

大语言模型作为知识图谱探索、分析与可视化助手的初步路线图

A Preliminary Roadmap for LLMs as Assistants in Exploring, Analyzing, and Visualizing Knowledge Graphs

Harry Li, Gabriel Appleby, Ashley Suh

AI总结:

本文通过访谈20位专业人士,研究大语言模型辅助知识图谱探索、分析与可视化的需求与顾虑,并提出大语言模型驱动的知识图谱探索系统设计路线图。

摘要:

我们提出了一项混合方法研究,以探索大语言模型(LLMs)如何协助用户对知识图谱(KGs)进行可视化探索与分析。我们调查并访谈了20位来自工业界、政府实验室和学术界的专业人士,他们经常以协作或并发的方式使用知识图谱和大语言模型。我们的研究结果表明,参与者压倒性地希望大语言模型能够通过联合查询构建来促进从知识图谱中检索数据,通过多轮对话识别知识图谱中有趣的关系,并根据知识图谱创建按需可视化,从而增强他们对大语言模型输出的信任。在与大语言模型交互时,参与者强烈偏好一种基于聊天的“组件”,该组件构建在他们常规分析工作流之上,并能够利用他们与可视化的交互来引导大语言模型。在查看大语言模型的输出时,参与者同样偏好带注释的可视化(例如从知识图谱中提取的子图或表格)与总结性文本的组合。然而,参与者也对大语言模型在将自然语言问题翻译为知识图谱查询时保持语义意图的能力、大语言模型从知识图谱中“幻觉”出虚假数据的风险,以及设计“完美提示”的困难表达了担忧。基于对访谈的分析,我们为设计由大语言模型驱动的知识图谱探索系统贡献了一份初步路线图,并概述了这一新兴设计空间中的未来机会。

英文摘要:

We present a mixed-methods study to explore how large language models (LLMs) can assist users in the visual exploration and analysis of knowledge graphs (KGs). We surveyed and interviewed 20 professionals from industry, government laboratories, and academia who regularly work with KGs and LLMs, either collaboratively or concurrently. Our findings show that participants overwhelmingly want an LLM to facilitate data retrieval from KGs through joint query construction, to identify interesting relationships in the KG through multi-turn conversation, and to create on-demand visualizations from the KG that enhance their trust in the LLM's outputs. To interact with an LLM, participants strongly prefer a chat-based 'widget,' built on top of their regular analysis workflows, with the ability to guide the LLM using their interactions with a visualization. When viewing an LLM's outputs, participants similarly prefer a combination of annotated visuals (e.g., subgraphs or tables extracted from the KG) alongside summarizing text. However, participants also expressed concerns about an LLM's ability to maintain semantic intent when translating natural language questions into KG queries, the risk of an LLM 'hallucinating' false data from the KG, and the difficulties of engineering a 'perfect prompt.' From the analysis of our interviews, we contribute a preliminary roadmap for the design of LLM-driven knowledge graph exploration systems and outline future opportunities in this emergent design space.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑