arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.20570cs.HC
收藏

面向可视化系统的微调大型语言模型:教育中自我调节学习的研究

Fine-Tuned Large Language Model for Visualization System: A Study on Self-Regulated Learning in Education

Lin Gao, Jing Lu, Zekai Shao, Ziyue Lin, Shengbin Yue, Chiokit Ieong, Yi Sun, Rory James Zauner, Zhongyu Wei, Siming Chen

AI总结:

本文提出将微调大型语言模型集成到可视化系统的框架,以解决领域、可视化和交互的对齐挑战,并构建教育系统Tailor-Mind,有效改善了初学者的自我调节学习体验。

摘要:

大型语言模型(LLMs)在智能可视化系统中展现出巨大潜力,特别是在特定领域的应用中。将LLMs集成到可视化系统中存在挑战,我们将这些挑战分为三个对齐:领域问题与LLMs的对齐、可视化与LLMs的对齐、以及交互与LLMs的对齐。为实现这些对齐,我们提出一个框架并概述一个工作流,以指导微调LLMs的应用,从而增强特定领域任务的可视化交互。由于智能可视化系统需要支持初学者的自我调节学习,这些对齐挑战在教育中至关重要。因此,我们将该框架应用于教育领域,并引入Tailor-Mind,这是一个旨在促进人工智能初学者自我调节学习的交互式可视化系统。基于初步研究的见解,我们确定了自我调节学习任务和微调目标,以指导可视化设计和调优数据构建。我们对微调LLMs与可视化对齐的关注使Tailor-Mind更像一位个性化导师。Tailor-Mind还支持交互式推荐,帮助初学者更好地实现学习目标。模型性能评估和用户研究证实,Tailor-Mind改善了自我调节学习体验,有效验证了所提出的框架。

英文摘要:

Large Language Models (LLMs) have shown great potential in intelligent visualization systems, especially for domain-specific applications. Integrating LLMs into visualization systems presents challenges, and we categorize these challenges into three alignments: domain problems with LLMs, visualization with LLMs, and interaction with LLMs. To achieve these alignments, we propose a framework and outline a workflow to guide the application of fine-tuned LLMs to enhance visual interactions for domain-specific tasks. These alignment challenges are critical in education because of the need for an intelligent visualization system to support beginners' self-regulated learning. Therefore, we apply the framework to education and introduce Tailor-Mind, an interactive visualization system designed to facilitate self-regulated learning for artificial intelligence beginners. Drawing on insights from a preliminary study, we identify self-regulated learning tasks and fine-tuning objectives to guide visualization design and tuning data construction. Our focus on aligning visualization with fine-tuned LLM makes Tailor-Mind more like a personalized tutor. Tailor-Mind also supports interactive recommendations to help beginners better achieve their learning goals. Model performance evaluations and user studies confirm that Tailor-Mind improves the self-regulated learning experience, effectively validating the proposed framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑