Large Language Models (LLMs) have shown great potential in intelligent visualization systems, especially for domain-specific applications. Integrating LLMs into visualization systems presents challenges, and we categorize these challenges into three alignments: domain problems with LLMs, visualization with LLMs, and interaction with LLMs. To achieve these alignments, we propose a framework and outline a workflow to guide the application of fine-tuned LLMs to enhance visual interactions for domain-specific tasks. These alignment challenges are critical in education because of the need for an intelligent visualization system to support beginners' self-regulated learning. Therefore, we apply the framework to education and introduce Tailor-Mind, an interactive visualization system designed to facilitate self-regulated learning for artificial intelligence beginners. Drawing on insights from a preliminary study, we identify self-regulated learning tasks and fine-tuning objectives to guide visualization design and tuning data construction. Our focus on aligning visualization with fine-tuned LLM makes Tailor-Mind more like a personalized tutor. Tailor-Mind also supports interactive recommendations to help beginners better achieve their learning goals. Model performance evaluations and user studies confirm that Tailor-Mind improves the self-regulated learning experience, effectively validating the proposed framework.
Integrating Visualization Literacy into Computer Graphics Education Using the Example of Dear Data
我们所面临的视觉交流量正在迅速增加,对处理、理解和生成视觉表示的技能需求很高。特别是专注于计算机图形和可视化的学生可以从更多样化的视觉素养教育中受益,因为他们毕业后经常需要为广大群众进行图形表示。我们提出的教学方法将基本的设计思维原则融入传统的可视化和图形教育。我们的课程受到了《Dear Data》一书的启发,这本书是IEEE VIS 2017闭幕式上热烈讨论的主题。本文概述了我们为期12周的教学实验,并总结了附带的问卷调查和访谈提取的结果。特别是,我们提供了可视化新手的创作过程和痛点的见解,讨论了可视化任务和设计思维之间的相互作用,并最终得出一般的视觉素养教育的设计启示。
What Do Visualization Instructors Want Students to Learn? Introducing a Concept Inventory for Visualization Design
Paul G. Allen School of Computer Science and Engineering at the University of Washington(华盛顿大学保罗·G·艾伦计算机科学与工程学学院);Department of Human Centered Design and Engineering at the University of Washington(华盛顿大学以人为本的设计与工程系)
A Large-Scale Feasibility Study of Screen-based 3D Visualization and Augmented Reality Tools for Human Anatomy Education: Exploring Gender Perspectives in Learning Experience
The MolecularWeb Universe: Web-Based, Immersive, Multiuser Molecular Graphics And Modeling, for Education and Work in Chemistry, Structural Biology, and Materials Sciences
Designing Born-Accessible Courses in Data Science and Visualization: Challenges and Opportunities of a Remote Curriculum Taught by Blind Instructors to Blind Students
Through the WordStream Glass: Revisiting Quantitative Encoding for Qualitative Learning Analytics
Harvard Medical School(哈佛医学院);University of New Hampshire(新罕布什尔大学);Hanoi University of Science and Technology(河内科学技术大学);University of Washington Bothell(华盛顿大学博塞尔分校)