arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2503.05464cs.CVcs.CY

视觉语言检索增强生成的自动教学平台

Automatic Teaching Platform on Vision Language Retrieval Augmented Generation

Yeshiva University(叶史瓦大学)

Ruslan Gokhman, Jialu Li, Youshan Zhang

AI总结:

本文提出VL-RAG系统,利用视觉语言检索增强生成,提供上下文相关、视觉丰富的响应,以增强学生理解,减少人工监督,并支持多学科扩展。

摘要:

自动化教学面临独特挑战,因为复制人际互动和适应性是复杂的。自动化系统通常无法提供细致入微的实时反馈,以匹配学生的个体学习节奏或理解水平,这可能阻碍对多样化需求的有效支持。在抽象概念需要适应性解释的领域,这尤其具有挑战性。在本文中,我们提出了一种视觉语言检索增强生成(命名为VL-RAG)系统,该系统有潜力通过提供上下文相关、视觉丰富化的响应来弥合这一差距,从而增强理解。通过利用定制答案和图像的数据库,VL-RAG系统可以动态检索与特定问题对齐的信息,创造更具互动性和吸引力的体验,促进更深层次的理解和学生的积极参与。它允许学生视觉和口头地探索概念,促进更深层次的理解,减少对持续人工监督的需求,同时保持灵活性以扩展到不同学科和课程材料。

英文摘要:

Automating teaching presents unique challenges, as replicating human interaction and adaptability is complex. Automated systems cannot often provide nuanced, real-time feedback that aligns with students' individual learning paces or comprehension levels, which can hinder effective support for diverse needs. This is especially challenging in fields where abstract concepts require adaptive explanations. In this paper, we propose a vision language retrieval augmented generation (named VL-RAG) system that has the potential to bridge this gap by delivering contextually relevant, visually enriched responses that can enhance comprehension. By leveraging a database of tailored answers and images, the VL-RAG system can dynamically retrieve information aligned with specific questions, creating a more interactive and engaging experience that fosters deeper understanding and active student participation. It allows students to explore concepts visually and verbally, promoting deeper understanding and reducing the need for constant human oversight while maintaining flexibility to expand across different subjects and course material.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑