arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

使用多智能体大语言模型系统进行自动化教科书审核

Automated Textbook Auditing with Multi-Agent LLM Systems

Ciprian Cristescu, Adrian-Marius Dumitran, Angela-Liliana Dumitran, Gabriel Stefan

arXiv 2607.11276首次发表:更新:

发表机构

University of Bucharest; Dimitrie Cantemir Christian University(布加勒斯特大学; 迪米特里·坎泰米尔基督教大学)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

研究旨在确保教材质量,提出人工智能教科书审核器这一多智能体管道,通过事实技术与语法双轨道分析生成报告,经判断智能体过滤误报,支持两种摄取模式且可领域适配,在两本教科书上验证可减少人工查找问题工作量。

AI 中文摘要

确保教材质量不仅需要标准校对:教科书必须同时审核事实准确性、特定领域技术正确性和语言质量,这是通用语法检查器无法完成的任务。我们提出了人工智能教科书审核器,这是一个模块化多智能体管道,用于跨学科领域对教材进行自动化质量保证。该系统接受教科书PDF,并通过两个分析轨道生成结构化、可供人工审核的报告。在事实和技术轨道中,一组专门的大语言模型智能体检测事实错误、代码错误、错误定义和概念不一致,并通过网络搜索增强人文学科领域的审核;语法轨道原生操作PDF以保留变音编码。一个判断智能体在向人工审核员展示结果之前,使用特定领域规则过滤误报。该管道支持两种摄取模式,并可通过编码特定学科错误分类法的自定义提示进行领域适配。我们在两本罗马尼亚高中教科书上展示了该系统,并表明它是一种可减少人工查找候选问题工作量的分类工具。

英文摘要

Ensuring the quality of educational materials requires more than standard proofreading: textbooks must be audited for factual accuracy, domain-specific technical correctness, and linguistic quality simultaneously -- a task that general-purpose grammar checkers cannot address. We present \textbf{AI Textbook Auditor}, a modular multi-agent pipeline for automated quality assurance of educational materials across subject domains. The system accepts a textbook PDF and produces a structured, human-reviewable report via two analysis tracks: a \textbf{Factual and Technical Track} in which an ensemble of specialized LLM agents detects factual inaccuracies, code errors, incorrect definitions, and conceptual inconsistencies, augmented with web search for humanities domains; and a \textbf{Grammar Track} operating PDF-natively to preserve diacritical encoding. A \textbf{Judge Agent} filters false positives using domain-specific rules before presenting findings to a human reviewer. The pipeline supports two ingestion modes -- vision-native page rendering and PyMuPDF text extraction -- and is domain-adaptable via custom prompts encoding subject-specific error taxonomies. We demonstrate the system on two Romanian upper-secondary textbooks: a CS textbook (56 technical findings across seven categories, with an expert-validated precision of 62.5\%) and a history and social sciences textbook (72 findings spanning factual errors, ideological bias, and grammar). The system is designed as a triage tool that reduces the manual effort of locating candidate issues, with human expert validation required before any editorial action.

CommentsPresented @ iTextbooks 2026: 7th Workshop on Intelligent Textbooks at AIED'2026

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑