使用Gemini和LuaLaTeX将物理视频转录为PDF/UA-2和符合ISO 32005标准的数学可访问PDF
Using Gemini and LuaLaTeX to transcribe physics videos into PDF/UA-2 and ISO 32005 math-accessible PDFs
浏览论文内容
中文总结 AI 辅助
该研究提出结合Gemini与LuaLaTeX的AI转录工作流，可将含大量数学内容的物理视频转录为符合PDF/UA-2和ISO 32005标准的数学可访问PDF，提供了性能评估及可复用的系统指令与导言。
中文摘要 AI 辅助
我们提出了一种AI转录工作流，使用免费工具将包含大量数学内容的教学物理视频转录为数学可访问PDF。在精心设计的系统指令引导下，Google Gemini可将链接或上传的视频转录为LaTeX输出；重要的是，所有黑板书写或屏幕展示的公式均被转录为LaTeX数学内容，并融入文本流或以描述性片段呈现，这些片段还会描述图表、图形以及教学中重要的动作与交互。Gemini的LaTeX输出被附加到预先编写的支持SE标记的导言中，并由LuaLaTeX引擎编译；生成的PDF转录稿通常可无错误编译，且通过PDF/UA-2和ISO 32005验证测试。我们使用大量测试转录示例提供了平衡的性能评估，公开的补充资源包含对应所有示例的完整转录稿，以及经过充分测试的系统指令和导言，以便他人使用、调整、研究和进一步开发该转录框架。
英文摘要
We present an AI transcription workflow that uses freely available tools to transcribe instructional physics videos with substantial mathematical content into math-accessible PDFs. Guided by our carefully crafted system instructions, Google Gemini transcribes linked or uploaded videos into LaTeX output. Importantly, all board-written or screen-presented equations are transcribed into LaTeX math and incorporated into the verbal flow or presented in descriptive segments, which also describe graphs, diagrams, and pedagogically important actions and interactions. Gemini's LaTeX output is appended to a prewritten SE tagging-enabled preamble and compiled by a LuaLaTeX engine; the resulting PDF transcripts routinely compile without errors and pass PDF/UA-2 and ISO 32005 validation tests. We provide a balanced performance assessment using numerous examples from test transcriptions. The publicly available supplementary resources contain complete transcripts corresponding to all presented examples, and also contain our well-tested system instructions and preamble so that others can use, adapt, study, and further develop our transcription framework.
