基于虚拟世界探索和视听感官替代的印刷品阅读障碍者数学内容浏览
Mathematical Content Browsing for Print-Disabled Readers Based on Virtual-World Exploration and Audio-Visual Sensory substitution
摘要:
包含数学内容的文档在很大程度上仍然是盲人和视障读者无法访问的,因为它们主要是以无标签的PDF格式发布的,其中不包括有效访问所需的语义数据。我们提出了一种浏览方法,专门针对这样的数学内容的打印禁用的读者。这种方法借鉴了通常用于探索文本冒险游戏的虚拟世界的导航机制,用视听感官替代图形内容。方程中元素的相对空间位置被表示为一个虚拟世界,这样读者就可以在元素之间导航。文本元素通常使用合成语音来宣告,而图形元素(诸如根和分数线)使用vOICe算法的修改来呈现。虚拟世界允许读者交互式地发现方程的空间结构,而图形元素作为声音的再现允许发现和识别不能合成为语音的元素的形状和身份。浏览的方法进行了评估,11名盲人和14名视力正常的参与者在用户试验,其中包括识别12个方程提取的PDF文件。总的来说,78%的病例(盲人和视力正常的受试者分别为74%和83%)完全正确识别方程。如果考虑部分正确性,则性能显著更高。我们的结论是,整合的空间模型表示为一个虚拟的世界,结合视听感官替代非文本元素可以是一种有效的方式,盲人和视障读者阅读目前无法访问的PDF文件中的数学内容。
英文摘要:
Documents containing mathematical content remain largely inaccessible to blind and visually impaired readers because they are predominantly published as untagged PDF which does not include the semantic data necessary for effective accessibility. We present a browsing approach for print-disabled readers specifically aimed at such mathematical content. This approach draws on the navigational mechanisms often used to explore the virtual worlds of text adventure games with audio-visual sensory substitution for graphical content. The relative spatial placement of the elements of an equation are represented as a virtual world, so that the reader can navigate from element to element. Text elements are announced conventionally using synthesised speech while graphical elements, such as roots and fraction lines, are rendered using a modification of the vOICe algorithm. The virtual world allows the reader to interactively discover the spatial structure of the equation, while the rendition of graphical elements as sound allows the shape and identity of elements that cannot be synthesised as speech to be discovered and recognised. The browsing approach was evaluated by eleven blind and fourteen sighted participants in a user trial that included the identification of twelve equations extracted from PDF documents. Overall, equations were identified completely correctly in 78% of cases (74% and 83% respectively for blind and sighted subjects). If partial correctness is considered, the performance is substantially higher. We conclude that the integration of a spatial model represented as a virtual world in conjunction with audio-visual sensory substitution for non-textual elements can be an effective way for blind and visually impaired readers to read currently inaccessible mathematical content in PDF documents.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。