用于对齐阅读材料与学习目标及评估牙科教育主题平衡的自然语言处理
Natural Language Processing for Aligning Readings with Learning Objectives and Assessing Topic Balance in Dental Education
AI总结:
本研究提出一种结合PubMedBERT、余弦相似度、NLI及主题建模的NLP工作流,用于牙科教育中对齐阅读材料与学习目标,经测试可提升阅读材料选择的准确率,支持循证课程整理。
摘要:
课程团队常缺乏时间检查指定阅读材料是否支持学习目标(LOs)以及主题覆盖是否平衡。我们提出一种自然语言处理(NLP)工作流,以支持循证的阅读列表整理。该工作流结合PubMedBERT句子嵌入与余弦相似度用于检索、自然语言推理(NLI)用于证据检查、主题建模用于覆盖分析。我们在牙科教育中测试该方法,使用13个课程级LOs和来自PubMed的3837对LO-摘要语料库。13个LOs的余弦相似度中位数范围为0.86至0.91,显示出较高的语义相似度。主题建模显示覆盖广泛但不均衡,每个领域有1至2个主导主题。仅靠相似度不足以选择阅读材料:在高相似度对(余弦0.90-1.00)中,22.9%被NLI分类为中性或矛盾。在含49对的专家标注验证集中,基于余弦的检索(余弦≥0.90)准确率为0.69,而结合余弦与NLI的方法针对专家对齐标签达到0.73的准确率。总体而言,该工作流展示了AI如何通过减少误报、帮助选择更匹配预期LOs的阅读材料来支持课程对齐。
英文摘要:
Curriculum teams often lack time to check whether assigned readings support learning objectives (LOs) and whether topic coverage is balanced. We present a natural language processing (NLP) workflow to support evidence-informed curation of reading lists. The workflow combines PubMedBERT sentence embeddings and cosine similarity for retrieval, natural language inference (NLI) for evidence checking, and topic modeling for coverage analysis. We tested the approach in dental education using 13 course-level LOs and a PubMed-derived corpus of 3,837 LO-abstract pairs. Median cosine similarity ranged from 0.86 to 0.91 across the 13 LOs, showing generally high semantic similarity. Topic modeling showed broad but uneven coverage, with one or two dominant topics per domain. Similarity alone was not enough for selecting readings: among high-similarity pairs (cosine 0.90-1.00), 22.9% were classified by NLI as neutral or contradictory. In a 49-pair expert-labeled validation set, cosine-based retrieval (cosine >= 0.90) achieved 0.69 accuracy, while the combined cosine and NLI approach achieved 0.73 accuracy against expert alignment labels. Overall, the workflow shows how AI can support curriculum alignment by reducing false positives and helping select readings that better match intended LOs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。