当前用于文本偏见检测的拓扑与机器学习应用
Current Topological and Machine Learning Applications for Bias Detection in Text
AI总结:
本研究利用 RedditBias 数据库,结合 BERT 等 transformer 模型、t-SNE 可视化与 KNN 分类器,分析文本偏见,发现 mini BERT 在偏见分类中表现最佳,建议改进单语模型并探索特定领域偏见。
摘要:
制度偏见会影响患者预后、教育成就和法律系统导航。书面记录通常反映了偏见,一旦识别出偏见,就可以推荐个人接受培训以减少偏见。现有许多机器学习工具可探索文本数据并创建预测模型,以搜索书面记录来识别实时偏见。然而,以往很少有研究调查偏见文本数据的大型语言模型嵌入和几何模型,以理解几何结构对偏见建模准确性的影响。为克服这一问题,本研究利用 RedditBias 数据库分析文本偏见。研究探索了包括 BERT 和 RoBERTa 变体在内的四种 transformer 模型。嵌入后,t-SNE 实现了数据的二维可视化。KNN 分类器区分了偏见类型,其中较低的 k 值被证明更为有效。研究结果表明,BERT(尤其是 mini BERT)在偏见分类中表现优异,而多语言模型则表现滞后。建议强调改进单语模型并探索特定领域的偏见。
英文摘要:
Institutional bias can impact patient outcomes, educational attainment, and legal system navigation. Written records often reflect bias, and once bias is identified; it is possible to refer individuals for training to reduce bias. Many machine learning tools exist to explore text data and create predictive models that can search written records to identify real-time bias. However, few previous studies investigate large language model embeddings and geometric models of biased text data to understand geometry's impact on bias modeling accuracy. To overcome this issue, this study utilizes the RedditBias database to analyze textual biases. Four transformer models, including BERT and RoBERTa variants, were explored. Post-embedding, t-SNE allowed two-dimensional visualization of data. KNN classifiers differentiated bias types, with lower k-values proving more effective. Findings suggest BERT, particularly mini BERT, excels in bias classification, while multilingual models lag. The recommendation emphasizes refining monolingual models and exploring domain-specific biases.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。