arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.11557cs.LGcs.CL
收藏

Knodle:基于PyTorch的模块化弱监督学习

Knodle: Modular Weakly Supervised Learning with PyTorch

University of Vienna(维也纳大学);Ludwig Maximilian University of Munich(慕尼黑大学)

Anastasiia Sedova, Andreas Stephan, Marina Speranskaya, Benjamin Roth

摘要:

用于提高弱监督机器学习模型的训练和预测质量的策略在针对特定任务定制或与特定模型架构集成的程度上有所不同。在这项工作中,我们介绍了Knodle,这是一个软件框架,它将弱数据注释,深度学习模型和改进弱监督训练的方法作为独立的模块化组件。这种模块化使训练过程能够访问细粒度信息,例如数据集特征、启发式规则的匹配或最终用于预测的深度学习模型的元素。因此,我们的框架可以包含各种各样的训练方法来改善弱监督,从只考虑规则和输出类的相关性的方法(独立于使用结果标签训练的机器学习模型),到利用神经网络和弱标记数据的相互作用的方法。我们说明了基准测试的潜力框架的性能比较的几个参考实现的选择数据集,已经在Knodle。该框架作为开源Python包knodle发布,可在https://github.com/knodle/knodle上获得。

英文摘要:

Strategies for improving the training and prediction quality of weakly supervised machine learning models vary in how much they are tailored to a specific task or integrated with a specific model architecture. In this work, we introduce Knodle, a software framework that treats weak data annotations, deep learning models, and methods for improving weakly supervised training as separate, modular components. This modularization gives the training process access to fine-grained information such as data set characteristics, matches of heuristic rules, or elements of the deep learning model ultimately used for prediction. Hence, our framework can encompass a wide range of training methods for improving weak supervision, ranging from methods that only look at correlations of rules and output classes (independently of the machine learning model trained with the resulting labels), to those that harness the interplay of neural networks and weakly labeled data. We illustrate the benchmarking potential of the framework with a performance comparison of several reference implementations on a selection of datasets that are already available in Knodle. The framework is published as an open-source Python package knodle and available at https://github.com/knodle/knodle.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑