应对机器学习中的数据损坏:平衡质量、数量与插补策略
Navigating Data Corruption in Machine Learning: Balancing Quality, Quantity, and Imputation Strategies
AI总结:
本研究通过NLP监督学习与交通信号强化学习两组实验,探究数据损坏对模型性能的影响,分析了插补策略的权衡效应、数据扩容的边际效用递减规律,得出30%数据决定性能的经验结论,为鲁棒ML系统开发提供指导。
摘要:
数据损坏(包括缺失数据与噪声数据)给现实世界的机器学习带来了重大挑战。本研究通过两组实验设置——面向自然语言处理任务的监督学习(NLP-SL)以及用于交通信号优化的深度强化学习(Signal-RL),探究了数据损坏对模型性能的影响,并探索了缓解此类影响的策略。我们分析了数据损坏程度与模型性能之间的关系,评估了数据插补方法的有效性,同时验证了扩大数据集规模以应对数据损坏的作用。\n 研究结果表明,数据损坏下的模型性能遵循收益递减曲线,可通过指数函数建模。缺失数据虽会损害性能,但危害不及噪声数据;噪声数据会导致严重的性能下降与训练不稳定,在Signal-RL这类序列决策任务中尤为明显。插补策略存在权衡:它们能恢复缺失信息,但也可能引入噪声,其有效性取决于插补准确率与损坏比例。我们在插补优势热力图中识别出了不同区域,包括“插补优势角”与“插补劣势边”,并根据决策边界将任务划分为“噪声敏感型”与“噪声不敏感型”。\n 此外,我们发现增加数据集规模能够缓解但无法完全克服数据损坏的影响。随着损坏程度上升,额外数据的边际效用会递减。本研究得出一条经验规律:约30%的数据对性能起决定性作用,剩余70%的影响极小。\n 这些发现为数据预处理、插补策略选择及数据收集实践提供了可落地的见解,可为噪声环境下鲁棒机器学习系统的开发提供指导。
英文摘要:
Data corruption, including missing and noisy data, poses significant challenges in real-world machine learning. This study investigates the effects of data corruption on model performance and explores strategies to mitigate these effects through two experimental setups: supervised learning with NLP tasks (NLP-SL) and deep reinforcement learning for traffic signal optimization (Signal-RL). We analyze the relationship between data corruption levels and model performance, evaluate the effectiveness of data imputation methods, and assess the utility of enlarging datasets to address data corruption. Our results show that model performance under data corruption follows a diminishing return curve, modeled by the exponential function. Missing data, while detrimental, is less harmful than noisy data, which causes severe performance degradation and training instability, particularly in sequential decision-making tasks like Signal-RL. Imputation strategies involve a trade-off: they recover missing information but may introduce noise. Their effectiveness depends on imputation accuracy and corruption ratio. We identify distinct regions in the imputation advantage heatmap, including an "imputation advantageous corner" and an "imputation disadvantageous edge" and classify tasks as "noise-sensitive" or "noise-insensitive" based on their decision boundaries. Furthermore, we find that increasing dataset size mitigates but cannot fully overcome the effects of data corruption. The marginal utility of additional data diminishes as corruption increases. An empirical rule emerges: approximately 30% of the data is critical for determining performance, while the remaining 70% has minimal impact. These findings provide actionable insights into data preprocessing, imputation strategies, and data collection practices, guiding the development of robust machine learning systems in noisy environments.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。