arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.08142cs.LG
收藏

全面数据预处理对新冠死亡预测建模的影响

Impact of Comprehensive Data Preprocessing on Predictive Modelling of COVID-19 Mortality

Syamaprasad College(沙亚玛普拉德学院)

Sangita Das, Subhrajyoti Maji

AI总结:

本文通过自定义数据预处理流程提升了新冠死亡预测模型的准确性,改进了MLP回归器的RMSE和R平方指标。

摘要:

准确的预测模型对于分析新冠死亡趋势至关重要。本研究评估了自定义数据预处理流程对使用Our World in Data(OWID)数据的十种机器学习模型预测新冠死亡率的影响。我们的流程与标准预处理流程有四个关键不同之处。首先,它将每周报告的总数转换为每日更新,纠正报告偏差,提供更准确的估计。其次,它使用本地化异常检测和处理来保持数据方差并提高准确性。第三,它利用列之间的计算依赖性来确保数据一致性。最后,它采用迭代特征选择过程来优化特征集并提高模型性能。结果表明,自定义流程带来了显著改进:MLP回归器在测试集上的RMSE为66.556,R平方为0.991,超过了标准流程中的决策树回归器,其测试RMSE为222.858,R平方为0.817。这些发现强调了定制预处理技术在提高新冠死亡预测建模准确性方面的重要性。尽管针对本研究特定,这些方法为不同数据集和领域提供了有价值的见解,提高了各种情境下的预测性能。

英文摘要:

Accurate predictive models are crucial for analysing COVID-19 mortality trends. This study evaluates the impact of a custom data preprocessing pipeline on ten machine learning models predicting COVID-19 mortality using data from Our World in Data (OWID). Our pipeline differs from a standard preprocessing pipeline through four key steps. Firstly, it transforms weekly reported totals into daily updates, correcting reporting biases and providing more accurate estimates. Secondly, it uses localised outlier detection and processing to preserve data variance and enhance accuracy. Thirdly, it utilises computational dependencies among columns to ensure data consistency. Finally, it incorporates an iterative feature selection process to optimise the feature set and improve model performance. Results show a significant improvement with the custom pipeline: the MLP Regressor achieved a test RMSE of 66.556 and a test R-squared of 0.991, surpassing the DecisionTree Regressor from the standard pipeline, which had a test RMSE of 222.858 and a test R-squared of 0.817. These findings highlight the importance of tailored preprocessing techniques in enhancing predictive modelling accuracy for COVID-19 mortality. Although specific to this study, these methodologies offer valuable insights into diverse datasets and domains, improving predictive performance across various contexts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑