arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.14094cs.LG
收藏

Datasheets for AI and medical datasets (DAIMS):医学研究中机器学习分析前的数据验证与文档化框架

Datasheets for AI and medical datasets (DAIMS): a data validation and documentation framework before machine learning analysis in medical research

Rigshospitalet, Copenhagen University Hospital(哥本哈根大学医院丽格医院)

Ramtin Zargari Marandi, Anne Svane Frahm, Maja Milojevic

AI总结:

针对医学研究中机器学习数据集验证与文档化不一致的问题,提出DAIMS框架,提供清单、工具、表格和流程图,以标准化数据准备并指导ML方法选择。

摘要:

尽管数据工程取得了进展,但在数据验证和文档化流程方面仍存在一致性不足的领域,这给涉及机器学习的研究带来了困惑和技术问题。虽然引入“Datasheets for Datasets”等框架已取得进展,但在为机器学习管道准备数据集方面仍有改进空间。在此,我们将该框架扩展为“Datasheets for AI and medical datasets - DAIMS”。我们公开可用的解决方案DAIMS提供了一个清单,包括数据标准化要求、辅助数据准备过程的软件工具、用于数据文档化和提出研究问题的扩展表格、作为数据字典的表格,以及用于建议机器学习分析以解决研究问题的流程图。该清单包含24项常见的数据标准化要求,其中工具检查并验证了其中的一部分。此外,我们提供了一个将研究问题映射到建议机器学习方法的流程图。DAIMS可作为数据集标准化的参考,并作为研究人员在其医学研究工作中应用有效机器学习技术的路线图。DAIMS可在GitHub上获取,并作为在线应用程序来自动化数据集评估的关键方面,促进为机器学习研究高效准备数据集。

英文摘要:

Despite progresses in data engineering, there are areas with limited consistencies across data validation and documentation procedures causing confusions and technical problems in research involving machine learning. There have been progresses by introducing frameworks like "Datasheets for Datasets", however there are areas for improvements to prepare datasets, ready for ML pipelines. Here, we extend the framework to "Datasheets for AI and medical datasets - DAIMS." Our publicly available solution, DAIMS, provides a checklist including data standardization requirements, a software tool to assist the process of the data preparation, an extended form for data documentation and pose research questions, a table as data dictionary, and a flowchart to suggest ML analyses to address the research questions. The checklist consists of 24 common data standardization requirements, where the tool checks and validate a subset of them. In addition, we provided a flowchart mapping research questions to suggested ML methods. DAIMS can serve as a reference for standardizing datasets and a roadmap for researchers aiming to apply effective ML techniques in their medical research endeavors. DAIMS is available on GitHub and as an online app to automate key aspects of dataset evaluation, facilitating efficient preparation of datasets for ML studies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑