arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2311.09088cs.HC
收藏

Co-ML:用于开发数据集设计实践的协作式机器学习模型构建

Co-ML: Collaborative Machine Learning Model Building for Developing Dataset Design Practices

Tiffany Tseng, Matt J. Davidson, Luis Morales-Navarro, Jennifer King Chen, Victoria Delaney, Mark Leibowitz, Jazbo Beason, R. Benjamin Shapiro

AI总结:

本文提出Co-ML,一款协作式机器学习建模平板应用,通过多设备同步和团队协作构建图像分类器,帮助初学者在实践中学习数据集设计,促进数据多样性与质量检查,研究发现学生更注重模型可学习性而非类别平衡。

摘要:

机器学习(ML)模型从根本上受数据塑造,构建包容的ML系统需要在如何设计具有代表性的数据集方面进行大量考量。然而,很少有面向初学者的ML建模工具旨在促进对数据集设计实践的动手学习,包括如何设计数据多样性和检查数据质量。为此,我们概述了用于设计包容性ML模型的四项数据设计实践(DDPs),并分享了如何设计一款名为Co-ML的平板应用,通过协作式ML模型构建体验来促进DDPs的学习。使用Co-ML,初学者可以通过分布式体验构建图像分类器,其中数据在多台设备间同步,使多个用户能够通过与同伴的讨论和协调来迭代优化ML数据集。我们在为期2周的教育性AIML夏令营中部署了Co-ML,13至18岁的青少年以小组形式构建定制的ML驱动移动应用。我们的分析揭示了在夏令营期间学生主导项目的背景下,使用Co-ML进行多用户模型构建如何支持DDPs的发展,包括纳入数据多样性、评估模型性能和检查数据质量。此外,我们发现学生尝试提升模型性能时,通常将可学习性置于类别平衡之上。通过这项工作,我们强调了协作、模型测试界面和学生主导项目的结合如何赋能学习者积极参与探索数据在ML系统中的作用。

英文摘要:

Machine learning (ML) models are fundamentally shaped by data, and building inclusive ML systems requires significant considerations around how to design representative datasets. Yet, few novice-oriented ML modeling tools are designed to foster hands-on learning of dataset design practices, including how to design for data diversity and inspect for data quality. To this end, we outline a set of four data design practices (DDPs) for designing inclusive ML models and share how we designed a tablet-based application called Co-ML to foster learning of DDPs through a collaborative ML model building experience. With Co-ML, beginners can build image classifiers through a distributed experience where data is synchronized across multiple devices, enabling multiple users to iteratively refine ML datasets in discussion and coordination with their peers. We deployed Co-ML in a 2-week-long educational AIML Summer Camp, where youth ages 13-18 worked in groups to build custom ML-powered mobile applications. Our analysis reveals how multi-user model building with Co-ML, in the context of student-driven projects created during the summer camp, supported development of DDPs including incorporating data diversity, evaluating model performance, and inspecting for data quality. Additionally, we found that students' attempts to improve model performance often prioritized learnability over class balance. Through this work, we highlight how the combination of collaboration, model testing interfaces, and student-driven projects can empower learners to actively engage in exploring the role of data in ML systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑