arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.02884cs.HCcs.AIcs.LG
收藏

Model Sketching:早期机器学习模型设计中的中心概念

Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Design

Stanford University(斯坦福大学);Northeastern University(东北大学)

Michelle S. Lam, Zixian Ma, Anne Li, Izequiel Freitas, Dakuo Wang, James A. Landay, Michael S. Bernstein

摘要:

机器学习从业者通常最终会在模型架构和性能指标等低级技术细节上挖掘隧道。早期的模型开发是否可以专注于模型应该关注哪些因素的高级问题?灵感来自设计中的草图,它将想法提炼到最小的表示,我们介绍模型草图:一个技术框架,用于迭代和快速创作机器学习模型的决策逻辑的功能近似。模型草图将从业者的注意力重新集中在构成高级的、人类可理解的概念上,模型被期望对其进行推理(例如,内容节制任务中的亵渎、种族主义或讽刺)。在对17名ML从业者的评估中,模型草图重构了从实现到更高层次探索的思维,促进了更广泛的模型设计的迭代,并帮助识别问题表述$\unicode{x2014}$中的差距,所有这些都是在通常构建模型所需时间的一小部分。

英文摘要:

Machine learning practitioners often end up tunneling on low-level technical details like model architectures and performance metrics. Could early model development instead focus on high-level questions of which factors a model ought to pay attention to? Inspired by the practice of sketching in design, which distills ideas to their minimal representation, we introduce model sketching: a technical framework for iteratively and rapidly authoring functional approximations of a machine learning model's decision-making logic. Model sketching refocuses practitioner attention on composing high-level, human-understandable concepts that the model is expected to reason over (e.g., profanity, racism, or sarcasm in a content moderation task) using zero-shot concept instantiation. In an evaluation with 17 ML practitioners, model sketching reframed thinking from implementation to higher-level exploration, prompted iteration on a broader range of model designs, and helped identify gaps in the problem formulation$\unicode{x2014}$all in a fraction of the time ordinarily required to build a model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑