While data science has emerged as a contentious new scientific field, enormous debates and discussions have been made on it why we need data science and what makes it as a science. In reviewing hundreds of pieces of literature which include data science in their titles, we find that the majority of the discussions essentially concern statistics, data mining, machine learning, big data, or broadly data analytics, and only a limited number of new data-driven challenges and directions have been explored. In this paper, we explore the intrinsic challenges and directions inspired by comprehensively exploring the complexities and intelligence embedded in data science problems. We focus on the research and innovation challenges inspired by the nature of data science problems as complex systems, and the methodologies for handling such systems.
A Review of Generative AI in Computer Science Education: Challenges and Opportunities in Accuracy, Authenticity, and Assessment
School of Computer Science and Engineering, California State University, San Bernardino, USA(加州州立大学圣伯纳迪诺分校计算机科学与工程学院);School of Information Systems and Technology, San Jose State University, USA(旧金山州立大学信息系统与技术学院);University of California, San Diego, USA(加州大学圣地亚哥分校)
Replication Markets: Results, Lessons, Challenges and Opportunities in AI Replication
University of California, Santa Cruz(加州大学圣克鲁兹分校);Massey University(梅西大学);Harvard University(哈佛大学);KeyW Research Lab(KeyW研究实验室);George Mason University(乔治梅森大学)
在过去的十年中,社会和行为科学中出现了系统的大规模复制项目(Camerer等人,2016,2018; Ebersole等人,2016; Klein等人,2014,2018;协作,2015)。这些项目是由对科学出版物中高比例的“假阳性”(Ioannovich,2005)以及“可疑研究实践”(Simmons,Nelson和Simonsohn,2011)的高流行率的理论和概念担忧驱动的。对研究结果可信度的担忧并不是行为科学和社会科学所独有的;在计算机科学中,人工智能(AI)和机器学习(ML)是特别值得关注的领域(Lucic et al.,2018; Freire,Bonnet和Shasha,2012; Gundersen和Kjensmo,2018; Henderson等人,2018年)。鉴于行为和社会科学在促进新方法以提高研究可信度方面的先锋作用,分析从这一领域吸取的经验教训并调整计算机科学,AI和ML的策略是一种很有前途的方法。本文中,我们回顾了行为和社会科学以及DARPA SCORE项目中使用的方法。我们特别关注人类预测复制结果的作用,以及预测如何利用从相对劳动和资源密集型复制中获得的信息。我们将讨论使用这些方法来监控和提高计算机科学,AI和ML研究领域的可信度的机会和挑战。