Research at the intersection of machine learning and the social sciences has provided critical new insights into social behavior. At the same time, a variety of critiques have been raised ranging from technical issues with the data used and features constructed, problematic assumptions built into models, their limited interpretability, and their contribution to bias and inequality. We argue such issues arise primarily because of the lack of social theory at various stages of the model building and analysis. In the first half of this paper, we walk through how social theory can be used to answer the basic methodological and interpretive questions that arise at each stage of the machine learning pipeline. In the second half, we show how theory can be used to assess and compare the quality of different social learning models, including interpreting, generalizing, and assessing the fairness of models. We believe this paper can act as a guide for computer and social scientists alike to navigate the substantive questions involved in applying the tools of machine learning to social data.
Intelligent Computing Social Modeling and Methodological Innovations in Political Science in the Era of Large Language Models
Shanghai Academy of Social Sciences(上海社会科学院);Nanjing University(南京大学);Shanghai Jiao Tong University(上海交通大学);Shanghai Institutes for International Studies(上海国际问题研究院)
A High-Scale Assessment of Social Media and Mainstream Media in Scientific Communication
Mendoza College of Business, University of Notre Dame(圣母门多萨商学院,圣母大学);New York University Shanghai(纽约大学上海分校);New York University(纽约大学);Kellogg School of Management, Northwestern University(西北大学凯洛格管理学院);National Bureau of Economic Research(美国国家经济研究局)
Artificially intelligent agents in the social and behavioral sciences: A history and outlook
Department of Computer Science, Aalto University(阿尔托大学计算机科学系);Center for Computational Social Science, Kobe University(大阪大学计算社会科学中心);Department of Methodology, London School of Economics and Political Science(伦敦政治经济学院方法论系)
Artificial intelligence adoption in the physical sciences, natural sciences, life sciences, social sciences and the arts and humanities: A bibliometric analysis of research publications from 1960-2021
From Symbols to Embeddings: A Tale of Two Representations in Computational Social Science
计算社会科学(Computational Social Science,CSS)是近年来兴起的一门新兴学科,旨在利用计算方法解决社会科学问题。CSS的研究是数据驱动的,并大大受益于在线用户生成的内容和社交网络的可用性,其中包含富文本和网络数据的调查。然而,这些大规模和多模态的数据也给研究人员提出了一个巨大的挑战:如何有效地表示数据,以挖掘我们想要的意义在CSS?为了探索答案,我们对CSS中的文本和网络数据表示进行了全面的回顾。具体来说,我们总结现有的表示为两种方案,即基于符号和基于嵌入的表示,并介绍了一系列的典型方法,为每一个方案。之后,我们提出了上述表示的应用程序的基础上调查的400多篇研究文章,从6个顶级场馆涉及CSS。从这些应用的统计数据中,我们发现了每种表示的强度,并发现了基于嵌入的表示在过去十年中出现并获得越来越多关注的趋势。最后,我们讨论了几个关键的挑战和开放的问题,为未来的发展方向。本调查旨在为CSS研究人员提供更深入的理解和更明智的数据表示应用。
Bridging Technology and Humanities: Evaluating the Impact of Large Language Models on Social Sciences Research with DeepSeek-R1
School of Physics and Information Technology, Shaanxi Normal University(陕西师范大学物理与信息技术学院);School of Foreign Languages, Northwest University(西北大学外国语学院);School of Computing, University of Georgia(佐治亚大学计算学院)
Prompt Selection Matters: Enhancing Text Annotations for Social Sciences with Large Language Models
Université Paris 1 Panthéon-Sorbonne(巴黎第一大学先贤祠-索邦大学);Université Paris-Saclay(巴黎萨克雷大学);Institut Jean Nicod(让·尼科德研究所);Ecole Normale Supérieure(巴黎高等师范学院);PSL-EHESS-CNRS(巴黎文理研究大学-法国高等社会科学研究院-法国国家科学研究中心)
LLM-Assisted Replication for Quantitative Social Science
Graduate School of Economics, Tohoku University(东北大学经济学研究生院);Max Planck Institute for Human Development(马克斯·普朗克人类发展研究所);CREST, ENSAE, Institut Polytechnique de Paris(巴黎高等理工学院CREST与ENSAE);Graduate School of Public Policy, The University of Tokyo(东京大学公共政策研究生院);Faculty of Engineering, The University of Tokyo(东京大学工学部)
Improving Stance Detection by Leveraging Measurement Knowledge from Social Sciences: A Case Study of Dutch Political Tweets and Traditional Gender Role Division
Department of Methodology and Statistics(方法学与统计学系)
Multilingual Agent-Based World Modeling for Social Science
Institute of Data Science, National University of Singapore(新加坡国立大学数据科学研究所);Singapore University of Technology and Design(新加坡科技设计大学);National School of Development, Peking University(北京大学国家发展研究院);Singapore Management University(新加坡管理大学)