[Working Paper] Survey research has a long-standing history of being a human-powered field, but one that embraces various technologies for the collection, processing, and analysis of various behavioral, political, and social outcomes of interest, among others. At the same time, Large Language Models (LLMs) bring new technological challenges and prerequisites in order to fully harness their potential. In this paper, we report work-in-progress on a systematic literature review based on keyword searches from multiple large-scale databases as well as citation networks that assesses how LLMs are currently being applied within the survey research process. We synthesize and organize our findings according to the survey research process to include examples of LLM usage across three broad phases: pre-data collection, data collection, and post-data collection. We discuss selected examples of potential use cases for LLMs as well as its pitfalls based on examples from existing literature. Considering survey research has rich experience and history regarding data quality, we discuss some opportunities and describe future outlooks for survey research to contribute to the continued development and refinement of LLMs.
A review of the literature on citation impact indicators
引文影响力指标在当今学术评价中发挥着重要作用,因此在文献计量学和科学计量学文献中受到了广泛的关注。本文提供了一个深入的文献综述引文影响指标。首先,概述了可用于计算引文影响指标的书目数据库(Web of Science,Scopus和Google Scholar)的文献。接下来,选定的主题在文献中的引用影响指标进行了详细审查。第一个专题是选择纳入引文影响指标计算的出版物和引文。第二个主题是引文影响指标的标准化,特别是领域差异的标准化。论文的第三个主题是合著论文的统计方法,最后一个主题是期刊的引文影响指标。最后,本文提出了一些建议,为今后的研究。
Machine Learning Information Retrieval and Summarisation to Support Systematic Review on Outcomes Based Contracting
University of Warwick(华威大学);Alan Turing Institute for Data Science and AI(艾伦·图灵数据科学与人工智能研究所);Cranfield University(克兰菲尔德大学);Government Outcomes Lab(政府成果实验室);Blavatnik School of Government(布拉瓦尼克政府学院);University of Oxford(牛津大学)
Towards Evidence-Based Ontology for Supporting Systematic Literature Review
The Lab for Internet Software Technologies Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所互联网软件技术实验室);Graduate University of Chinese Academy of Sciences(中国科学院研究生院);National ICT Australia, University of New South Wales(澳大利亚国家信息与通信技术研究院,新南威尔士大学)
[研究背景]:系统文献综述(Systematic Literature Review,SLR)已成为软件工程的一种重要研究方法。[Aim]本文提出了一种方法,利用经验演变的本体,以支持自动化的关键SLR活动。【方法】:首先,我们提出了一个本体,SLRONT,建立在SLR经验和最佳实践的基础上,以捕捉常见的术语和它们之间的关系在SLR过程中;第二,我们提出了一个扩展版本的SLRONT,COSONT和实例化它的知识和概念提取结构化摘要。案例研究说明了应用它来支持SLR步骤的细节。【结果】:结果表明,通过使用COSONT,我们得到了相同的结论,与纯粹的手工工作相比,但所涉及的工作量显着减少。[结论]利用本体论的方法可以有效地支持系统性文献综述的开展。