Systematic Framework of Application Methods for Large Language Models in Language Sciences
Tongji University, China(同济大学);University of Tübingen, Germany(图宾根大学);Institute of Natural Language Processing, University of Stuttgart, Germany(斯图加特大学自然语言处理研究所)
Large Language Models (LLMs) are transforming language sciences. However, their widespread deployment currently suffers from methodological fragmentation and a lack of systematic soundness. This study proposes two comprehensive methodological frameworks designed to guide the strategic and responsible application of LLMs in language sciences. The first method-selection framework defines and systematizes three distinct, complementary approaches, each linked to a specific research goal: (1) prompt-based interaction with general-use models for exploratory analysis and hypothesis generation; (2) fine-tuning of open-source models for confirmatory, theory-driven investigation and high-quality data generation; and (3) extraction of contextualized embeddings for further quantitative analysis and probing of model internal mechanisms. We detail the technical implementation and inherent trade-offs of each method, supported by empirical case studies. Based on the method-selection framework, the second systematic framework proposed provides constructed configurations that guide the practical implementation of multi-stage research pipelines based on these approaches. We then conducted a series of empirical experiments to validate our proposed framework, employing retrospective analysis, prospective application, and an expert evaluation survey. By enforcing the strategic alignment of research questions with the appropriate LLM methodology, the frameworks enable a critical paradigm shift in language science research. We believe that this system is fundamental for ensuring reproducibility, facilitating the critical evaluation of LLM mechanisms, and providing the structure necessary to move traditional linguistics from ad-hoc utility to verifiable, robust science.
Cheap Learning: Maximising Performance of Language Models for Social Data Science Using Minimal Data
Public Policy Programme, The Alan Turing Institute, British Library(公共政策计划、艾伦·图灵研究所、大英图书馆);School of Geographical Sciences, University of Bristol(地理科学学院、布里斯托尔大学);Oxford Internet Institute, University of Oxford(牛津大学网络研究所);Zug Institute for Blockchain Research, University of Lucerne(祖格区块链研究所、卢塞恩大学)
Pedagogical Alignment for Vision-Language-Action Models: A Comprehensive Framework for Data, Architecture, and Evaluation in Education
Chosun University(全州大学);Seoul National University(首尔国立大学);Korea Institute for Curriculum and Evaluation(韩国课程评价院);Nanyang Technological University(南洋理工大学)
Introducing HALC: A general pipeline for the systematic and reliable construction of prompts for automated coding with LLMs in the computational social sciences
It's not Rocket Science : Interpreting Figurative Language in Narratives
Columbia University(哥伦比亚大学);Allen Institute for Artificial Intelligence(艾伦人工智能研究所);University of Washington(华盛顿大学);University of British Columbia(不列颠哥伦比亚大学)
Prompt Selection Matters: Enhancing Text Annotations for Social Sciences with Large Language Models
Université Paris 1 Panthéon-Sorbonne(巴黎第一大学先贤祠-索邦大学);Université Paris-Saclay(巴黎萨克雷大学);Institut Jean Nicod(让·尼科德研究所);Ecole Normale Supérieure(巴黎高等师范学院);PSL-EHESS-CNRS(巴黎文理研究大学-法国高等社会科学研究院-法国国家科学研究中心)
Large language models in materials science and the need for open-source approaches
School of Physics, Chemistry and Earth Sciences, The University of Adelaide(物理、化学和地球科学学院,阿德莱德大学);School of Computer and Mathematical Sciences, The University of Adelaide(计算机与数学科学学院,阿德莱德大学)
PLLaMa: An Open-source Large Language Model for Plant Science
University of California, Santa Barbara(加州大学圣塔芭芭拉分校);University of Lincoln(林肯大学);Chinese Academy of Agricultural Sciences(中国农业科学院);Swedish University of Agricultural Sciences(瑞典农业科学大学)
MatTools: Benchmarking Large Language Models for Materials Science Tools
Center for Structural Materials, Department of Mechanical Engineering, The University of Hong Kong(香港大学机械工程系结构材料中心);Materials Innovation Institute for Life Sciences(生命科学创新研究所)
Construction and Application of Materials Knowledge Graph in Multidisciplinary Materials Science via Large Language Model
School of Computer Science and Engineering, University of New South Wales(新南威尔士大学计算机科学与工程学院);GreenDynamics(绿动力);Department of Materials Science and Engineering, City University of Hong Kong(香港城市大学材料科学与工程系);Department of Linguistics and Translation, City University of Hong Kong(香港城市大学语言学与翻译系);School of Photovoltaic and Renewable Energy Engineering, University of New South Wales(新南威尔士大学光伏与可再生能源工程学院);College of Design & Innovation, Tongji University(同济大学设计与创新学院)
Selecting Language Models for Social Science: Start Small, Start Open, and Validate
Department of Sociology and Anthropology, Lehigh University(社会学与人类学系,莱恩大学);Department of Sociology, New Mexico State University(社会学系,新墨西哥州立大学);Department of Computer Science, New Mexico State University(计算机科学系,新墨西哥州立大学)
MaterialFigBENCH: benchmark dataset with figures for evaluating college-level materials science problem-solving abilities of multimodal large language models
OceanGPT: A Large Language Model for Ocean Science Tasks
College Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Donghai Laboratory(东海实验室);School of Software Technology, Zhejiang University(浙江大学软件学院);Huzhou University(湖州大学);Ocean College, Zhejiang University(浙江大学海洋学院);Zhoushan-Zhejiang University Ocean Research Center(舟山浙江大学海洋研究中心)
Political-LLM: Large Language Models in Political Science
Florida State University(佛罗里达州立大学);University of Southern California(南加利福尼亚大学);Louisiana State University(路易斯安那州立大学);University of Virginia(弗吉尼亚大学);University of Pennsylvania(宾夕法尼亚大学);New York University(纽约大学);Oxford University(牛津大学);Lehigh University(理海大学);Rice University(莱斯大学);Northwestern University(西北大学);NVIDIA(英伟达公司)