arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2512.09552cs.CL
收藏

大型语言模型在语言科学中应用方法的系统框架

Systematic Framework of Application Methods for Large Language Models in Language Sciences

Tongji University, China(同济大学);University of Tübingen, Germany(图宾根大学);Institute of Natural Language Processing, University of Stuttgart, Germany(斯图加特大学自然语言处理研究所)

Kun Sun, Rong Wang

AI总结:

本文提出两个系统框架,指导LLMs在语言科学中的战略应用,通过方法选择和多阶段研究流程提升研究的可重复性和科学性。

摘要:

大型语言模型(LLMs)正在改变语言科学。然而,其广泛应用目前受到方法学碎片化和缺乏系统严谨性的影响。本研究提出了两个综合的方法学框架,旨在指导LLMs在语言科学中的战略和负责任的应用。第一个方法选择框架定义并系统化了三种不同的、互补的方法,每种方法与特定的研究目标相关:(1)基于提示与通用模型的交互用于探索性分析和假设生成;(2)对开源模型的微调用于确认性、理论驱动的调查和高质量数据生成;(3)提取上下文化嵌入用于进一步的定量分析和对模型内部机制的探测。我们详细阐述了每种方法的技术实现和固有权衡,并通过实证案例研究加以支持。基于方法选择框架,第二个系统框架提供了构造的配置,指导基于这些方法的多阶段研究流程的实践实施。我们随后进行了一系列实证实验来验证所提框架,采用回顾分析、前瞻性应用和专家评估调查。通过强制研究问题与适当LLM方法的战略对齐,这些框架使语言科学研究实现了关键范式转变。我们相信,这种系统对于确保可重复性、促进LLM机制的批判性评估以及为传统语言学从随意实用性转向可验证、稳健的科学提供必要的结构都是基础性的。

英文摘要:

Large Language Models (LLMs) are transforming language sciences. However, their widespread deployment currently suffers from methodological fragmentation and a lack of systematic soundness. This study proposes two comprehensive methodological frameworks designed to guide the strategic and responsible application of LLMs in language sciences. The first method-selection framework defines and systematizes three distinct, complementary approaches, each linked to a specific research goal: (1) prompt-based interaction with general-use models for exploratory analysis and hypothesis generation; (2) fine-tuning of open-source models for confirmatory, theory-driven investigation and high-quality data generation; and (3) extraction of contextualized embeddings for further quantitative analysis and probing of model internal mechanisms. We detail the technical implementation and inherent trade-offs of each method, supported by empirical case studies. Based on the method-selection framework, the second systematic framework proposed provides constructed configurations that guide the practical implementation of multi-stage research pipelines based on these approaches. We then conducted a series of empirical experiments to validate our proposed framework, employing retrospective analysis, prospective application, and an expert evaluation survey. By enforcing the strategic alignment of research questions with the appropriate LLM methodology, the frameworks enable a critical paradigm shift in language science research. We believe that this system is fundamental for ensuring reproducibility, facilitating the critical evaluation of LLM mechanisms, and providing the structure necessary to move traditional linguistics from ad-hoc utility to verifiable, robust science.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑