arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.04859cs.CLcs.AIcs.CY
收藏

码本缩减与饱和:关于大语言模型归纳式主题饱和及主题分析中初始编码的新观察

Codebook Reduction and Saturation: Novel observations on Inductive Thematic Saturation for Large Language Models and initial coding in Thematic Analysis

Abertay University(阿伯泰大学);Yale Medical School(耶鲁医学院)

Stefano De Paoli, Walter Stan Mathis

AI总结:

本文研究大语言模型在主题分析初始编码中的分析饱和问题,提出基于DSPy框架的归纳式主题饱和(ITS)测量新技术,以实现对饱和度的精确量化。

摘要:

本文反思了使用大语言模型(LLMs)执行主题分析的过程。具体而言,本文处理的是由LLMs产生的初始编码的分析饱和问题。主题分析是一种成熟的定性分析方法,由相互关联的阶段组成。其中一个关键阶段是初始编码,在此阶段分析人员为数据集的离散组成部分分配标签。饱和是衡量定性分析有效性的一种方式,与初始编码的重复和再现有关。在本文中,我们反思了LLMs在多大程度上能够实现分析饱和,并提出了一种测量归纳式主题饱和(ITS)的新技术。该新技术利用了一个名为DSPy的编程框架。所提出的新方法能够精确测量ITS。

英文摘要:

This paper reflects on the process of performing Thematic Analysis with Large Language Models (LLMs). Specifically, the paper deals with the problem of analytical saturation of initial codes, as produced by LLMs. Thematic Analysis is a well-established qualitative analysis method composed of interlinked phases. A key phase is the initial coding, where the analysts assign labels to discrete components of a dataset. Saturation is a way to measure the validity of a qualitative analysis and relates to the recurrence and repetition of initial codes. In the paper we reflect on how well LLMs achieve analytical saturation and propose also a novel technique to measure Inductive Thematic Saturation (ITS). This novel technique leverages a programming framework called DSPy. The proposed novel approach allows a precise measurement of ITS.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑