While many researchers use Large Language Models (LLMs) through chat-based access, their real potential lies in leveraging LLMs via application programming interfaces (APIs). This paper conceptualizes LLMs as universal text processing machines and presents a comprehensive workflow for employing LLMs in three qualitative and quantitative content analysis tasks: (1) annotation (an umbrella term for qualitative coding, labeling and text classification), (2) summarization, and (3) information extraction. The workflow is explicitly human-centered. Researchers design, supervise, and validate each stage of the LLM process to ensure rigor and transparency. Our approach synthesizes insights from extensive methodological literature across multiple disciplines: political science, sociology, computer science, psychology, and management. We outline validation procedures and best practices to address key limitations of LLMs, such as their black-box nature, prompt sensitivity, and tendency to hallucinate. To facilitate practical implementation, we provide supplementary materials, including a prompt library and Python code in Jupyter Notebook format, accompanied by detailed usage instructions.
Harnessing LLMs for Automated Video Content Analysis: An Exploratory Workflow of Short Videos on Depression
The University of Texas at Austin(德克萨斯大学奥斯汀分校);Institute of High Performance Computing (IHPC), A*STAR(高性能计算研究所(A*STAR));Pennsylvania State University(宾夕法尼亚州立大学);Clark University(克拉克大学);Columbia University(哥伦比亚大学)
Conversational Education at Scale: A Multi-LLM Agent Workflow for Procedural Learning and Pedagogic Quality Assessment
Vrije University of Amsterdam(阿姆斯特丹自由大学);University College London(伦敦大学学院);University of Amsterdam(阿姆斯特丹大学);National Institute of Informatics(日本信息处理学会);Shandong University(山东大学);Guangzhou University(广州大学)
Biomedical systems biology workflow orchestration and execution with PoSyMed
Institute for Computational Systems Biomedicine, University of Hamburg(计算系统生物医学研究所,汉堡大学);Faculty of Science, Computer Science, Vrije Universiteit Amsterdam(科学与计算机科学学院,阿姆斯特丹自由大学);Department for Mathematics and Computer Science, University of Southern Denmark(数学与计算机科学系,南丹麦大学)
Dalian University of Technology(大连理工大学);Zhejiang University(浙江大学);University of Science and Technology of China(中国科学技术大学);Tencent(腾讯);Tongji University(同济大学)
Remote Sensing Image Intelligent Interpretation with the Language-Centered Perspective: Principles, Methods and Challenges
School of Geosciences and Info-Physics, Central South University(中南大学地球科学与信息物理学院);Faculty of Geosciences and Environmental Engineering, Southwest Jiaotong University(西南交通大学地质科学与环境工程学院);School of Earth and Space Sciences, Peking University(北京大学地球与空间科学学院);Institute of Remote Sensing Information Processing (IRSIP), Wuhan University(武汉大学遥感信息处理研究所)
Enabling Doctor-Centric Medical AI with LLMs through Workflow-Aligned Tasks and Benchmarks
Shenzhen Research Institute of Big Data(大数据研究 institute);National Health Data Institute(国家健康数据研究所);Halmstad University(哈马碧大学);Shenzhen University of Advanced Technology(深圳先进技术大学)
NuHF Claw: A Risk Constrained Cognitive Agent Framework for Human Centered Procedure Support in Digital Nuclear Control Rooms
Institute of Nuclear and New Energy Technology, Tsinghua University(清华大学核能与新能源技术研究院);National Key Laboratory of Human Factors Engineering(人因工程国家重点实验室);Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所)
Human-Centered LLM-Agent User Interface: A Position Paper
New York University Shanghai(上海纽约大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);New York University Tandon School of Engineering(纽约大学坦登工程学院)
本文指出LLM-Agent用户界面(LAUI)应超越被动跟随,通过主动研究用户需求并提出新交互方案来帮助不了解底层系统的用户发现涌现工作流,并以Flute X GPT为例进行了说明。
Center for Artificial Intelligence in Public Health Research (ZKI-PH)(公共健康研究中的人工智能研究中心);Robert Koch Institute(罗伯特· Koch 研究所);Department of Mathematics and Computer Science(数学与计算机科学系)
What to Format and How: A Benchmark and Workflow Approach for Document Formatting
Institute of Information Engineering, Chinese Academy of Sciences(信息工程研究所,中国科学院);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院)