语言大模型 / LLM - arXivDaily 专题

2407.02235 2025-03-10 cs.CL 89%

Towards a Holistic Framework for Multimodal Large Language Models in Three-dimensional Brain CT Report Generation

Cheng-Yi Li, Kao-Jung Chang, Cheng-Fu Yang, Hsin-Yu Wu, Wenting Chen, Hritik Bansal, Ling Chen, Yi-Ping Yang, Yu-Chun Chen, Shih-Pin Chen, Jiing-Feng Lirng, Kai-Wei Chang, Shih-Hwa Chiou

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

Comments 6 figures, 5 supplementary figures, 8 supplementary tables

Journal ref Nature Communications 16, 2258 (2025)

2503.04135 2025-03-07 cs.CL 89%

Biological Sequence with Language Model Prompting: A Survey

Jiyue Jiang, Zikang Wang, Yuheng Shan, Heyan Chai, Jiayi Li, Zixian Ma, Xinrui Zhang, Yu Li

专题命中评测与基准：language model(title,abstract)；prompting(title,abstract)；large language model(abstract)；分类 cs.CL

2503.03702 2025-03-06 cs.CL 89%

Developing and Utilizing a Large-Scale Cantonese Dataset for Multi-Tasking in Large Language Models

Jiyue Jiang, Alfred Kar Yin Truong, Yanyu Chen, Qinghang Bao, Sheng Wang, Pengan Chen, Jiuming Wang, Lingpeng Kong, Yu Li, Chuan Wu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL

2503.01742 2025-03-06 cs.CL 89%

Building Safe GenAI Applications: An End-to-End Overview of Red Teaming for Large Language Models

Alberto Purpura, Sahil Wadhwa, Jesse Zymet, Akshay Gupta, Andy Luo, Melissa Kazemi Rad, Swapnil Shinde, Mohammad Shahed Sorower

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2403.07714 2025-03-06 cs.CL 89%

StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Models

Zhicheng Guo, Sijie Cheng, Hao Wang, Shihao Liang, Yujia Qin, Peng Li, Zhiyuan Liu, Maosong Sun, Yang Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

2503.01947 2025-03-06 cs.CL cs.CY 89%

Analyzing the Safety of Japanese Large Language Models in Stereotype-Triggering Prompts

Akito Nakanishi, Yukie Sano, Geng Liu, Francesco Pierri

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments This paper has been submitted to IEEE Transactions on Artificial Intelligence for possible publication

2502.18652 2025-03-05 cs.AI cs.CY 89%

Independent Mobility GPT (IDM-GPT): A Self-Supervised Multi-Agent Large Language Model Framework for Customized Traffic Mobility Analysis Using Machine Learning Models

Fengze Yang, Xiaoyue Cathy Liu, Lingjiu Lu, Bingzhang Wang, Chenxi Dylan Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 24 pages, 4 figures, TRR accepted

2503.01672 2025-03-04 cs.CL cs.SI 89%

Automated Annotation of Evolving Corpora for Augmenting Longitudinal Network Data: A Framework Integrating Large Language Models and Expert Knowledge

Xiao Liu, Zirui Wu, Jiayi Li, Zhicheng Shao, Xun Pang, Yansong Feng

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Work in progress, presented at the 2025 Asian PolMeth Conference

2503.01045 2025-03-04 cs.CL 89%

Language-agnostic, automated assessment of listeners' speech recall using large language models

Björn Herrmann

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 37 pages, 5 figure, 1 table

2502.17487 2025-03-04 cs.AI cs.CY cs.HC 89%

User Intent to Use DeepSeek for Healthcare Purposes and their Trust in the Large Language Model: Multinational Survey Study

Avishek Choudhury, Yeganeh Shahsavar, Hamid Shamszare

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2406.14598 2025-03-04 cs.AI 89%

SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal

Tinghao Xie, Xiangyu Qi, Yi Zeng, Yangsibo Huang, Udari Madhushani Sehwag, Kaixuan Huang, Luxi He, Boyi Wei, Dacheng Li, Ying Sheng, Ruoxi Jia, Bo Li, Kai Li, Danqi Chen, Peter Henderson, Prateek Mittal

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Paper accepted to ICLR 2025

2503.00137 2025-03-04 cs.CL 89%

SCORE: Systematic COnsistency and Robustness Evaluation for Large Language Models

Grigor Nalbandyan, Rima Shahbazyan, Evelina Bakhturina

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2502.20196 2025-02-28 cs.CL 89%

ChineseEcomQA: A Scalable E-commerce Concept Evaluation Benchmark for Large Language Models

Haibin Chen, Kangtao Lv, Chengwei Hu, Yanshi Li, Yujin Yuan, Yancheng He, Xingyao Zhang, Langming Liu, Shilei Liu, Wenbo Su, Bo Zheng

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2402.13758 2025-02-28 cs.CL 89%

Factual consistency evaluation of summarization in the Era of large language models

Zheheng Luo, Qianqian Xie, Sophia Ananiadou

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments published on ESWA

2502.18817 2025-02-27 cs.CL 89%

Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models

Shuliang Liu, Xinze Li, Zhenghao Liu, Yukun Yan, Cheng Yang, Zheni Zeng, Zhiyuan Liu, Maosong Sun, Ge Yu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2502.18474 2025-02-27 cs.SE cs.AI 89%

A Contemporary Survey of Large Language Model Assisted Program Analysis

Jiayimei Wang, Tao Ni, Wei-Bin Lee, Qingchuan Zhao

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2502.18228 2025-02-26 cs.CL 89%

Debt Collection Negotiations with Large Language Models: An Evaluation System and Optimizing Decision Making with Multi-Agent

Xiaofeng Wang, Zhixin Zhang, Jinguang Zheng, Yiming Ai, Rui Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL

Comments 21 pages

2502.18138 2025-02-26 cs.SI cs.AI 89%

Large Language Model Driven Agents for Simulating Echo Chamber Formation

Chenhao Gu, Ling Luo, Zainab Razia Zaidi, Shanika Karunasekera

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2405.11874 2025-02-26 cs.CL 89%

xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation

Qingchen Yu, Zifan Zheng, Shichao Song, Zhiyu Li, Feiyu Xiong, Bo Tang, Ding Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by ICLR 2025

2502.17657 2025-02-26 stat.AP cs.AI 89%

StatLLM: A Dataset for Evaluating the Performance of Large Language Models in Statistical Analysis

Xinyi Song, Lina Lee, Kexin Xie, Xueying Liu, Xinwei Deng, Yili Hong

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 25 pages, 7 figures

2502.17000 2025-02-25 cs.CV cs.LG 89%

An Enhanced Large Language Model For Cross Modal Query Understanding System Using DL-KeyBERT Based CAZSSCL-MPGPT

Shreya Singh

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 26 pages, 7 figures

2502.16863 2025-02-25 cs.MA cs.LG cs.RO 89%

Leveraging Large Language Models for Effective and Explainable Multi-Agent Credit Assignment

Kartik Nagpal, Dayi Dong, Jean-Baptiste Bouvier, Negar Mehr

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 8 pages+Appendix, 6 Figures, AAMAS 2025

2501.15147 2025-02-25 cs.AI cs.HC 89%

A Causality-aware Paradigm for Evaluating Creativity of Multimodal Large Language Models

Zhongzhan Huang, Shanshan Zhong, Pan Zhou, Shanghua Gao, Marinka Zitnik, Liang Lin

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted by TPAMI. arXiv admin note: text overlap with arXiv:2312.02439

2502.15797 2025-02-25 cs.CR cs.AI 89%

OCCULT: Evaluating Large Language Models for Offensive Cyber Operation Capabilities

Michael Kouremetis, Marissa Dotter, Alex Byrne, Dan Martin, Ethan Michalak, Gianpaolo Russo, Michael Threet, Guido Zarrella

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 31 pages, 17 figures, 11 tables

2502.13564 2025-02-20 cs.CL 89%

PRIV-QA: Privacy-Preserving Question Answering for Cloud Large Language Models

Guangwei Li, Yuansen Zhang, Yinggui Wang, Shoumeng Yan, Lei Wang, Tao Wei

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2502.07068 2025-02-20 cs.CL 89%

Specializing Large Language Models to Simulate Survey Response Distributions for Global Populations

Yong Cao, Haijiang Liu, Arnav Arora, Isabelle Augenstein, Paul Röttger, Daniel Hershcovich

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments 15 pages, 9 figures, accepted to NAACL 2025 main

2501.09801 2025-02-20 cs.IR cs.CL 89%

Conversational Text Extraction with Large Language Models Using Retrieval-Augmented Systems

Soham Roy, Mitul Goswami, Nisharg Nargund, Suneeta Mohanty, Prasant Kumar Pattnaik

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Journal ref 2024 6th International Conference on Computational Intelligence and Networks (CINE)

2502.13396 2025-02-20 cs.CL 89%

Prompting a Weighting Mechanism into LLM-as-a-Judge in Two-Step: A Case Study

Wenwen Xie, Gray Gwizdz, Dongji Feng

专题命中评测与基准：LLM(title,abstract)；prompting(title)；large language model(abstract)；language model(abstract)

Comments 5 pages, 5 tables, 1 figure

2502.13059 2025-02-19 cs.CL 89%

SimpleVQA: Multimodal Factuality Evaluation for Multimodal Large Language Models

Xianfu Cheng, Wei Zhang, Shiwei Zhang, Jian Yang, Xiangyuan Guan, Xianjie Wu, Xiang Li, Ge Zhang, Jiaheng Liu, Yuying Mai, Yutao Zeng, Zhoufutu Wen, Ke Jin, Baorui Wang, Weixiao Zhou, Yunhong Lu, Tongliang Li, Wenhao Huang, Zhoujun Li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2502.09747 2025-02-19 cs.CL 89%

The Widespread Adoption of Large Language Model-Assisted Writing Across Society

Weixin Liang, Yaohui Zhang, Mihai Codreanu, Jiayu Wang, Hancheng Cao, James Zou

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

1. 评测与基准 32208 篇

Towards a Holistic Framework for Multimodal Large Language Models in Three-dimensional Brain CT Report Generation

Biological Sequence with Language Model Prompting: A Survey

Developing and Utilizing a Large-Scale Cantonese Dataset for Multi-Tasking in Large Language Models

Building Safe GenAI Applications: An End-to-End Overview of Red Teaming for Large Language Models

StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Models

Analyzing the Safety of Japanese Large Language Models in Stereotype-Triggering Prompts

Independent Mobility GPT (IDM-GPT): A Self-Supervised Multi-Agent Large Language Model Framework for Customized Traffic Mobility Analysis Using Machine Learning Models

Automated Annotation of Evolving Corpora for Augmenting Longitudinal Network Data: A Framework Integrating Large Language Models and Expert Knowledge

Language-agnostic, automated assessment of listeners' speech recall using large language models

User Intent to Use DeepSeek for Healthcare Purposes and their Trust in the Large Language Model: Multinational Survey Study

SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal

SCORE: Systematic COnsistency and Robustness Evaluation for Large Language Models

ChineseEcomQA: A Scalable E-commerce Concept Evaluation Benchmark for Large Language Models

Factual consistency evaluation of summarization in the Era of large language models

Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models

A Contemporary Survey of Large Language Model Assisted Program Analysis

Debt Collection Negotiations with Large Language Models: An Evaluation System and Optimizing Decision Making with Multi-Agent

Large Language Model Driven Agents for Simulating Echo Chamber Formation

xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation

StatLLM: A Dataset for Evaluating the Performance of Large Language Models in Statistical Analysis

An Enhanced Large Language Model For Cross Modal Query Understanding System Using DL-KeyBERT Based CAZSSCL-MPGPT

Leveraging Large Language Models for Effective and Explainable Multi-Agent Credit Assignment

A Causality-aware Paradigm for Evaluating Creativity of Multimodal Large Language Models

OCCULT: Evaluating Large Language Models for Offensive Cyber Operation Capabilities

PRIV-QA: Privacy-Preserving Question Answering for Cloud Large Language Models

Specializing Large Language Models to Simulate Survey Response Distributions for Global Populations

Conversational Text Extraction with Large Language Models Using Retrieval-Augmented Systems

Prompting a Weighting Mechanism into LLM-as-a-Judge in Two-Step: A Case Study

SimpleVQA: Multimodal Factuality Evaluation for Multimodal Large Language Models

The Widespread Adoption of Large Language Model-Assisted Writing Across Society