语言大模型 / LLM - arXivDaily 专题

2502.17924 2025-03-04 cs.CL 88%

FACT-AUDIT: An Adaptive Multi-Agent Framework for Dynamic Fact-Checking Evaluation of Large Language Models

Hongzhan Lin, Yang Deng, Yuxuan Gu, Wenxuan Zhang, Jing Ma, See-Kiong Ng, Tat-Seng Chua

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2502.20868 2025-03-03 cs.CL 88%

ProBench: Benchmarking Large Language Models in Competitive Programming

Lei Yang, Renren Jin, Ling Shi, Jianxiang Peng, Yue Chen, Deyi Xiong

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2502.14776 2025-02-28 cs.CL 88%

SurveyX: Academic Survey Automation via Large Language Models

Xun Liang, Jiawei Yang, Yezhaohui Wang, Chen Tang, Zifan Zheng, Shichao Song, Zehao Lin, Yebin Yang, Simin Niu, Hanyu Wang, Bo Tang, Feiyu Xiong, Keming Mao, Zhiyu li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 15 pages, 16 figures

2502.18511 2025-02-27 cs.CR cs.AI 88%

ELBA-Bench: An Efficient Learning Backdoor Attacks Benchmark for Large Language Models

Xuxu Liu, Siyuan Liang, Mengya Han, Yong Luo, Aishan Liu, Xiantao Cai, Zheng He, Dacheng Tao

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2502.17785 2025-02-26 cs.CL cs.HC 88%

Exploring the Potential of Large Language Models for Estimating the Reading Comprehension Question Difficulty

Yoshee Jain, John Hollander, Amber He, Sunny Tang, Liang Zhang, John Sabatini

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 13 pages, 2 figures

2502.16614 2025-02-25 cs.CL 88%

CodeCriticBench: A Holistic Code Critique Benchmark for Large Language Models

Alexander Zhang, Marcus Dong, Jiaheng Liu, Wei Zhang, Yejie Wang, Jian Yang, Ge Zhang, Tianyu Liu, Zhongyuan Peng, Yingshui Tan, Yuanxing Zhang, Zhexu Wang, Weixun Wang, Yancheng He, Ken Deng, Wangchunshu Zhou, Wenhao Huang, Zhaoxiang Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2502.16491 2025-02-25 cs.CL 88%

Intrinsic Model Weaknesses: How Priming Attacks Unveil Vulnerabilities in Large Language Models

Yuyi Huang, Runzhe Zhan, Derek F. Wong, Lidia S. Chao, Ailin Tao

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2501.18636 2025-02-25 cs.CR cs.AI cs.IR 88%

SafeRAG: Benchmarking Security in Retrieval-Augmented Generation of Large Language Model

Xun Liang, Simin Niu, Zhiyu Li, Sensen Zhang, Hanyu Wang, Feiyu Xiong, Jason Zhaoxin Fan, Bo Tang, Shichao Song, Mengwei Wang, Jiawei Yang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2409.12558 2025-02-25 cs.CL 88%

RAD-Bench: Evaluating Large Language Models Capabilities in Retrieval Augmented Dialogues

Tzu-Lin Kuo, Feng-Ting Liao, Mu-Wei Hsieh, Fu-Chieh Chang, Po-Chun Hsu, Da-Shan Shiu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2501.14649 2025-02-24 cs.CL 88%

Investigating the (De)Composition Capabilities of Large Language Models in Natural-to-Formal Language Conversion

Ziyao Xu, Houfeng Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted at NAACL 2025 main conference

2501.13773 2025-02-24 cs.CL 88%

Do Large Language Models Truly Understand Geometric Structures?

Xiaofeng Wang, Yiming Wang, Wenhong Zhu, Rui Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted to ICLR 2025

2410.09453 2025-02-24 cs.AI cs.CV 88%

MMAD: A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detection

Xi Jiang, Jian Li, Hanqiu Deng, Yong Liu, Bin-Bin Gao, Yifeng Zhou, Jialin Li, Chengjie Wang, Feng Zheng

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments Accepted by ICLR 2025. The code and data are available at https://github.com/jam-cc/MMAD

2409.15766 2025-02-24 cs.CL 88%

CHBench: A Chinese Dataset for Evaluating Health in Large Language Models

Chenlu Guo, Nuo Xu, Yi Chang, Yuan Wu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 11 pages

2405.02357 2025-02-24 cs.LG 88%

Large Language Models for Mobility Analysis in Transportation Systems: A Survey on Forecasting Tasks

Zijian Zhang, Yujie Sun, Zepu Wang, Yuqi Nie, Xiaobo Ma, Ruolin Li, Peng Sun, Xuegang Ban

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments 27 pages, presented in 2025 TRB meeting

2404.04990 2025-02-20 cs.CL 88%

MLaKE: Multilingual Knowledge Editing Benchmark for Large Language Models

Zihao Wei, Jingcheng Deng, Liang Pang, Hanxing Ding, Huawei Shen, Xueqi Cheng

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted as a full paper at COLING 2025

2502.13117 2025-02-19 stat.AP cs.AI 88%

Performance Evaluation of Large Language Models in Statistical Programming

Xinyi Song, Kexin Xie, Lina Lee, Ruizhe Chen, Jared M. Clark, Hao He, Haoran He, Jie Min, Xinlei Zhang, Simin Zheng, Zhiyang Zhang, Xinwei Deng, Yili Hong

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 27 pages, 8 figures

2502.11861 2025-02-18 cs.CL 88%

Exploring Large Language Models in Healthcare: Insights into Corpora Sources, Customization Strategies, and Evaluation Metrics

Shuqi Yang, Mingrui Jing, Shuai Wang, Jiaxin Kou, Manfei Shi, Weijie Xing, Yan Hu, Zheng Zhu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 45 pages, 1 figure, 5 tables

2502.11266 2025-02-18 cs.CL 88%

The Shrinking Landscape of Linguistic Diversity in the Age of Large Language Models

Zhivar Sourati, Farzan Karimi-Malekabadi, Meltem Ozcan, Colin McDaniel, Alireza Ziabari, Jackson Trager, Ala Tak, Meng Chen, Fred Morstatter, Morteza Dehghani

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments arXiv admin note: text overlap with arXiv:2404.00267

2406.01882 2025-02-18 cs.CR cs.AI cs.ET cs.SE 88%

HoneyGPT: Breaking the Trilemma in Terminal Honeypots with Large Language Model

Ziyang Wang, Jianzhou You, Haining Wang, Tianwei Yuan, Shichao Lv, Yang Wang, Limin Sun

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2502.09994 2025-02-17 cs.AI 88%

Decision Information Meets Large Language Models: The Future of Explainable Operations Research

Yansen Zhang, Qingcan Kang, Wing Yin Yu, Hailei Gong, Xiaojin Fu, Xiongwei Han, Tao Zhong, Chen Ma

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2409.02375 2025-02-17 cs.CL 88%

How Privacy-Savvy Are Large Language Models? A Case Study on Compliance and Privacy Technical Review

Yang Liu, Xichou Zhu, Zhou Shen, Yi Liu, Min Li, Yujun Chen, Benzi John, Zhenzhen Ma, Tao Hu, Zhi Li, Bolong Yang, Manman Wang, Zongxing Xie, Peng Liu, Dan Cai, Junhui Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 8 pages, 4 figures

2409.01980 2025-02-17 cs.LG 88%

Large Language Models for Anomaly and Out-of-Distribution Detection: A Survey

Ruiyao Xu, Kaize Ding

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments Accepted to NAACL 2025 Findings

2502.08687 2025-02-14 cs.CL 88%

Data Augmentation to Improve Large Language Models in Food Hazard and Product Detection

Areeg Fahad Rasheed, M. Zarkoosh, Shimam Amer Chasib, Safa F. Abbas

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2412.05506 2025-02-11 stat.ML cs.LG stat.ME 88%

Confidence Diagram of Nonparametric Ranking for Uncertainty Assessment in Large Language Models Evaluation

Zebin Wang, Yi Han, Ethan X. Fang, Lan Wang, Junwei Lu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2502.05224 2025-02-11 cs.CR cs.AI 88%

A Survey on Backdoor Threats in Large Language Models (LLMs): Attacks, Defenses, and Evaluations

Yihe Zhou, Tao Ni, Wei-Bin Lee, Qingchuan Zhao

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2502.04378 2025-02-10 cs.CV cs.GR cs.LG cs.SE 88%

DILLEMA: Diffusion and Large Language Models for Multi-Modal Augmentation

Luciano Baresi, Davide Yi Xian Hu, Muhammad Irfan Mas'udi, Giovanni Quattrocchi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2406.11678 2025-02-07 cs.IR cs.CL 88%

TourRank: Utilizing Large Language Models for Documents Ranking with a Tournament-Inspired Strategy

Yiqun Chen, Qi Liu, Yi Zhang, Weiwei Sun, Xinyu Ma, Wei Yang, Daiting Shi, Jiaxin Mao, Dawei Yin

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2502.00855 2025-02-04 cs.AI 88%

Psychometric-Based Evaluation for Theorem Proving with Large Language Models

Jianyu Zhang, Yongwang Zhao, Long Zhang, Jilin Hu, Xiaokun Luan, Zhiwei Xu, Feng Yang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2502.00826 2025-02-04 cs.CL 88%

Weak Supervision Dynamic KL-Weighted Diffusion Models Guided by Large Language Models

Julian Perry, Frank Sanders, Carter Scott

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2501.18845 2025-02-03 cs.CL 88%

Text Data Augmentation for Large Language Models: A Comprehensive Survey of Methods, Challenges, and Opportunities

Yaping Chai, Haoran Xie, Joe S. Qin

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 20 pages, 4 figures, 4 tables

1. 评测与基准 32208 篇

FACT-AUDIT: An Adaptive Multi-Agent Framework for Dynamic Fact-Checking Evaluation of Large Language Models

ProBench: Benchmarking Large Language Models in Competitive Programming

SurveyX: Academic Survey Automation via Large Language Models

ELBA-Bench: An Efficient Learning Backdoor Attacks Benchmark for Large Language Models

Exploring the Potential of Large Language Models for Estimating the Reading Comprehension Question Difficulty

CodeCriticBench: A Holistic Code Critique Benchmark for Large Language Models

Intrinsic Model Weaknesses: How Priming Attacks Unveil Vulnerabilities in Large Language Models

SafeRAG: Benchmarking Security in Retrieval-Augmented Generation of Large Language Model

RAD-Bench: Evaluating Large Language Models Capabilities in Retrieval Augmented Dialogues

Investigating the (De)Composition Capabilities of Large Language Models in Natural-to-Formal Language Conversion

Do Large Language Models Truly Understand Geometric Structures?

MMAD: A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detection

CHBench: A Chinese Dataset for Evaluating Health in Large Language Models

Large Language Models for Mobility Analysis in Transportation Systems: A Survey on Forecasting Tasks

MLaKE: Multilingual Knowledge Editing Benchmark for Large Language Models

Performance Evaluation of Large Language Models in Statistical Programming

Exploring Large Language Models in Healthcare: Insights into Corpora Sources, Customization Strategies, and Evaluation Metrics

The Shrinking Landscape of Linguistic Diversity in the Age of Large Language Models

HoneyGPT: Breaking the Trilemma in Terminal Honeypots with Large Language Model

Decision Information Meets Large Language Models: The Future of Explainable Operations Research

How Privacy-Savvy Are Large Language Models? A Case Study on Compliance and Privacy Technical Review

Large Language Models for Anomaly and Out-of-Distribution Detection: A Survey

Data Augmentation to Improve Large Language Models in Food Hazard and Product Detection

Confidence Diagram of Nonparametric Ranking for Uncertainty Assessment in Large Language Models Evaluation

A Survey on Backdoor Threats in Large Language Models (LLMs): Attacks, Defenses, and Evaluations

DILLEMA: Diffusion and Large Language Models for Multi-Modal Augmentation

TourRank: Utilizing Large Language Models for Documents Ranking with a Tournament-Inspired Strategy

Psychometric-Based Evaluation for Theorem Proving with Large Language Models

Weak Supervision Dynamic KL-Weighted Diffusion Models Guided by Large Language Models

Text Data Augmentation for Large Language Models: A Comprehensive Survey of Methods, Challenges, and Opportunities