语言大模型 / LLM - arXivDaily 专题

2404.15639 2024-12-31 cs.CL 89%

CodeIP: A Grammar-Guided Multi-Bit Watermark for Large Language Models of Code

Batu Guan, Yao Wan, Zhangqian Bi, Zheng Wang, Hongyu Zhang, Pan Zhou, Lichao Sun

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 16 pages, 13 figures

2412.18727 2024-12-30 cs.SE cs.AI cs.SY eess.SY 89%

SAFLITE: Fuzzing Autonomous Systems via Large Language Models

Taohong Zhu, Adrians Skapars, Fardeen Mackenzie, Declan Kehoe, William Newton, Suzanne Embury, Youcheng Sun

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2412.18443 2024-12-25 cs.CL 89%

Is Large Language Model Good at Triple Set Prediction? An Empirical Study

Yuan Yuan, Yajing Xu, Wen Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2412.17011 2024-12-24 cs.CL 89%

Robustness of Large Language Models Against Adversarial Attacks

Yiyi Tao, Yixian Shen, Hang Zhang, Yanxin Shen, Lun Wang, Chuanqi Shi, Shaoshuai Du

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2409.07790 2024-12-24 cs.CL eess.AS 89%

Full-text Error Correction for Chinese Speech Recognition with Large Language Model

Zhiyuan Tang, Dong Wang, Shen Huang, Shidong Shang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments ICASSP 2025

2412.15352 2024-12-23 cs.LG cs.CC 89%

Large Language Models on Small Resource-Constrained Systems: Performance Characterization, Analysis and Trade-offs

Liam Seymour, Basar Kutukcu, Sabur Baidya

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2412.11851 2024-12-17 cs.CL cs.MM 89%

A Benchmark and Robustness Study of In-Context-Learning with Large Language Models in Music Entity Detection

Simon Hachmeier, Robert Jäschke

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2412.11068 2024-12-17 cs.IR cs.AI 89%

RecSys Arena: Pair-wise Recommender System Evaluation with Large Language Models

Zhuo Wu, Qinglin Jia, Chuhan Wu, Zhaocheng Du, Shuai Wang, Zan Wang, Zhenhua Dong

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2407.07086 2024-12-13 cs.AI 89%

Hypothetical Minds: Scaffolding Theory of Mind for Multi-Agent Tasks with Large Language Models

Logan Cross, Violet Xiang, Agam Bhatia, Daniel LK Yamins, Nick Haber

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2308.04748 2024-12-11 cs.SE cs.LG 89%

Fuzz4All: Universal Fuzzing with Large Language Models

Chunqiu Steven Xia, Matteo Paltenghi, Jia Le Tian, Michael Pradel, Lingming Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments Accepted at ICSE 2024

Journal ref ICSE 2024: Proceedings of the IEEE/ACM 46th International Conference on Software Engineering

2306.07951 2024-12-10 cs.CL 89%

Questioning the Survey Responses of Large Language Models

Ricardo Dominguez-Olmedo, Moritz Hardt, Celestine Mendler-Dünner

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments NeurIPS 2024

2406.14955 2024-12-10 cs.CL 89%

ICLEval: Evaluating In-Context Learning Ability of Large Language Models

Wentong Chen, Yankai Lin, ZhenHao Zhou, HongYun Huang, Yantao Jia, Zhao Cao, Ji-Rong Wen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

2412.04485 2024-12-09 cs.AR cs.AI 89%

EDA-Aware RTL Generation with Large Language Models

Mubashir ul Islam, Humza Sami, Pierre-Emmanuel Gaillardon, Valerio Tenace

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2409.04475 2024-12-09 cs.DB cs.AI 89%

Revolutionizing Database Q&A with Large Language Models: Comprehensive Benchmark and Evaluation

Yihang Zheng, Bo Li, Zhenghao Lin, Yi Luo, Xuanhe Zhou, Chen Lin, Jinsong Su, Guoliang Li, Shifu Li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 12 pages

2310.03128 2024-12-06 cs.SE cs.CL 89%

MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use

Yue Huang, Jiawen Shi, Yuan Li, Chenrui Fan, Siyuan Wu, Qihui Zhang, Yixin Liu, Pan Zhou, Yao Wan, Neil Zhenqiang Gong, Lichao Sun

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2412.03563 2024-12-05 cs.CL cs.CY 89%

From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agents

Xinyi Mou, Xuanwen Ding, Qi He, Liang Wang, Jingcong Liang, Xinnong Zhang, Libo Sun, Jiayu Lin, Jie Zhou, Xuanjing Huang, Zhongyu Wei

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2412.03220 2024-12-05 cs.LG 89%

Survey of different Large Language Model Architectures: Trends, Benchmarks, and Challenges

Minghao Shao, Abdul Basit, Ramesh Karri, Muhammad Shafique

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2412.03075 2024-12-05 cs.CL cs.SD eess.AS 89%

ASR-EC Benchmark: Evaluating Large Language Models on Chinese ASR Error Correction

Victor Junqiu Wei, Weicheng Wang, Di Jiang, Yuanfeng Song, Lu Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

2412.02915 2024-12-05 cs.CL q-bio.GN 89%

Single-Cell Omics Arena: A Benchmark Study for Large Language Models on Cell Type Annotation Using Single-Cell Data

Junhao Liu, Siwei Xu, Lei Zhang, Jing Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

2402.13446 2024-12-04 cs.CL 89%

Large Language Models for Data Annotation and Synthesis: A Survey

Zhen Tan, Dawei Li, Song Wang, Alimohammad Beigi, Bohan Jiang, Amrita Bhattacharjee, Mansooreh Karami, Jundong Li, Lu Cheng, Huan Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2024 Main

2411.19203 2024-12-02 cs.CL 89%

An Extensive Evaluation of Factual Consistency in Large Language Models for Data-to-Text Generation

Joy Mahapatra, Utpal Garain

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 15 pages

2408.06752 2024-12-02 cs.DL cs.AI 89%

Evaluating Research Quality with Large Language Models: An Analysis of ChatGPT's Effectiveness with Different Settings and Inputs

Mike Thelwall

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2403.03230 2024-12-02 q-bio.NC cs.AI 89%

Large language models surpass human experts in predicting neuroscience results

Xiaoliang Luo, Akilles Rechardt, Guangzhi Sun, Kevin K. Nejad, Felipe Yáñez, Bati Yilmaz, Kangjoo Lee, Alexandra O. Cohen, Valentina Borghesani, Anton Pashkov, Daniele Marinazzo, Jonathan Nicholas, Alessandro Salatiello, Ilia Sucholutsky, Pasquale Minervini, Sepehr Razavi, Roberta Rocca, Elkhan Yusifov, Tereza Okalova, Nianlong Gu, Martin Ferianc, Mikail Khona, Kaustubh R. Patil, Pui-Shee Lee, Rui Mata, Nicholas E. Myers, Jennifer K Bizley, Sebastian Musslick, Isil Poyraz Bilgin, Guiomar Niso, Justin M. Ales, Michael Gaebler, N Apurva Ratan Murty, Leyla Loued-Khenissi, Anna Behler, Chloe M. Hall, Jessica Dafflon, Sherry Dongqi Bao, Bradley C. Love

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments The latest version of this paper has been published at Nature Human Behaviour, please see https://www.nature.com/articles/s41562-024-02046-9

2409.20288 2024-11-27 cs.CL 89%

LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Models

Haitao Li, You Chen, Qingyao Ai, Yueyue Wu, Ruizhe Zhang, Yiqun Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments NeurIPs 2024

2409.17011 2024-11-26 cs.CL cs.DL 89%

AutoLLM-CARD: Towards a Description and Landscape of Large Language Models

Shengwei Tian, Lifeng Han, Goran Nenadic

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments ongoing work, technical report

2411.13802 2024-11-25 cs.CL 89%

SemiKong: Curating, Training, and Evaluating A Semiconductor Industry-Specific Large Language Model

Christopher Nguyen, William Nguyen, Atsushi Suzuki, Daisuke Oku, Hong An Phan, Sang Dinh, Zooey Nguyen, Anh Ha, Shruti Raghavan, Huy Vo, Thang Nguyen, Lan Nguyen, Yoshikuni Hirayama

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments On-going work

2311.05232 2024-11-20 cs.CL 89%

A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions

Lei Huang, Weijiang Yu, Weitao Ma, Weihong Zhong, Zhangyin Feng, Haotian Wang, Qianglong Chen, Weihua Peng, Xiaocheng Feng, Bing Qin, Ting Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by ACM Transactions on Information Systems (TOIS)

2411.09826 2024-11-18 cs.CL 89%

Evaluating Gender Bias in Large Language Models

Michael Döll, Markus Döhring, Andreas Müller

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments 13 pages, 12 figures, 1 table

2411.09772 2024-11-18 cs.CR cs.LG 89%

Beyond Static Tools: Evaluating Large Language Models for Cryptographic Misuse Detection

Zohaib Masood, Miguel Vargas Martin

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2404.07940 2024-11-15 cs.SE cs.LG 89%

InfiBench: Evaluating the Question-Answering Capabilities of Code Large Language Models

Linyi Li, Shijie Geng, Zhenwen Li, Yibo He, Hao Yu, Ziyue Hua, Guanghan Ning, Siwei Wang, Tao Xie, Hongxia Yang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 31 pages. Appear at NeurIPS 2024 Datasets and Benchmarks track. Project website: https://infi-coder.github.io/infibench

1. 评测与基准 32208 篇

CodeIP: A Grammar-Guided Multi-Bit Watermark for Large Language Models of Code

SAFLITE: Fuzzing Autonomous Systems via Large Language Models

Is Large Language Model Good at Triple Set Prediction? An Empirical Study

Robustness of Large Language Models Against Adversarial Attacks

Full-text Error Correction for Chinese Speech Recognition with Large Language Model

Large Language Models on Small Resource-Constrained Systems: Performance Characterization, Analysis and Trade-offs

A Benchmark and Robustness Study of In-Context-Learning with Large Language Models in Music Entity Detection

RecSys Arena: Pair-wise Recommender System Evaluation with Large Language Models

Hypothetical Minds: Scaffolding Theory of Mind for Multi-Agent Tasks with Large Language Models

Fuzz4All: Universal Fuzzing with Large Language Models

Questioning the Survey Responses of Large Language Models

ICLEval: Evaluating In-Context Learning Ability of Large Language Models

EDA-Aware RTL Generation with Large Language Models

Revolutionizing Database Q&A with Large Language Models: Comprehensive Benchmark and Evaluation

MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use

From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agents

Survey of different Large Language Model Architectures: Trends, Benchmarks, and Challenges

ASR-EC Benchmark: Evaluating Large Language Models on Chinese ASR Error Correction

Single-Cell Omics Arena: A Benchmark Study for Large Language Models on Cell Type Annotation Using Single-Cell Data

Large Language Models for Data Annotation and Synthesis: A Survey

An Extensive Evaluation of Factual Consistency in Large Language Models for Data-to-Text Generation

Evaluating Research Quality with Large Language Models: An Analysis of ChatGPT's Effectiveness with Different Settings and Inputs

Large language models surpass human experts in predicting neuroscience results

LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Models

AutoLLM-CARD: Towards a Description and Landscape of Large Language Models

SemiKong: Curating, Training, and Evaluating A Semiconductor Industry-Specific Large Language Model

A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions

Evaluating Gender Bias in Large Language Models

Beyond Static Tools: Evaluating Large Language Models for Cryptographic Misuse Detection

InfiBench: Evaluating the Question-Answering Capabilities of Code Large Language Models