语言大模型 / LLM - arXivDaily 专题

2408.16423 2024-08-30 eess.AS cs.SD 87%

WHISMA: A Speech-LLM to Perform Zero-shot Spoken Language Understanding

Mohan Li, Cong-Thanh Do, Simon Keizer, Youmna Farag, Svetlana Stoyanchev, Rama Doddipatla

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；foundation model(abstract)

Comments accepted to SLT 2024

2406.07778 2024-08-23 cs.CR cs.AI cs.CL cs.LG 87%

A Study of Backdoors in Instruction Fine-tuned Language Models

Jayaram Raghuram, George Kesidis, David J. Miller

专题命中评测与基准：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Under review

2408.09043 2024-08-20 cs.LG cs.AI cs.CL 87%

Improving VTE Identification through Language Models from Radiology Reports: A Comparative Study of Mamba, Phi-3 Mini, and BERT

Jamie Deng, Yusen Wu, Yelena Yesha, Phuong Nguyen

专题命中评测与基准：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2408.07313 2024-08-15 cs.HC 87%

Exploring Large-Scale Language Models to Evaluate EEG-Based Multimodal Data for Mental Health

Yongquan Hu, Shuning Zhang, Ting Dang, Hong Jia, Flora D. Salim, Wen Hu, Aaron J. Quigley

专题命中评测与基准：language model(title,abstract)；LLM(abstract)；large language model(abstract)；prompting(abstract)

Comments 6 pages; UbiComp Companion '24, Companion of the 2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing, October 5--9, 2024}{Melbourne, VIC, Australia

2309.10254 2024-07-30 cs.CR cs.AI cs.CL cs.CY cs.LG 87%

LLM Platform Security: Applying a Systematic Evaluation Framework to OpenAI's ChatGPT Plugins

Umar Iqbal, Tadayoshi Kohno, Franziska Roesner

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments To appear in the proceedings of the 7th AAAI / ACM Conference on AI, Ethics, and Society (AIES), October 2024

2402.19379 2024-07-23 cs.CY cs.AI cs.CL cs.LG 87%

Wisdom of the Silicon Crowd: LLM Ensemble Prediction Capabilities Rival Human Crowd Accuracy

Philipp Schoenegger, Indre Tuminauskaite, Peter S. Park, Philip E. Tetlock

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 20 pages; 13 visualizations (nine figures, four tables)

2407.10793 2024-07-16 cs.CL cs.AI cs.LG 87%

GraphEval: A Knowledge-Graph Based LLM Hallucination Evaluation Framework

Hannah Sansford, Nicholas Richardson, Hermina Petric Maretic, Juba Nait Saada

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 12 pages, to be published at KiL'24: Workshop on Knowledge-infused Learning co-located with 30th ACM KDD Conference, August 26, 2024, Barcelona, Spain

2407.10627 2024-07-16 cs.CL cs.AI cs.LG 87%

Arena Learning: Build Data Flywheel for LLMs Post-training via Simulated Chatbot Arena

Haipeng Luo, Qingfeng Sun, Can Xu, Pu Zhao, Qingwei Lin, Jianguang Lou, Shifeng Chen, Yansong Tang, Weizhu Chen

专题命中评测与基准：post-training(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2406.18120 2024-07-16 cs.CL cs.AI cs.CY cs.LG 87%

ArzEn-LLM: Code-Switched Egyptian Arabic-English Translation and Speech Recognition Using LLMs

Ahmed Heakl, Youssef Zaghloul, Mennatullah Ali, Rania Hossam, Walid Gomaa

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 9 pages, 4 figures, 5 tables, 6th International Conference on AI in Computational Linguistics

2406.19578 2024-07-01 cs.CV cs.AI cs.CL cs.LG 87%

PathAlign: A vision-language model for whole slide images in histopathology

Faruk Ahmed, Andrew Sellergren, Lin Yang, Shawn Xu, Boris Babenko, Abbi Ward, Niels Olson, Arash Mohtashamian, Yossi Matias, Greg S. Corrado, Quang Duong, Dale R. Webster, Shravya Shetty, Daniel Golden, Yun Liu, David F. Steiner, Ellery Wulczyn

专题命中评测与基准：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 9 main pages and 19 pages of supplemental material; 3 main tables, 3 main figures and 11 supplemental tables, 7 supplemental figures

2310.02124 2024-05-28 cs.CL cs.AI cs.CY cs.LG cs.MA 87%

Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View

Jintian Zhang, Xin Xu, Ningyu Zhang, Ruibo Liu, Bryan Hooi, Shumin Deng

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ACL 2024 Main Conference. 64 pages (8 main), 70 figures, 37 tables. Blog: https://www.zjukg.org/project/MachineSoM

2405.05378 2024-05-10 cs.CL cs.AI cs.CY cs.HC cs.LG 87%

"They are uncultured": Unveiling Covert Harms and Social Threats in LLM Generated Conversations

Preetam Prabhu Srikar Dammu, Hayoung Jung, Anjali Singh, Monojit Choudhury, Tanushree Mitra

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2404.12010 2024-04-19 cs.CL cs.AI cs.LG 87%

ParaFusion: A Large-Scale LLM-Driven English Paraphrase Dataset Infused with High-Quality Lexical and Syntactic Diversity

Lasal Jayawardena, Prasan Yapa

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2402.09283 2024-03-28 cs.CL cs.AI cs.CY cs.LG 87%

Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey

Zhichen Dong, Zhanhui Zhou, Chao Yang, Jing Shao, Yu Qiao

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to NAACL 2024

2403.07920 2024-03-14 q-bio.BM cs.AI cs.CL cs.LG 87%

ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Training

Le Zhuo, Zewen Chi, Minghao Xu, Heyan Huang, Heqi Zheng, Conghui He, Xian-Ling Mao, Wentao Zhang

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments https://protllm.github.io/project/

2401.17268 2024-01-31 cs.CL cs.AI cs.LG 87%

Weaver: Foundation Models for Creative Writing

Tiannan Wang, Jiamin Chen, Qingrui Jia, Shuai Wang, Ruoyu Fang, Huilin Wang, Zhaowei Gao, Chunzhao Xie, Chuou Xu, Jihong Dai, Yibin Liu, Jialong Wu, Shengwei Ding, Long Li, Zhiwei Huang, Xinle Deng, Teng Yu, Gangan Ma, Han Xiao, Zixin Chen, Danjun Xiang, Yunxia Wang, Yuanyuan Zhu, Yi Xiao, Jing Wang, Yiru Wang, Siran Ding, Jiayang Huang, Jiayi Xu, Yilihamu Tayier, Zhenyu Hu, Yuan Gao, Chengfeng Zheng, Yueshu Ye, Yihang Li, Lei Wan, Xinyue Jiang, Yujie Wang, Siyu Cheng, Zhule Song, Xiangru Tang, Xiaohua Xu, Ningyu Zhang, Huajun Chen, Yuchen Eleanor Jiang, Wangchunshu Zhou

专题命中评测与基准：foundation model(title)；LLM(abstract)；large language model(abstract)；language model(abstract)

2308.09936 2023-12-19 cs.CV cs.AI cs.CL cs.LG 87%

BLIVA: A Simple Multimodal LLM for Better Handling of Text-Rich Visual Questions

Wenbo Hu, Yifan Xu, Yi Li, Weiyue Li, Zeyuan Chen, Zhuowen Tu

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at AAAI Conference on Artificial Intelligence (AAAI-24)

2312.02310 2023-12-06 cs.CV cs.AI cs.CL cs.LG 87%

VaQuitA: Enhancing Alignment in LLM-Assisted Video Understanding

Yizhou Wang, Ruiyi Zhang, Haoliang Wang, Uttaran Bhattacharya, Yun Fu, Gang Wu

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2309.02301 2023-11-27 cs.CV 87%

CIEM: Contrastive Instruction Evaluation Method for Better Instruction Tuning

Hongyu Hu, Jiyuan Zhang, Minyi Zhao, Zhenbang Sun

专题命中评测与基准：instruction tuning(title,abstract)；LLM(abstract)；large language model(abstract)；language model(abstract)

2302.04012 2023-10-24 cs.CR cs.AI cs.CL cs.LG cs.SE 87%

CodeLMSec Benchmark: Systematically Evaluating and Finding Security Vulnerabilities in Black-Box Code Language Models

Hossein Hajipour, Keno Hassler, Thorsten Holz, Lea Schönherr, Mario Fritz

专题命中评测与基准：language model(title,abstract)；large language model(abstract)；prompting(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 23 pages, 9 figures

2308.15126 2023-10-11 cs.LG cs.AI cs.CL cs.CV 87%

Evaluation and Analysis of Hallucination in Large Vision-Language Models

Junyang Wang, Yiyang Zhou, Guohai Xu, Pengcheng Shi, Chenlin Zhao, Haiyang Xu, Qinghao Ye, Ming Yan, Ji Zhang, Jihua Zhu, Jitao Sang, Haoyu Tang

专题命中评测与基准：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 11 pages, 5 figures

2309.15487 2023-09-28 cs.CV 87%

Tackling VQA with Pretrained Foundation Models without Further Training

Alvin De Jun Tan, Bingquan Shen

专题命中评测与基准：foundation model(title,abstract)；LLM(abstract)；large language model(abstract)；language model(abstract)

2306.16275 2023-06-29 cs.CL cs.AI cs.LG 87%

Leveraging GPT-4 for Food Effect Summarization to Enhance Product-Specific Guidance Development via Iterative Prompting

Yiwen Shi, Ping Ren, Jing Wang, Biao Han, Taha ValizadehAslani, Felix Agbavor, Yi Zhang, Meng Hu, Liang Zhao, Hualou Liang

专题命中评测与基准：prompting(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 22 pages, 6 figures

2210.01848 2023-01-30 cs.LG cs.AI cs.CL q-bio.NC stat.ML 87%

Explaining Patterns in Data with Language Models via Interpretable Autoprompting

Chandan Singh, John X. Morris, Jyoti Aneja, Alexander M. Rush, Jianfeng Gao

专题命中评测与基准：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments The two first authors contributed equally

2201.07207 2022-03-09 cs.LG cs.AI cs.CL cs.CV cs.RO 87%

Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents

Wenlong Huang, Pieter Abbeel, Deepak Pathak, Igor Mordatch

专题命中评测与基准：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Project website at https://huangwl18.github.io/language-planner

2111.01243 2021-11-03 cs.CL cs.AI cs.LG 87%

Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey

Bonan Min, Hayley Ross, Elior Sulem, Amir Pouran Ben Veyseh, Thien Huu Nguyen, Oscar Sainz, Eneko Agirre, Ilana Heinz, Dan Roth

专题命中评测与基准：language model(title,abstract)；large language model(abstract)；prompting(abstract)；分类 cs.CL、cs.AI、cs.LG

2601.13709 2026-01-21 cs.AI cs.CL cs.CY cs.HC cs.SI 87%

Hidden in Plain Text: Measuring LLM Deception Quality Against Human Baselines Using Social Deduction Games

隐藏在 plain 文本中：使用社会推断游戏测量 LLM 欺骗质量 against 人类基准

Christopher Kao, Vanshika Vats, James Davis

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

AI总结本文通过社会推断游戏测量 LLM 欺骗能力，发现 LLM 在欺骗人类时表现更优，但其欺骗质量低于人类。

Comments For associated dataset, see https://github.com/cocochief4/llm-mafia. Published in IEEE ICA 2025, waiting for IEEEXplore proceedings

2411.15594 2025-10-21 cs.CL cs.AI 87%

A Survey on LLM-as-a-Judge

Jiawei Gu, Xuhui Jiang, Zhichao Shi, Hexiang Tan, Xuehao Zhai, Chengjin Xu, Wei Li, Yinghan Shen, Shengjie Ma, Honghao Liu, Saizhuo Wang, Kun Zhang, Yuanzhuo Wang, Wen Gao, Lionel Ni, Jian Guo

机构 * IDEA Research, International Digital Economy Academy（IDEA研究机构，国际数字经济学院）； Sun Yat-sen University（孙中山大学）； DataArc Tech Ltd（DataArc技术有限公司）； Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所）； Department of Civil and Environmental Engineering, Imperial College London（伦敦帝国理工学院土木与环境工程系）； Gaoling School of Artificial Intelligence, Renmin University of China（中国人民大学硅谷人工智能学院）； The Hong Kong University of Science and Technology（香港科技大学）； The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））； Department of Computer Science and Technology, Peking University（北京大学计算机科学与技术系）

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Project Page: https://awesome-llm-as-a-judge.github.io/

2310.01432 2024-12-10 cs.CL cs.AI 87%

Split and Merge: Aligning Position Biases in LLM-based Evaluators

Zongjie Li, Chaozheng Wang, Pingchuan Ma, Daoyuan Wu, Shuai Wang, Cuiyun Gao, Yang Liu

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted by EMNLP 2024. Please cite the conference version of this paper, e.g., "Zongjie Li, Chaozheng Wang, Pingchuan Ma, Daoyuan Wu, Shuai Wang, Cuiyun Gao, and Yang Liu. 2024. Split and Merge: Aligning Position Biases in LLM-based Evaluators. (EMNLP 2024)"

2404.11457 2024-08-22 cs.IR cs.AI cs.CL 87%

Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Era

Sunhao Dai, Chen Xu, Shicheng Xu, Liang Pang, Zhenhua Dong, Jun Xu

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments KDD 2024 Tutorial&Survey; Tutorial Website: https://llm-ir-bias-fairness.github.io/

1. 评测与基准 32411 篇

WHISMA: A Speech-LLM to Perform Zero-shot Spoken Language Understanding

A Study of Backdoors in Instruction Fine-tuned Language Models

Improving VTE Identification through Language Models from Radiology Reports: A Comparative Study of Mamba, Phi-3 Mini, and BERT

Exploring Large-Scale Language Models to Evaluate EEG-Based Multimodal Data for Mental Health

LLM Platform Security: Applying a Systematic Evaluation Framework to OpenAI's ChatGPT Plugins

Wisdom of the Silicon Crowd: LLM Ensemble Prediction Capabilities Rival Human Crowd Accuracy

GraphEval: A Knowledge-Graph Based LLM Hallucination Evaluation Framework

Arena Learning: Build Data Flywheel for LLMs Post-training via Simulated Chatbot Arena

ArzEn-LLM: Code-Switched Egyptian Arabic-English Translation and Speech Recognition Using LLMs

PathAlign: A vision-language model for whole slide images in histopathology

Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View

"They are uncultured": Unveiling Covert Harms and Social Threats in LLM Generated Conversations

ParaFusion: A Large-Scale LLM-Driven English Paraphrase Dataset Infused with High-Quality Lexical and Syntactic Diversity

Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey

ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Training

Weaver: Foundation Models for Creative Writing

BLIVA: A Simple Multimodal LLM for Better Handling of Text-Rich Visual Questions

VaQuitA: Enhancing Alignment in LLM-Assisted Video Understanding

CIEM: Contrastive Instruction Evaluation Method for Better Instruction Tuning

CodeLMSec Benchmark: Systematically Evaluating and Finding Security Vulnerabilities in Black-Box Code Language Models

Evaluation and Analysis of Hallucination in Large Vision-Language Models

Tackling VQA with Pretrained Foundation Models without Further Training

Leveraging GPT-4 for Food Effect Summarization to Enhance Product-Specific Guidance Development via Iterative Prompting

Explaining Patterns in Data with Language Models via Interpretable Autoprompting

Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents

Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey

Hidden in Plain Text: Measuring LLM Deception Quality Against Human Baselines Using Social Deduction Games

A Survey on LLM-as-a-Judge

Split and Merge: Aligning Position Biases in LLM-based Evaluators

Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Era