语言大模型 / LLM - arXivDaily 专题

2411.08320 2024-11-14 cs.AI 89%

Responsible AI in Construction Safety: Systematic Evaluation of Large Language Models and Prompt Engineering

Farouq Sammour, Jia Xu, Xi Wang, Mo Hu, Zhenyu Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 29 pages, 5 figures

2411.08275 2024-11-14 cs.IR cs.CL 89%

A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look

Shivani Upadhyay, Ronak Pradeep, Nandan Thakur, Daniel Campos, Nick Craswell, Ian Soboroff, Hoa Trang Dang, Jimmy Lin

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2409.13704 2024-11-12 cs.CL cs.IR 89%

Entity Extraction from High-Level Corruption Schemes via Large Language Models

Panagiotis Koletsis, Panagiotis-Konstantinos Gemos, Christos Chronis, Iraklis Varlamis, Vasilis Efthymiou, Georgios Th. Papadopoulos

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2407.06004 2024-11-08 cs.CL 89%

Perceptions to Beliefs: Exploring Precursory Inferences for Theory of Mind in Large Language Models

Chani Jung, Dongkwan Kim, Jiho Jin, Jiseon Kim, Yeon Seonwoo, Yejin Choi, Alice Oh, Hyunwoo Kim

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2409.02795 2024-11-01 cs.CL 89%

Towards a Unified View of Preference Learning for Large Language Models: A Survey

Bofei Gao, Feifan Song, Yibo Miao, Zefan Cai, Zhe Yang, Liang Chen, Helan Hu, Runxin Xu, Qingxiu Dong, Ce Zheng, Shanghaoran Quan, Wen Xiao, Ge Zhang, Daoguang Zan, Keming Lu, Bowen Yu, Dayiheng Liu, Zeyu Cui, Jian Yang, Lei Sha, Houfeng Wang, Zhifang Sui, Peiyi Wang, Tianyu Liu, Baobao Chang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 23 pages, 6 figures

2312.17617 2024-11-01 cs.CL 89%

Large Language Models for Generative Information Extraction: A Survey

Derong Xu, Wei Chen, Wenjun Peng, Chao Zhang, Tong Xu, Xiangyu Zhao, Xian Wu, Yefeng Zheng, Yang Wang, Enhong Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments The article has been accepted by Frontiers of Computer Science (FCS), with the DOI: {10.1007/s11704-024-40555-y}. You can cite the FCS version

2406.14952 2024-10-29 cs.CL 89%

ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models

Haiquan Zhao, Lingyu Li, Shisong Chen, Shuqi Kong, Jiaan Wang, Kexin Huang, Tianle Gu, Yixu Wang, Wang Jian, Dandan Liang, Zhixu Li, Yan Teng, Yanghua Xiao, Yingchun Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments EMNLP 2024

2410.20848 2024-10-29 cs.NE cs.AI 89%

Deep Insights into Automated Optimization with Large Language Models and Evolutionary Algorithms

He Yu, Jing Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2410.19848 2024-10-29 cs.CV cs.CL 89%

Benchmarking Large Language Models for Image Classification of Marine Mammals

Yijiashun Qi, Shuzhang Cai, Zunduo Zhao, Jiaming Li, Yanbin Lin, Zhiqiang Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments ICKG 2024

2410.14660 2024-10-21 cs.LG 89%

A Large Language Model-Driven Reward Design Framework via Dynamic Feedback for Reinforcement Learning

Shengjie Sun, Runze Liu, Jiafei Lyu, Jing-Wen Yang, Liangpeng Zhang, Xiu Li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2306.15087 2024-10-21 cs.CL cs.CY 89%

WinoQueer: A Community-in-the-Loop Benchmark for Anti-LGBTQ+ Bias in Large Language Models

Virginia K. Felkner, Ho-Chun Herbert Chang, Eugene Jang, Jonathan May

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to ACL 2023 (main conference). This version corrects a bug found in evaluation code after publication. General findings have not changed, but tables 5 and 6 and figure 1 have been corrected

2410.13153 2024-10-18 cs.CL 89%

Better to Ask in English: Evaluation of Large Language Models on English, Low-resource and Cross-Lingual Settings

Krishno Dey, Prerona Tarannum, Md. Arid Hasan, Imran Razzak, Usman Naseem

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

2403.12675 2024-10-18 cs.CL 89%

Pragmatic Competence Evaluation of Large Language Models for the Korean Language

Dojun Park, Jiwoo Lee, Hyeyun Jeong, Seohyun Park, Sungeun Lee

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments 38th Pacific Asia Conference on Language, Information and Computation

2404.02806 2024-10-16 cs.SE cs.AI cs.HC 89%

The RealHumanEval: Evaluating Large Language Models' Abilities to Support Programmers

Hussein Mozannar, Valerie Chen, Mohammed Alsobay, Subhro Das, Sebastian Zhao, Dennis Wei, Manish Nagireddy, Prasanna Sattigeri, Ameet Talwalkar, David Sontag

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2410.06566 2024-10-10 cs.CL 89%

Detecting Bias and Enhancing Diagnostic Accuracy in Large Language Models for Healthcare

Pardis Sadat Zahraei, Zahra Shakeri

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2409.11365 2024-10-10 cs.CL 89%

CoCA: Regaining Safety-awareness of Multimodal Large Language Models with Constitutional Calibration

Jiahui Gao, Renjie Pi, Tianyang Han, Han Wu, Lanqing Hong, Lingpeng Kong, Xin Jiang, Zhenguo Li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 10 pages, COLM-2024

2408.07482 2024-10-10 cs.DC cs.AI 89%

Training Overhead Ratio: A Practical Reliability Metric for Large Language Model Training Systems

Ning Lu, Qian Xie, Hao Zhang, Wenyi Fang, Yang Zheng, Zheng Hu, Jiantao Ma

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments To be published in: IEEE International Symposium on Software Reliability Engineering (ISSRE2024) workshop

2405.12021 2024-10-10 cs.CL 89%

Can AI Relate: Testing Large Language Model Response for Mental Health Support

Saadia Gabriel, Isha Puri, Xuhai Xu, Matteo Malgaroli, Marzyeh Ghassemi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments EMNLP 2024 Findings

2402.06861 2024-10-08 cs.AI 89%

UrbanKGent: A Unified Large Language Model Agent Framework for Urban Knowledge Graph Construction

Yansong Ning, Hao Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments NeurIPS 2024

2410.03848 2024-10-08 cs.CL cs.CV 89%

Using Prompts to Guide Large Language Models in Imitating a Real Person's Language Style

Ziyang Chen, Stylios Moscholios

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

2410.03546 2024-10-07 cs.HC cs.CY cs.LG 89%

Multidimensional Human Activity Recognition With Large Language Model: A Conceptual Framework

Syed Mhamudul Hasan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2410.03181 2024-10-07 cs.CL 89%

Kiss up, Kick down: Exploring Behavioral Changes in Multi-modal Large Language Models with Assigned Visual Personas

Seungjong Sun, Eungu Lee, Seo Yeon Baek, Seunghyun Hwang, Wonbyung Lee, Dongyan Nan, Bernard J. Jansen, Jang Hyun Kim

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments EMNLP 2024

2304.03347 2024-10-03 cs.CL 89%

Towards Interpretable Mental Health Analysis with Large Language Models

Kailai Yang, Shaoxiong Ji, Tianlin Zhang, Qianqian Xie, Ziyan Kuang, Sophia Ananiadou

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments Accepted by EMNLP 2023 main conference as a long paper

2410.00526 2024-10-02 cs.CL 89%

Benchmarking Large Language Models for Conversational Question Answering in Multi-instructional Documents

Shiwei Wu, Chen Zhang, Yan Gao, Qimeng Wang, Tong Xu, Yao Hu, Enhong Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2403.17146 2024-10-02 cs.CL 89%

Outcome-Constrained Large Language Models for Countering Hate Speech

Lingzi Hong, Pengcheng Luo, Eduardo Blanco, Xiaoying Song

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted for presentation at the EMNLP 2024 main conference

2409.15186 2024-10-01 cs.AR cs.AI 89%

Location is Key: Leveraging Large Language Model for Functional Bug Localization in Verilog

Bingkun Yao, Ning Wang, Jie Zhou, Xi Wang, Hong Gao, Zhe Jiang, Nan Guan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2407.03937 2024-10-01 cs.CL 89%

TongGu: Mastering Classical Chinese Understanding with Knowledge-Grounded Large Language Models

Jiahuan Cao, Dezhi Peng, Peirong Zhang, Yongxin Shi, Yang Liu, Kai Ding, Lianwen Jin

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2403.09972 2024-09-30 cs.CL 89%

Think Twice Before Trusting: Self-Detection for Large Language Models through Comprehensive Answer Reflection

Moxin Li, Wenjie Wang, Fuli Feng, Fengbin Zhu, Qifan Wang, Tat-Seng Chua

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments EMNLP findings 2024

2409.16788 2024-09-26 cs.CL 89%

Mitigating the Bias of Large Language Model Evaluation

Hongli Zhou, Hui Huang, Yunfei Long, Bing Xu, Conghui Zhu, Hailong Cao, Muyun Yang, Tiejun Zhao

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2409.16191 2024-09-25 cs.CL 89%

HelloBench: Evaluating Long Text Generation Capabilities of Large Language Models

Haoran Que, Feiyu Duan, Liqun He, Yutao Mou, Wangchunshu Zhou, Jiaheng Liu, Wenge Rong, Zekun Moore Wang, Jian Yang, Ge Zhang, Junran Peng, Zhaoxiang Zhang, Songyang Zhang, Kai Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

1. 评测与基准 32207 篇

Responsible AI in Construction Safety: Systematic Evaluation of Large Language Models and Prompt Engineering

A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look

Entity Extraction from High-Level Corruption Schemes via Large Language Models

Perceptions to Beliefs: Exploring Precursory Inferences for Theory of Mind in Large Language Models

Towards a Unified View of Preference Learning for Large Language Models: A Survey

Large Language Models for Generative Information Extraction: A Survey

ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models

Deep Insights into Automated Optimization with Large Language Models and Evolutionary Algorithms

Benchmarking Large Language Models for Image Classification of Marine Mammals

A Large Language Model-Driven Reward Design Framework via Dynamic Feedback for Reinforcement Learning

WinoQueer: A Community-in-the-Loop Benchmark for Anti-LGBTQ+ Bias in Large Language Models

Better to Ask in English: Evaluation of Large Language Models on English, Low-resource and Cross-Lingual Settings

Pragmatic Competence Evaluation of Large Language Models for the Korean Language

The RealHumanEval: Evaluating Large Language Models' Abilities to Support Programmers

Detecting Bias and Enhancing Diagnostic Accuracy in Large Language Models for Healthcare

CoCA: Regaining Safety-awareness of Multimodal Large Language Models with Constitutional Calibration

Training Overhead Ratio: A Practical Reliability Metric for Large Language Model Training Systems

Can AI Relate: Testing Large Language Model Response for Mental Health Support

UrbanKGent: A Unified Large Language Model Agent Framework for Urban Knowledge Graph Construction

Using Prompts to Guide Large Language Models in Imitating a Real Person's Language Style

Multidimensional Human Activity Recognition With Large Language Model: A Conceptual Framework

Kiss up, Kick down: Exploring Behavioral Changes in Multi-modal Large Language Models with Assigned Visual Personas

Towards Interpretable Mental Health Analysis with Large Language Models

Benchmarking Large Language Models for Conversational Question Answering in Multi-instructional Documents

Outcome-Constrained Large Language Models for Countering Hate Speech

Location is Key: Leveraging Large Language Model for Functional Bug Localization in Verilog

TongGu: Mastering Classical Chinese Understanding with Knowledge-Grounded Large Language Models

Think Twice Before Trusting: Self-Detection for Large Language Models through Comprehensive Answer Reflection

Mitigating the Bias of Large Language Model Evaluation

HelloBench: Evaluating Long Text Generation Capabilities of Large Language Models