语言大模型 / LLM - arXivDaily 专题

2305.13091 2023-10-23 cs.CL 89%

Large Language Models are Not Yet Human-Level Evaluators for Abstractive Summarization

Chenhui Shen, Liying Cheng, Xuan-Phi Nguyen, Yang You, Lidong Bing

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 19 pages, 5 figures

Journal ref Findings of EMNLP 2023

2310.12321 2023-10-20 cs.CL 89%

A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4

Katikapalli Subramanyam Kalyan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments Preprint under review, 58 pages

2305.11171 2023-10-20 cs.CL 89%

TrueTeacher: Learning Factual Consistency Evaluation with Large Language Models

Zorik Gekhman, Jonathan Herzig, Roee Aharoni, Chen Elkind, Idan Szpektor

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted as a long paper in EMNLP 2023

2310.08167 2023-10-13 cs.CL 89%

Multiclass Classification of Policy Documents with Large Language Models

Erkan Gunes, Christoffer Koch Florczak

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2310.07289 2023-10-12 cs.CL 89%

Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge Generators

Liang Chen, Yang Deng, Yatao Bian, Zeyu Qin, Bingzhe Wu, Tat-Seng Chua, Kam-Fai Wong

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2023 main conference

2310.06762 2023-10-11 cs.CL 89%

TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models

Xiao Wang, Yuansen Zhang, Tianze Chen, Songyang Gao, Senjie Jin, Xianjun Yang, Zhiheng Xi, Rui Zheng, Yicheng Zou, Tao Gui, Qi Zhang, Xuanjing Huang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

2310.05863 2023-10-11 eess.AS cs.AI cs.CV cs.SD 89%

Fine-grained Audio-Visual Joint Representations for Multimodal Large Language Models

Guangzhi Sun, Wenyi Yu, Changli Tang, Xianzhao Chen, Tian Tan, Wei Li, Lu Lu, Zejun Ma, Chao Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2305.08377 2023-10-10 cs.CL 89%

Text Classification via Large Language Models

Xiaofei Sun, Xiaoya Li, Jiwei Li, Fei Wu, Shangwei Guo, Tianwei Zhang, Guoyin Wang

专题命中评测与基准：language model(title,abstract)；large language model(title)；LLM(abstract)；prompting(abstract)

Comments Pre-print Version

2310.03293 2023-10-06 cs.CL 89%

A New Dialogue Response Generation Agent for Large Language Models by Asking Questions to Detect User's Intentions

Siwei Wu, Xiangqing Shen, Rui Xia

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2310.03283 2023-10-06 cs.CL 89%

A Formalism and Approach for Improving Robustness of Large Language Models Using Risk-Adjusted Confidence Scores

Ke Shen, Mayank Kejriwal

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2309.15461 2023-09-28 cs.CL 89%

ChatCounselor: A Large Language Models for Mental Health Support

June M. Liu, Donghao Li, He Cao, Tianhe Ren, Zeyi Liao, Jiamin Wu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2309.10929 2023-09-21 cs.CL 89%

Specializing Small Language Models towards Complex Style Transfer via Latent Attribute Pre-Training

Ruiqi Xu, Yongfeng Huang, Xin Chen, Lin Zhang

专题命中评测与基准：language model(title,abstract)；small language model(title)；LLM(abstract)；large language model(abstract)

2309.10238 2023-09-20 cs.CL 89%

PolicyGPT: Automated Analysis of Privacy Policies with Large Language Models

Chenhao Tang, Zhengliang Liu, Chong Ma, Zihao Wu, Yiwei Li, Wei Liu, Dajiang Zhu, Quanzheng Li, Xiang Li, Tianming Liu, Lei Fan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2309.09338 2023-09-19 cs.CL 89%

Performance of the Pre-Trained Large Language Model GPT-4 on Automated Short Answer Grading

Gerd Kortemeyer

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2309.08949 2023-09-19 cs.CL 89%

Enhancing Large Language Model Induced Task-Oriented Dialogue Systems Through Look-Forward Motivated Goals

Zhiyuan Hu, Yue Feng, Yang Deng, Zekun Li, See-Kiong Ng, Anh Tuan Luu, Bryan Hooi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 7 Pages

2309.08922 2023-09-19 cs.CL 89%

Multimodal Multi-Hop Question Answering Through a Conversation Between Tools and Efficiently Finetuned Large Language Models

Hossein Rajabzadeh, Suyuchen Wang, Hyock Ju Kwon, Bang Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2308.16797 2023-09-11 cs.CL 89%

Simple LLM Prompting is State-of-the-Art for Robust and Multilingual Dialogue Evaluation

John Mendonça, Patrícia Pereira, Helena Moniz, João Paulo Carvalho, Alon Lavie, Isabel Trancoso

专题命中评测与基准：prompting(title,abstract)；LLM(title)；large language model(abstract)；language model(abstract)

Comments DSTC11 best paper for Track 4

2309.00029 2023-09-04 cs.AI cs.CY cs.SE 89%

Exploring the Potential of Large Language Models to Generate Formative Programming Feedback

Natalie Kiesler, Dominic Lohr, Hieke Keuning

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted to FIE 2023

2308.09662 2023-08-31 cs.CL 89%

Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment

Rishabh Bhardwaj, Soujanya Poria

专题命中评测与基准：language model(title,abstract)；large language model(title)；LLM(abstract)；prompting(abstract)

2308.06966 2023-08-29 cs.CL 89%

EcomGPT: Instruction-tuning Large Language Models with Chain-of-Task Tasks for E-commerce

Yangning Li, Shirong Ma, Xiaobin Wang, Shen Huang, Chengyue Jiang, Hai-Tao Zheng, Pengjun Xie, Fei Huang, Yong Jiang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Initial version of EcomGPT

2308.04026 2023-08-09 cs.AI 89%

AgentSims: An Open-Source Sandbox for Large Language Model Evaluation

Jiaju Lin, Haoran Zhao, Aochi Zhang, Yiting Wu, Huqiuyue Ping, Qin Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments submit to EMNLP2023 demo track

2308.03873 2023-08-09 cs.SE cs.LG 89%

Evaluating and Explaining Large Language Models for Code Using Syntactic Structures

David N Palacio, Alejandro Velasco, Daniel Rodriguez-Cardenas, Kevin Moran, Denys Poshyvanyk

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2307.16180 2023-08-01 cs.CL 89%

Do LLMs Possess a Personality? Making the MBTI Test an Amazing Evaluation for Large Language Models

Keyu Pan, Yawen Zeng

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2307.14225 2023-07-27 cs.IR cs.LG 89%

Large Language Models are Competitive Near Cold-start Recommenders for Language- and Item-based Preferences

Scott Sanner, Krisztian Balog, Filip Radlinski, Ben Wedin, Lucas Dixon

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.LG

Comments To appear at RecSys'23

2307.12966 2023-07-25 cs.CL 89%

Aligning Large Language Models with Human: A Survey

Yufei Wang, Wanjun Zhong, Liangyou Li, Fei Mi, Xingshan Zeng, Wenyong Huang, Lifeng Shang, Xin Jiang, Qun Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments work in progress

2307.12573 2023-07-25 cs.CL 89%

Tachikuma: Understading Complex Interactions with Multi-Character and Novel Objects by Large Language Models

Yuanzhi Liang, Linchao Zhu, Yi Yang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments Preliminary version of an ongoing work

2307.08974 2023-07-19 cs.AI cs.CY 89%

Development of the ChatGPT, Generative Artificial Intelligence and Natural Large Language Models for Accountable Reporting and Use (CANGARU) Guidelines

Giovanni E. Cacciamani, Michael B. Eppler, Conner Ganjavi, Asli Pekan, Brett Biedermann, Gary S. Collins, Inderbir S. Gill

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 20 pages, 1 figure, protocol

2302.14520 2023-06-02 cs.CL 89%

Large Language Models Are State-of-the-Art Evaluators of Translation Quality

Tom Kocmi, Christian Federmann

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments Accepted in EAMT, 10 pages, 8 tables, one figure

2305.17701 2023-05-31 cs.CL 89%

KoSBi: A Dataset for Mitigating Social Bias Risks Towards Safer Large Language Model Application

Hwaran Lee, Seokhee Hong, Joonsuk Park, Takyoung Kim, Gunhee Kim, Jung-Woo Ha

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 17 pages, 8 figures, 12 tables, ACL 2023

2305.18099 2023-05-30 cs.CL cs.CY 89%

Writing user personas with Large Language Models: Testing phase 6 of a Thematic Analysis of semi-structured interviews

Stefano De Paoli

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

1. 评测与基准 32096 篇

Large Language Models are Not Yet Human-Level Evaluators for Abstractive Summarization

A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4

TrueTeacher: Learning Factual Consistency Evaluation with Large Language Models

Multiclass Classification of Policy Documents with Large Language Models

Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge Generators

TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models

Fine-grained Audio-Visual Joint Representations for Multimodal Large Language Models

Text Classification via Large Language Models

A New Dialogue Response Generation Agent for Large Language Models by Asking Questions to Detect User's Intentions

A Formalism and Approach for Improving Robustness of Large Language Models Using Risk-Adjusted Confidence Scores

ChatCounselor: A Large Language Models for Mental Health Support

Specializing Small Language Models towards Complex Style Transfer via Latent Attribute Pre-Training

PolicyGPT: Automated Analysis of Privacy Policies with Large Language Models

Performance of the Pre-Trained Large Language Model GPT-4 on Automated Short Answer Grading

Enhancing Large Language Model Induced Task-Oriented Dialogue Systems Through Look-Forward Motivated Goals

Multimodal Multi-Hop Question Answering Through a Conversation Between Tools and Efficiently Finetuned Large Language Models

Simple LLM Prompting is State-of-the-Art for Robust and Multilingual Dialogue Evaluation

Exploring the Potential of Large Language Models to Generate Formative Programming Feedback

Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment

EcomGPT: Instruction-tuning Large Language Models with Chain-of-Task Tasks for E-commerce

AgentSims: An Open-Source Sandbox for Large Language Model Evaluation

Evaluating and Explaining Large Language Models for Code Using Syntactic Structures

Do LLMs Possess a Personality? Making the MBTI Test an Amazing Evaluation for Large Language Models

Large Language Models are Competitive Near Cold-start Recommenders for Language- and Item-based Preferences

Aligning Large Language Models with Human: A Survey

Tachikuma: Understading Complex Interactions with Multi-Character and Novel Objects by Large Language Models

Development of the ChatGPT, Generative Artificial Intelligence and Natural Large Language Models for Accountable Reporting and Use (CANGARU) Guidelines

Large Language Models Are State-of-the-Art Evaluators of Translation Quality

KoSBi: A Dataset for Mitigating Social Bias Risks Towards Safer Large Language Model Application

Writing user personas with Large Language Models: Testing phase 6 of a Thematic Analysis of semi-structured interviews