语言大模型 / LLM - arXivDaily 专题

2402.11493 2024-05-30 cs.CL 88%

Benchmarking Knowledge Boundary for Large Language Models: A Different Perspective on Model Evaluation

Xunjian Yin, Xu Zhang, Jie Ruan, Xiaojun Wan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted as the main paper of ACL 2024

2405.16933 2024-05-28 cs.CL cs.IR 88%

Empowering Large Language Models to Set up a Knowledge Retrieval Indexer via Self-Learning

Xun Liang, Simin Niu, Zhiyu li, Sensen Zhang, Shichao Song, Hanyu Wang, Jiawei Yang, Feiyu Xiong, Bo Tang, Chenyang Xi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2404.00675 2024-05-28 cs.CV cs.AI 88%

LLM meets Vision-Language Models for Zero-Shot One-Class Classification

Yassir Bendou, Giulia Lioi, Bastien Pasdeloup, Lukas Mauch, Ghouthi Boukli Hacene, Fabien Cardinaux, Vincent Gripon

专题命中评测与基准：language model(title,abstract)；LLM(title)；large language model(abstract)；分类 cs.AI

2310.05204 2024-05-28 cs.LG 88%

Towards Optimizing with Large Language Models

Pei-Fu Guo, Ying-Hsuan Chen, Yun-Da Tsai, Shou-De Lin

专题命中评测与基准：large language model(title)；language model(title)；LLM(abstract)；prompting(abstract)

2405.16284 2024-05-28 cs.CL cs.IR 88%

Generating clickbait spoilers with an ensemble of large language models

Mateusz Woźny, Mateusz Lango

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2403.17540 2024-05-28 cs.CL 88%

Large Language Models Are State-of-the-Art Evaluator for Grammatical Error Correction

Masamune Kobayashi, Masato Mita, Mamoru Komachi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted to BEA workshop at NAACL 2024

2308.10410 2024-05-24 cs.CL 88%

Large Language Models on Wikipedia-Style Survey Generation: an Evaluation in NLP Concepts

Fan Gao, Hang Jiang, Rui Yang, Qingcheng Zeng, Jinghui Lu, Moritz Blum, Dairui Liu, Tianwei She, Yuang Jiang, Irene Li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Journal ref ACL 2024 Findings

2405.12264 2024-05-22 cs.LG math.CT math.MG 88%

Directed Metric Structures arising in Large Language Models

Stéphane Gaubert, Yiannis Vlassopoulos

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2404.07720 2024-05-22 cs.CL 88%

Automatic Generation and Evaluation of Reading Comprehension Test Items with Large Language Models

Andreas Säuberli, Simon Clematide

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted for publication at the 3rd Workshop on Tools and Resources for People with REAding DIfficulties (READI) at LREC-COLING 2024; correction after publication: swapped "guessing setting" and "comprehension setting" in Section 4.5

2311.05812 2024-05-22 cs.CL 88%

CFBenchmark: Chinese Financial Assistant Benchmark for Large Language Model

Yang Lei, Jiangtong Li, Dawei Cheng, Zhijun Ding, Changjun Jiang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 12 pages, 4 figures

2404.11835 2024-05-21 cs.AI 88%

CAUS: A Dataset for Question Generation based on Human Cognition Leveraging Large Language Models

Minjung Shin, Donghyun Kim, Jeh-Kwang Ryu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 8 pages, 4 figures and 3 tables. This work has been accepted for presentation as a poster with full paper publication at CogSci 2024. This is the final submission

2405.10579 2024-05-20 cs.CL 88%

A Hard Nut to Crack: Idiom Detection with Conversational Large Language Models

Francesca De Luca Fornaciari, Begoña Altuna, Itziar Gonzalez-Dios, Maite Melero

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2405.10251 2024-05-17 cs.CL 88%

A Systematic Evaluation of Large Language Models for Natural Language Generation Tasks

Xuanfan Ni, Piji Li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments CCL2023

2405.09318 2024-05-16 cs.CR cs.LG 88%

Transfer Learning in Pre-Trained Large Language Models for Malware Detection Based on System Calls

Pedro Miguel Sánchez Sánchez, Alberto Huertas Celdrán, Gérôme Bovet, Gregorio Martínez Pérez

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments Submitted to IEEE MILCOM 2024

2405.08400 2024-05-15 cs.CL 88%

Stylometric Watermarks for Large Language Models

Georg Niess, Roman Kern

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 19 pages, 4 figures, 9 tables

2405.08317 2024-05-15 cs.CL cs.SD eess.AS 88%

SpeechGuard: Exploring the Adversarial Robustness of Multimodal Large Language Models

Raghuveer Peri, Sai Muralidhar Jayanthi, Srikanth Ronanki, Anshu Bhatia, Karel Mundnich, Saket Dingliwal, Nilaksh Das, Zejiang Hou, Goeric Huybrechts, Srikanth Vishnubhotla, Daniel Garcia-Romero, Sundararajan Srinivasan, Kyu J Han, Katrin Kirchhoff

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 9+6 pages, Submitted to ACL 2024

2401.12554 2024-05-15 cs.DC cs.AI 88%

Can Large Language Models Write Parallel Code?

Daniel Nichols, Joshua H. Davis, Zhaojun Xie, Arjun Rajaram, Abhinav Bhatele

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Journal ref The 33rd International Symposium on High-Performance Parallel and Distributed Computing (HPDC '24), June 3-7, 2024, Pisa, Italy. ACM, New York, NY, USA, 14 pages

2306.17281 2024-05-15 cs.DC cs.AI 88%

HPC-Coder: Modeling Parallel Programs using Large Language Models

Daniel Nichols, Aniruddha Marathe, Harshitha Menon, Todd Gamblin, Abhinav Bhatele

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Journal ref ISC High Performance 2024 Research Paper Proceedings (39th International Conference), Hamburg, Germany, 2024, pp. 1-12

2405.07990 2024-05-14 cs.CL cs.CV 88%

Plot2Code: A Comprehensive Benchmark for Evaluating Multi-modal Large Language Models in Code Generation from Scientific Plots

Chengyue Wu, Yixiao Ge, Qiushan Guo, Jiahao Wang, Zhixuan Liang, Zeyu Lu, Ying Shan, Ping Luo

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2403.14965 2024-05-13 cs.SE cs.AI 88%

Comprehensive Evaluation and Insights into the Use of Large Language Models in the Automation of Behavior-Driven Development Acceptance Test Formulation

Shanthi Karpurapu, Sravanthy Myneni, Unnati Nettur, Likhit Sagar Gajja, Dave Burke, Tom Stiehm, Jeffery Payne

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2405.06105 2024-05-13 cs.CL 88%

Can Perplexity Reflect Large Language Model's Ability in Long Text Understanding?

Yutong Hu, Quzhe Huang, Mingxu Tao, Chen Zhang, Yansong Feng

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2405.04655 2024-05-09 cs.CL 88%

Understanding the Capabilities and Limitations of Large Language Models for Cultural Commonsense

Siqi Shen, Lajanugen Logeswaran, Moontae Lee, Honglak Lee, Soujanya Poria, Rada Mihalcea

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2405.03098 2024-05-07 cs.CL 88%

FairMonitor: A Dual-framework for Detecting Stereotypes and Biases in Large Language Models

Yanhong Bai, Jiabao Zhao, Jinxin Shi, Zhentao Xie, Xingjiao Wu, Liang He

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2405.02472 2024-05-07 cs.CL 88%

Semantic Scaling: Bayesian Ideal Point Estimates with Large Language Models

Michael Burnham

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2404.19360 2024-05-01 cs.CV cs.CL cs.IR 88%

Large Language Model Informed Patent Image Retrieval

Hao-Cheng Lo, Jung-Mei Chu, Jieh Hsiang, Chun-Chieh Cho

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 8 pages. Under review

2312.10349 2024-04-30 cs.SE cs.AI 88%

A Comparative Analysis of Large Language Models for Code Documentation Generation

Shubhang Shekhar Dvivedi, Vyshnav Vijay, Sai Leela Rahul Pujari, Shoumik Lodh, Dhruv Kumar

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments Under review

2404.16924 2024-04-29 cs.IR cs.CL 88%

A Survey of Generative Search and Recommendation in the Era of Large Language Models

Yongqi Li, Xinyu Lin, Wenjie Wang, Fuli Feng, Liang Pang, Wenjie Li, Liqiang Nie, Xiangnan He, Tat-Seng Chua

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2404.13340 2024-04-23 cs.SE cs.AI 88%

Large Language Models as Test Case Generators: Performance Evaluation and Enhancement

Kefan Li, Yuan Yuan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2404.09894 2024-04-22 cs.CL cs.SE 88%

Glitch Tokens in Large Language Models: Categorization Taxonomy and Effective Detection

Yuxi Li, Yi Liu, Gelei Deng, Ying Zhang, Wenjia Song, Ling Shi, Kailong Wang, Yuekang Li, Yang Liu, Haoyu Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2308.10390 2024-04-19 cs.CL 88%

LibriSQA: A Novel Dataset and Framework for Spoken Question Answering with Large Language Models

Zihan Zhao, Yiyang Jiang, Heyang Liu, Yanfeng Wang, Yu Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

1. 评测与基准 32208 篇

Benchmarking Knowledge Boundary for Large Language Models: A Different Perspective on Model Evaluation

Empowering Large Language Models to Set up a Knowledge Retrieval Indexer via Self-Learning

LLM meets Vision-Language Models for Zero-Shot One-Class Classification

Towards Optimizing with Large Language Models

Generating clickbait spoilers with an ensemble of large language models

Large Language Models Are State-of-the-Art Evaluator for Grammatical Error Correction

Large Language Models on Wikipedia-Style Survey Generation: an Evaluation in NLP Concepts

Directed Metric Structures arising in Large Language Models

Automatic Generation and Evaluation of Reading Comprehension Test Items with Large Language Models

CFBenchmark: Chinese Financial Assistant Benchmark for Large Language Model

CAUS: A Dataset for Question Generation based on Human Cognition Leveraging Large Language Models

A Hard Nut to Crack: Idiom Detection with Conversational Large Language Models

A Systematic Evaluation of Large Language Models for Natural Language Generation Tasks

Transfer Learning in Pre-Trained Large Language Models for Malware Detection Based on System Calls

Stylometric Watermarks for Large Language Models

SpeechGuard: Exploring the Adversarial Robustness of Multimodal Large Language Models

Can Large Language Models Write Parallel Code?

HPC-Coder: Modeling Parallel Programs using Large Language Models

Plot2Code: A Comprehensive Benchmark for Evaluating Multi-modal Large Language Models in Code Generation from Scientific Plots

Comprehensive Evaluation and Insights into the Use of Large Language Models in the Automation of Behavior-Driven Development Acceptance Test Formulation

Can Perplexity Reflect Large Language Model's Ability in Long Text Understanding?

Understanding the Capabilities and Limitations of Large Language Models for Cultural Commonsense

FairMonitor: A Dual-framework for Detecting Stereotypes and Biases in Large Language Models

Semantic Scaling: Bayesian Ideal Point Estimates with Large Language Models

Large Language Model Informed Patent Image Retrieval

A Comparative Analysis of Large Language Models for Code Documentation Generation

A Survey of Generative Search and Recommendation in the Era of Large Language Models

Large Language Models as Test Case Generators: Performance Evaluation and Enhancement

Glitch Tokens in Large Language Models: Categorization Taxonomy and Effective Detection

LibriSQA: A Novel Dataset and Framework for Spoken Question Answering with Large Language Models