语言大模型 / LLM - arXivDaily 专题

2409.00091 2024-09-04 cs.CL cs.AI cs.LG 90%

Classification of Safety Events at Nuclear Sites using Large Language Models

Mishca de Costa, Muhammad Anwar, Daniel Lau, Issam Hammad

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Journal ref 43rd Annual CNS Conference and the 48th Annual CNS/CNA Student Conference Sheraton Cavalier Saskatoon Hotel, Saskatoon, SK, Canada, June 16-19, 2024

2408.16296 2024-08-30 cs.CV cs.IR 90%

Rethinking Sparse Lexical Representations for Image Retrieval in the Age of Rising Multi-Modal Large Language Models

Kengo Nakata, Daisuke Miyashita, Youyang Ng, Yasuto Hoshi, Jun Deguchi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments Accepted to ECCV 2024 Workshops: 2nd Workshop on Traditional Computer Vision in the Age of Deep Learning (TradiCV)

2311.18743 2024-08-27 cs.CL cs.AI cs.LG 90%

AlignBench: Benchmarking Chinese Alignment of Large Language Models

Xiao Liu, Xuanyu Lei, Shengyuan Wang, Yue Huang, Zhuoer Feng, Bosi Wen, Jiale Cheng, Pei Ke, Yifan Xu, Weng Lam Tam, Xiaohan Zhang, Lichao Sun, Xiaotao Gu, Hongning Wang, Jing Zhang, Minlie Huang, Yuxiao Dong, Jie Tang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ACL 2024

2408.12263 2024-08-23 cs.CL cs.AI cs.LG 90%

Toward the Evaluation of Large Language Models Considering Score Variance across Instruction Templates

Yusuke Sakai, Adam Nohejl, Jiangnan Hang, Hidetaka Kamigaito, Taro Watanabe

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 19 pages, 7 figures

2408.10474 2024-08-21 cs.SE cs.AI cs.CL cs.CR cs.LG 90%

LeCov: Multi-level Testing Criteria for Large Language Models

Xuan Xie, Jiayang Song, Yuheng Huang, Da Song, Fuyuan Zhang, Felix Juefei-Xu, Lei Ma

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2408.03281 2024-08-08 cs.CL cs.AI cs.LG 90%

StructEval: Deepen and Broaden Large Language Model Assessment via Structured Evaluation

Boxi Cao, Mengjie Ren, Hongyu Lin, Xianpei Han, Feng Zhang, Junfeng Zhan, Le Sun

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ACL 2024;Benchmark at https://github.com/c-box/StructEval ;Leaderboard at https://huggingface.co/spaces/Bowieee/StructEval_leaderboard

2403.10795 2024-08-08 cs.CL cs.AI cs.LG cs.RO 90%

Can Large Language Models Solve Robot Routing?

Zhehui Huang, Guangyao Shi, Gaurav S. Sukhatme

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Submitted to International Symposium of Robotics Research (ISRR 2024)

2307.12469 2024-07-30 cs.CR 90%

How Effective Are They? Exploring Large Language Model Based Fuzz Driver Generation

Cen Zhang, Yaowen Zheng, Mingqiang Bai, Yeting Li, Wei Ma, Xiaofei Xie, Yuekang Li, Limin Sun, Yang Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments 13 pages, 9 figures

Journal ref ISSTA 2024

2307.06290 2024-07-30 cs.CL cs.AI cs.LG 90%

Instruction Mining: Instruction Data Selection for Tuning Large Language Models

Yihan Cao, Yanbin Kang, Chi Wang, Lichao Sun

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 24 pages, 7 figures

2307.04346 2024-07-23 cs.SE 90%

Can Large Language Models Write Good Property-Based Tests?

Vasudev Vikram, Caroline Lemieux, Joshua Sunshine, Rohan Padhye

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2407.10817 2024-07-16 cs.CL cs.AI cs.LG 90%

Foundational Autoraters: Taming Large Language Models for Better Automatic Evaluation

Tu Vu, Kalpesh Krishna, Salaheddin Alzubi, Chris Tar, Manaal Faruqui, Yun-Hsuan Sung

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 31 pages, 5 figures, 7 tables

2406.10552 2024-07-09 cs.CL cs.AI cs.LG 90%

Large Language Model Enhanced Clustering for News Event Detection

Adane Nega Tarekegn

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2402.01781 2024-07-04 cs.CL cs.AI cs.LG 90%

When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards

Norah Alzahrani, Hisham Abdullah Alyahya, Yazeed Alnumay, Sultan Alrashed, Shaykhah Alsubaie, Yusef Almushaykeh, Faisal Mirza, Nouf Alotaibi, Nora Altwairesh, Areeb Alowisheq, M Saiful Bari, Haidar Khan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments updated with ACL 2024 camera ready version

2407.01725 2024-07-03 cs.CL cs.AI cs.LG 90%

DiscoveryBench: Towards Data-Driven Discovery with Large Language Models

Bodhisattwa Prasad Majumder, Harshit Surana, Dhruv Agarwal, Bhavana Dalvi Mishra, Abhijeetsingh Meena, Aryan Prakhar, Tirth Vora, Tushar Khot, Ashish Sabharwal, Peter Clark

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Website: https://github.com/allenai/discoverybench

2406.11434 2024-06-18 cs.DB 90%

DB-GPT-Hub: Towards Open Benchmarking Text-to-SQL Empowered by Large Language Models

Fan Zhou, Siqiao Xue, Danrui Qi, Wenhui Shi, Wang Zhao, Ganglin Wei, Hongyang Zhang, Caigai Jiang, Gangwei Jiang, Zhixuan Chu, Faqiang Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2406.10890 2024-06-18 cs.CL cs.AI cs.LG 90%

RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models

Zhuoran Jin, Pengfei Cao, Chenhao Wang, Zhitao He, Hongbang Yuan, Jiachun Li, Yubo Chen, Kang Liu, Jun Zhao

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 48 pages, 7 figures, 12 tables

2406.04845 2024-06-10 cs.CL cs.AI cs.DC cs.LG cs.MA 90%

FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models

Rui Ye, Rui Ge, Xinyu Zhu, Jingyi Chai, Yaxin Du, Yang Liu, Yanfeng Wang, Siheng Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 22 pages

2402.05044 2024-06-10 cs.CL cs.AI cs.CR cs.LG 90%

SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language Models

Lijun Li, Bowen Dong, Ruohui Wang, Xuhao Hu, Wangmeng Zuo, Dahua Lin, Yu Qiao, Jing Shao

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at ACL 2024 Findings

2310.15123 2024-06-10 cs.CL cs.AI cs.LG 90%

Branch-Solve-Merge Improves Large Language Model Evaluation and Generation

Swarnadeep Saha, Omer Levy, Asli Celikyilmaz, Mohit Bansal, Jason Weston, Xian Li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments NAACL 2024 (19 pages, 7 figures, 11 tables)

2406.00083 2024-06-07 cs.CR cs.AI cs.CL cs.IR cs.LG 90%

BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models

Jiaqi Xue, Mengxin Zheng, Yebowen Hu, Fei Liu, Xun Chen, Qian Lou

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2402.17811 2024-06-06 cs.CL cs.AI cs.LG 90%

TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space

Shaolei Zhang, Tian Yu, Yang Feng

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ACL 2024 main conference, Project Page: https://ictnlp.github.io/TruthX-site/

2312.04455 2024-06-05 cs.CL cs.AI cs.LG 90%

Fortify the Shortest Stave in Attention: Enhancing Context Awareness of Large Language Models for Effective Tool Use

Yuhan Chen, Ang Lv, Ting-En Lin, Changyu Chen, Yuchuan Wu, Fei Huang, Yongbin Li, Rui Yan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ACL 2024 main

2402.15043 2024-06-04 cs.CL cs.AI cs.LG 90%

KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models

Zhuohao Yu, Chang Gao, Wenjin Yao, Yidong Wang, Wei Ye, Jindong Wang, Xing Xie, Yue Zhang, Shikun Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ACL 2024 (main conference); 19 pages, 5 figures, 19 tables, code is available at: https://github.com/zhuohaoyu/KIEval

2402.15938 2024-06-03 cs.CL cs.AI cs.CR cs.LG cs.SE 90%

Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models

Yihong Dong, Xue Jiang, Huanyu Liu, Zhi Jin, Bin Gu, Mengfei Yang, Ge Li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ACL

2405.16136 2024-05-28 cs.AI cs.CL cs.LG cs.SD eess.AS 90%

C3LLM: Conditional Multimodal Content Generation Using Large Language Models

Zixuan Wang, Qinkai Duan, Yu-Wing Tai, Chi-Keung Tang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2311.16543 2024-05-22 cs.AR 90%

RTLFixer: Automatically Fixing RTL Syntax Errors with Large Language Models

Yun-Da Tsai, Mingjie Liu, Haoxing Ren

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2403.12403 2024-05-09 cs.CL cs.AI cs.LG 90%

Towards Interpretable Hate Speech Detection using Large Language Model-extracted Rationales

Ayushi Nirmal, Amrita Bhattacharjee, Paras Sheth, Huan Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Camera-ready for NAACL WOAH 2024 (Workshop on Online Abuse and Harms). First two authors contributed equally

2404.13013 2024-04-22 cs.CV cs.AI cs.CL cs.LG 90%

Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Models

Chuofan Ma, Yi Jiang, Jiannan Wu, Zehuan Yuan, Xiaojuan Qi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI、cs.LG

2310.17722 2024-04-17 cs.LG cs.AI cs.CL 90%

Large Language Models as Generalizable Policies for Embodied Tasks

Andrew Szot, Max Schwarzer, Harsh Agrawal, Bogdan Mazoure, Walter Talbott, Katherine Metcalf, Natalie Mackraz, Devon Hjelm, Alexander Toshev

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2310.17526 2024-04-11 cs.CL cs.AI cs.LG 90%

Can large language models replace humans in the systematic review process? Evaluating GPT-4's efficacy in screening and extracting data from peer-reviewed and grey literature in multiple languages

Qusai Khraisha, Sophie Put, Johanna Kappenberg, Azza Warraitch, Kristin Hadfield

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 9 pages, 2 figures, 1 table

1. 评测与基准 32208 篇

Classification of Safety Events at Nuclear Sites using Large Language Models

Rethinking Sparse Lexical Representations for Image Retrieval in the Age of Rising Multi-Modal Large Language Models

AlignBench: Benchmarking Chinese Alignment of Large Language Models

Toward the Evaluation of Large Language Models Considering Score Variance across Instruction Templates

LeCov: Multi-level Testing Criteria for Large Language Models

StructEval: Deepen and Broaden Large Language Model Assessment via Structured Evaluation

Can Large Language Models Solve Robot Routing?

How Effective Are They? Exploring Large Language Model Based Fuzz Driver Generation

Instruction Mining: Instruction Data Selection for Tuning Large Language Models

Can Large Language Models Write Good Property-Based Tests?

Foundational Autoraters: Taming Large Language Models for Better Automatic Evaluation

Large Language Model Enhanced Clustering for News Event Detection

When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards

DiscoveryBench: Towards Data-Driven Discovery with Large Language Models

DB-GPT-Hub: Towards Open Benchmarking Text-to-SQL Empowered by Large Language Models

RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models

FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models

SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language Models

Branch-Solve-Merge Improves Large Language Model Evaluation and Generation

BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models

TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space

Fortify the Shortest Stave in Attention: Enhancing Context Awareness of Large Language Models for Effective Tool Use

KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models

Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models

C3LLM: Conditional Multimodal Content Generation Using Large Language Models

RTLFixer: Automatically Fixing RTL Syntax Errors with Large Language Models

Towards Interpretable Hate Speech Detection using Large Language Model-extracted Rationales

Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Models

Large Language Models as Generalizable Policies for Embodied Tasks

Can large language models replace humans in the systematic review process? Evaluating GPT-4's efficacy in screening and extracting data from peer-reviewed and grey literature in multiple languages