语言大模型 / LLM - arXivDaily 专题

2501.13121 2025-01-24 cs.CL cs.AI cs.LG 90%

Episodic Memories Generation and Evaluation Benchmark for Large Language Models

Alexis Huet, Zied Ben Houidi, Dario Rossi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2408.05968 2025-01-17 cs.CR 90%

Nob-MIAs: Non-biased Membership Inference Attacks Assessment on Large Language Models with Ex-Post Dataset Construction

Cédric Eichler, Nathan Champeil, Nicolas Anciaux, Alexandra Bensamoun, Heber Hwang Arcolezi, José Maria De Fuentes

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；pretraining(abstract)

2501.06863 2025-01-14 cs.LG cs.AI cs.CL 90%

Transfer Learning of Tabular Data by Finetuning Large Language Models

Shourav B. Rabbani, Ibna Kowsar, Manar D. Samad

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2410.20302 2025-01-06 cs.LG cs.AI cs.CL 90%

Sequential Large Language Model-Based Hyper-parameter Optimization

Kanan Mahammadli, Seyda Ertekin

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2412.19994 2024-12-31 physics.chem-ph cs.AI cs.CL cs.LG 90%

From Generalist to Specialist: A Survey of Large Language Models for Chemistry

Yang Han, Ziping Wan, Lu Chen, Kai Yu, Xin Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments COLING2025,We maintain an up-to-date Github repository at: https://github.com/OpenDFM/LLM4Chemistry

2412.15298 2024-12-23 cs.CL cs.AI cs.LG q-fin.ST stat.ME 90%

A Comparative Study of DSPy Teleprompter Algorithms for Aligning Large Language Models Evaluation Metrics to Human Evaluation

Bhaskarjit Sarmah, Kriti Dutta, Anna Grigoryan, Sachin Tiwari, Stefano Pasquali, Dhagash Mehta

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 7 pages, 10 tables, two-column format

2404.06209 2024-12-05 cs.LG cs.AI cs.CL 90%

Elephants Never Forget: Memorization and Learning of Tabular Data in Large Language Models

Sebastian Bordt, Harsha Nori, Vanessa Rodrigues, Besmira Nushi, Rich Caruana

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments COLM camera ready, fix typo

2409.14165 2024-12-03 cs.AI cs.CL cs.LG cs.RO cs.SY eess.SY 90%

A Survey on Large Language Model-empowered Autonomous Driving

Yuxuan Zhu, Shiyi Wang, Wenqing Zhong, Nianchen Shen, Yunqi Li, Siqi Wang, Zhiheng Li, Cathy Wu, Zhengbing He, Li Li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2410.10869 2024-12-02 cs.CL cs.AI cs.LG 90%

Application of NotebookLM, a Large Language Model with Retrieval-Augmented Generation, for Lung Cancer Staging

Ryota Tozuka, Hisashi Johno, Akitomo Amakawa, Junichi Sato, Mizuki Muto, Shoichiro Seki, Atsushi Komaba, Hiroshi Onishi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 9 pages, 5 figures, 1 table, 3 ancillary files

2306.13549 2024-12-02 cs.CV cs.AI cs.CL cs.LG 90%

A Survey on Multimodal Large Language Models

Shukang Yin, Chaoyou Fu, Sirui Zhao, Ke Li, Xing Sun, Tong Xu, Enhong Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted for publication in National Science Review. Project page:https://github.com/BradyFU/Awesome-Multimodal-Large-Language-Models

2404.16789 2024-11-26 cs.LG cs.AI cs.CL 90%

Continual Learning of Large Language Models: A Comprehensive Survey

Haizhou Shi, Zihao Xu, Hengyi Wang, Weiyi Qin, Wenyuan Wang, Yibin Wang, Zifeng Wang, Sayna Ebrahimi, Hao Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 44 pages, 2 figures, 4 tables; Work in progress

2411.14500 2024-11-25 cs.CL cs.AI cs.CY cs.LG 90%

Exploring Accuracy-Fairness Trade-off in Large Language Models

Qingquan Zhang, Qiqi Duan, Bo Yuan, Yuhui Shi, Jialin Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 9 pages

2404.00282 2024-11-21 cs.LG cs.AI cs.CL cs.RO 90%

Survey on Large Language Model-Enhanced Reinforcement Learning: Concept, Taxonomy, and Methods

Yuji Cao, Huan Zhao, Yuheng Cheng, Ting Shu, Yue Chen, Guolong Liu, Gaoqi Liang, Junhua Zhao, Jinyue Yan, Yun Li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 22 pages (including bibliography), 6 figures

2407.02680 2024-11-13 cs.SE 90%

KGym: A Platform and Dataset to Benchmark Large Language Models on Linux Kernel Crash Resolution

Alex Mathai, Chenxi Huang, Petros Maniatis, Aleksandr Nogikh, Franjo Ivancic, Junfeng Yang, Baishakhi Ray

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2404.01332 2024-11-13 cs.CL cs.AI cs.LG 90%

Explaining Large Language Models Decisions Using Shapley Values

Behnam Mohammadi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2411.02930 2024-11-06 cs.CL cs.AI cs.LG 90%

Textual Aesthetics in Large Language Models

Lingjie Jiang, Shaohan Huang, Xun Wu, Furu Wei

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；preference optimization(abstract)；分类 cs.CL、cs.AI、cs.LG

2403.05266 2024-11-05 cs.CL cs.AI cs.LG 90%

ERBench: An Entity-Relationship based Automatically Verifiable Hallucination Benchmark for Large Language Models

Jio Oh, Soyeon Kim, Junseok Seo, Jindong Wang, Ruochen Xu, Xing Xie, Steven Euijong Whang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2402.06544 2024-10-29 cs.CL cs.AI cs.LG 90%

Calibrating Long-form Generations from Large Language Models

Yukun Huang, Yixin Liu, Raghuveer Thirukovalluru, Arman Cohan, Bhuwan Dhingra

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2405.19323 2024-10-22 cs.CL cs.AI cs.CY cs.LG 90%

Are Large Language Models Chameleons? An Attempt to Simulate Social Surveys

Mingmeng Geng, Sihong He, Roberto Trotta

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 17 pages

2410.12865 2024-10-18 cs.CL cs.AI cs.LG 90%

ELF-Gym: Evaluating Large Language Models Generated Features for Tabular Prediction

Yanlin Zhang, Ning Li, Quan Gan, Weinan Zhang, David Wipf, Minjie Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2410.09084 2024-10-15 cs.CL cs.AI cs.LG cs.RO 90%

Diagnosing Robotics Systems Issues with Large Language Models

Jordis Emilia Herrmann, Aswath Mandakath Gopinath, Mikael Norrlof, Mark Niklas Müller

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2406.11370 2024-10-15 cs.CL cs.AI cs.CY cs.LG 90%

Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments

Han Zhou, Xingchen Wan, Yinhong Liu, Nigel Collier, Ivan Vulić, Anna Korhonen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments EMNLP 2024

2406.09923 2024-10-15 cs.CL cs.AI cs.LG 90%

CliBench: A Multifaceted and Multigranular Evaluation of Large Language Models for Clinical Decision Making

Mingyu Derek Ma, Chenchen Ye, Yu Yan, Xiaoxuan Wang, Peipei Ping, Timothy S Chang, Wei Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Project page: https://clibench.github.io

2409.19339 2024-10-08 cs.CL cs.AI cs.CV cs.LG 90%

Visual Question Decomposition on Multimodal Large Language Models

Haowei Zhang, Jianzhe Liu, Zhen Han, Shuo Chen, Bailan He, Volker Tresp, Zhiqiang Xu, Jindong Gu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to EMNLP2024 Findings

2407.01920 2024-10-08 cs.CL cs.AI cs.CV cs.LG cs.MM 90%

To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models

Bozhong Tian, Xiaozhuan Liang, Siyuan Cheng, Qingbin Liu, Mengru Wang, Dianbo Sui, Xi Chen, Huajun Chen, Ningyu Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments EMNLP 2024 Findings; Code and dataset are released at https://github.com/zjunlp/KnowUnDo

2407.04069 2024-10-04 cs.CL cs.AI cs.LG 90%

A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations

Md Tahmid Rahman Laskar, Sawsan Alqahtani, M Saiful Bari, Mizanur Rahman, Mohammad Abdullah Matin Khan, Haidar Khan, Israt Jahan, Amran Bhuiyan, Chee Wei Tan, Md Rizwan Parvez, Enamul Hoque, Shafiq Joty, Jimmy Huang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at EMNLP 2024 (Main Conference)

2406.18181 2024-09-26 cs.SE 90%

On the Evaluation of Large Language Models in Unit Test Generation

Lin Yang, Chen Yang, Shutao Gao, Weijing Wang, Bo Wang, Qihao Zhu, Xiao Chu, Jianyi Zhou, Guangtai Liang, Qianxiang Wang, Junjie Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments Accepted by ASE 2024, Research Paper Track

2401.08438 2024-09-25 cs.CL cs.AI cs.LG 90%

CogGPT: Unleashing the Power of Cognitive Dynamics on Large Language Models

Yaojia Lv, Haojie Pan, Zekun Wang, Jiafeng Liang, Yuanxing Liu, Ruiji Fu, Ming Liu, Zhongyuan Wang, Bing Qin

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to EMNLP 2024 (Findings)

2311.11415 2024-09-24 cs.CR cs.AI cs.CL cs.HC cs.LG 90%

A Security Risk Taxonomy for Prompt-Based Interaction With Large Language Models

Erik Derner, Kristina Batistič, Jan Zahálka, Robert Babuška

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2409.03375 2024-09-06 cs.CL cs.AI cs.LG 90%

Leveraging Large Language Models through Natural Language Processing to provide interpretable Machine Learning predictions of mental deterioration in real time

Francisco de Arriba-Pérez, Silvia García-Méndez

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

1. 评测与基准 32208 篇

Episodic Memories Generation and Evaluation Benchmark for Large Language Models

Nob-MIAs: Non-biased Membership Inference Attacks Assessment on Large Language Models with Ex-Post Dataset Construction

Transfer Learning of Tabular Data by Finetuning Large Language Models

Sequential Large Language Model-Based Hyper-parameter Optimization

From Generalist to Specialist: A Survey of Large Language Models for Chemistry

A Comparative Study of DSPy Teleprompter Algorithms for Aligning Large Language Models Evaluation Metrics to Human Evaluation

Elephants Never Forget: Memorization and Learning of Tabular Data in Large Language Models

A Survey on Large Language Model-empowered Autonomous Driving

Application of NotebookLM, a Large Language Model with Retrieval-Augmented Generation, for Lung Cancer Staging

A Survey on Multimodal Large Language Models

Continual Learning of Large Language Models: A Comprehensive Survey

Exploring Accuracy-Fairness Trade-off in Large Language Models

Survey on Large Language Model-Enhanced Reinforcement Learning: Concept, Taxonomy, and Methods

KGym: A Platform and Dataset to Benchmark Large Language Models on Linux Kernel Crash Resolution

Explaining Large Language Models Decisions Using Shapley Values

Textual Aesthetics in Large Language Models

ERBench: An Entity-Relationship based Automatically Verifiable Hallucination Benchmark for Large Language Models

Calibrating Long-form Generations from Large Language Models

Are Large Language Models Chameleons? An Attempt to Simulate Social Surveys

ELF-Gym: Evaluating Large Language Models Generated Features for Tabular Prediction

Diagnosing Robotics Systems Issues with Large Language Models

Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments

CliBench: A Multifaceted and Multigranular Evaluation of Large Language Models for Clinical Decision Making

Visual Question Decomposition on Multimodal Large Language Models

To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models

A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations

On the Evaluation of Large Language Models in Unit Test Generation

CogGPT: Unleashing the Power of Cognitive Dynamics on Large Language Models

A Security Risk Taxonomy for Prompt-Based Interaction With Large Language Models

Leveraging Large Language Models through Natural Language Processing to provide interpretable Machine Learning predictions of mental deterioration in real time