语言大模型 / LLM - arXivDaily 专题

2408.10039 2024-12-17 cs.AI 88%

MSDiagnosis: A Benchmark for Evaluating Large Language Models in Multi-Step Clinical Diagnosis

Ruihui Hou, Shencheng Chen, Yongqi Fan, Guangya Yu, Lifeng Zhu, Jing Sun, Jingping Liu, Tong Ruan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2409.11112 2024-12-16 cs.CL cs.CY 88%

Strategic Insights in Human and Large Language Model Tactics at Word Guessing Games

Matīss Rikters, Sanita Reinsone

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Journal ref Published in the 4th Wordplay: When Language Meets Games Workshop @ ACL 2024

2412.07906 2024-12-12 cs.CL 88%

Rethinking Emotion Annotations in the Era of Large Language Models

Minxue Niu, Yara El-Tawil, Amrit Romana, Emily Mower Provost

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2404.18353 2024-12-12 cs.CR cs.AI cs.PL 88%

How secure is AI-generated Code: A Large-Scale Comparison of Large Language Models

Norbert Tihanyi, Tamas Bisztray, Mohamed Amine Ferrag, Ridhi Jain, Lucas C. Cordeiro

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments Accepted and will be shortly published at Empirical Software Engineering (EMSE). Journal Impact Factor: 3.5 (2023)

2310.09872 2024-12-11 cs.LG 88%

Leveraging Large Language Models for Node Generation in Few-Shot Learning on Text-Attributed Graphs

Jianxiang Yu, Yuxiang Ren, Chenghua Gong, Jiaqi Tan, Xiang Li, Xuecang Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments Accepted by AAAI2025

2412.05571 2024-12-10 cs.CL 88%

A polar coordinate system represents syntax in large language models

Pablo Diego-Simón, Stéphane D'Ascoli, Emmanuel Chemla, Yair Lakretz, Jean-Rémi King

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Journal ref NeurIPS 2024

2308.09975 2024-12-10 cs.CL 88%

FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Models

Xin Guo, Haotian Xia, Zhaowei Liu, Hanyang Cao, Zhi Yang, Zhiqiang Liu, Sizhe Wang, Jinyi Niu, Chuqi Wang, Yanhui Wang, Xiaolong Liang, Xiaoming Huang, Bing Zhu, Zhongyu Wei, Yun Chen, Weining Shen, Liwen Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2411.02589 2024-12-06 cs.CL 88%

Context-Informed Machine Translation of Manga using Multimodal Large Language Models

Philip Lippmann, Konrad Skublicki, Joshua Tanner, Shonosuke Ishiwatari, Jie Yang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments COLING 2025

2412.03025 2024-12-05 cs.CL 88%

Human Variability vs. Machine Consistency: A Linguistic Analysis of Texts Generated by Humans and Large Language Models

Sergio E. Zanotto, Segun Aroyehun

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2412.02104 2024-12-04 cs.CL 88%

Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Survey

Yunkai Dang, Kaichen Huang, Jiahao Huo, Yibo Yan, Sirui Huang, Dongrui Liu, Mengxi Gao, Jie Zhang, Chen Qian, Kun Wang, Yong Liu, Jing Shao, Hui Xiong, Xuming Hu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2404.16019 2024-12-04 cs.CL 88%

The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models

Hannah Rose Kirk, Alexander Whitefield, Paul Röttger, Andrew Bean, Katerina Margatina, Juan Ciro, Rafael Mosquera, Max Bartolo, Adina Williams, He He, Bertie Vidgen, Scott A. Hale

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Journal ref The Thirty-eight Conference on Neural Information Processing Systems Datasets and Benchmarks Track (2024)

2402.11217 2024-12-02 cs.CL cs.CV 88%

A Spectrum Evaluation Benchmark for Medical Multi-Modal Large Language Models

Jie Liu, Wenxuan Wang, Yihang Su, Jingyuan Huan, Wenting Chen, Yudi Zhang, Cheng-Yi Li, Kao-Jung Chang, Xiaohan Xin, Linlin Shen, Michael R. Lyu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 20 pages, 15 figures

2411.16927 2024-11-27 cs.SE cs.AI 88%

ASSERTIFY: Utilizing Large Language Models to Generate Assertions for Production Code

Mohammad Jalili Torkamani, Abhinav Sharma, Nikita Mehrotra, Rahul Purandare

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 20 pages, 10 figures, 10 listings, 2 tables, preprint

2411.00208 2024-11-26 cs.CY cs.AI 88%

Using Large Language Models for a standard assessment mapping for sustainable communities

Luc Jonveaux

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 8 pages, 2 figures

2408.10072 2024-11-22 cs.CV cs.AI 88%

FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistant

Zhengchao Huang, Bin Xia, Zicheng Lin, Zhun Mou, Wenming Yang, Jiaya Jia

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 23 pages, 21 figures; project page: https://ffaa-vl.github.io

2411.13226 2024-11-21 cs.CL 88%

AIDBench: A benchmark for evaluating the authorship identification capability of large language models

Zichen Wen, Dadi Guo, Huishuai Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 21 pages, 7 figures

2411.13032 2024-11-21 cs.HC cs.AI cs.CY 88%

"It was 80% me, 20% AI": Seeking Authenticity in Co-Writing with Large Language Models

Angel Hsing-Chi Hwang, Q. Vera Liao, Su Lin Blodgett, Alexandra Olteanu, Adam Trischler

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2411.12880 2024-11-21 cs.IR cs.AI 88%

Advancing Large Language Models for Spatiotemporal and Semantic Association Mining of Similar Environmental Events

Yuanyuan Tian, Wenwen Li, Lei Hu, Xiao Chen, Michael Brook, Michael Brubaker, Fan Zhang, Anna K. Liljedahl

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2411.11072 2024-11-20 cs.CL 88%

Multilingual Large Language Models: A Systematic Survey

Shaolin Zhu, Supryadi, Shaoyang Xu, Haoran Sun, Leiyu Pan, Menglong Cui, Jiangcun Du, Renren Jin, António Branco, Deyi Xiong

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2408.00884 2024-11-19 cs.DB cs.CL 88%

Hybrid Querying Over Relational Databases and Large Language Models

Fuheng Zhao, Divyakant Agrawal, Amr El Abbadi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Journal ref CIDR 2025

2407.05250 2024-11-18 cs.CL 88%

CLIMB: A Benchmark of Clinical Bias in Large Language Models

Yubo Zhang, Shudi Hou, Mingyu Derek Ma, Wei Wang, Muhao Chen, Jieyu Zhao

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2310.10570 2024-11-15 cs.CL 88%

On Context Utilization in Summarization with Large Language Models

Mathieu Ravaut, Aixin Sun, Nancy F. Chen, Shafiq Joty

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments ACL 2024. 9 pages, 7 figures, 3 tables

2411.08438 2024-11-14 cs.AI 88%

Towards Optimizing a Retrieval Augmented Generation using Large Language Model on Academic Data

Anum Afzal, Juraj Vladika, Gentrit Fazlija, Andrei Staradubets, Florian Matthes

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2411.06691 2024-11-12 cs.AI 88%

Autonomous Droplet Microfluidic Design Framework with Large Language Models

Dinh-Nguyen Nguyen, Raymond Kai-Yu Tong, Ngoc-Duy Dinh

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2406.01428 2024-11-11 cs.CL cs.CV 88%

Superhuman performance in urology board questions by an explainable large language model enabled for context integration of the European Association of Urology guidelines: the UroBot study

Martin J. Hetz, Nicolas Carl, Sarah Haggenmüller, Christoph Wies, Maurice Stephan Michel, Frederik Wessels, Titus J. Brinker

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Journal ref 10.1016/j.esmorw.2024.100078

2411.04981 2024-11-08 cs.CR cs.AI 88%

Enhancing Reverse Engineering: Investigating and Benchmarking Large Language Models for Vulnerability Analysis in Decompiled Binaries

Dylan Manuel, Nafis Tanveer Islam, Joseph Khoury, Ana Nunez, Elias Bou-Harb, Peyman Najafirad

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2308.13149 2024-11-08 cs.CL 88%

SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Research

Liangtai Sun, Yang Han, Zihan Zhao, Da Ma, Zhennan Shen, Baocai Chen, Lu Chen, Kai Yu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 12 pages, 17 figures, 12 tables. Accepted by AAAI 2024

2410.20746 2024-11-07 cs.CL cs.CY cs.HC 88%

ElectionSim: Massive Population Election Simulation Powered by Large Language Model Driven Agents

Xinnong Zhang, Jiayu Lin, Libo Sun, Weihong Qi, Yihang Yang, Yue Chen, Hanjia Lyu, Xinyi Mou, Siming Chen, Jiebo Luo, Xuanjing Huang, Shiping Tang, Zhongyu Wei

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 42 pages, 14 figures

2406.10057 2024-11-07 cs.CV cs.AI 88%

First Multi-Dimensional Evaluation of Flowchart Comprehension for Multimodal Large Language Models

Enming Zhang, Ruobing Yao, Huanyong Liu, Junhui Yu, Jiale Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2411.02117 2024-11-05 cs.CL 88%

AVSS: Layer Importance Evaluation in Large Language Models via Activation Variance-Sparsity Analysis

Zichen Song, Yuxin Wu, Sitan Huang, Zhongfeng Kang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 4 pages, 1 figure

1. 评测与基准 32208 篇

MSDiagnosis: A Benchmark for Evaluating Large Language Models in Multi-Step Clinical Diagnosis

Strategic Insights in Human and Large Language Model Tactics at Word Guessing Games

Rethinking Emotion Annotations in the Era of Large Language Models

How secure is AI-generated Code: A Large-Scale Comparison of Large Language Models

Leveraging Large Language Models for Node Generation in Few-Shot Learning on Text-Attributed Graphs

A polar coordinate system represents syntax in large language models

FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Models

Context-Informed Machine Translation of Manga using Multimodal Large Language Models

Human Variability vs. Machine Consistency: A Linguistic Analysis of Texts Generated by Humans and Large Language Models

Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Survey

The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models

A Spectrum Evaluation Benchmark for Medical Multi-Modal Large Language Models

ASSERTIFY: Utilizing Large Language Models to Generate Assertions for Production Code

Using Large Language Models for a standard assessment mapping for sustainable communities

FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistant

AIDBench: A benchmark for evaluating the authorship identification capability of large language models

"It was 80% me, 20% AI": Seeking Authenticity in Co-Writing with Large Language Models

Advancing Large Language Models for Spatiotemporal and Semantic Association Mining of Similar Environmental Events

Multilingual Large Language Models: A Systematic Survey

Hybrid Querying Over Relational Databases and Large Language Models

CLIMB: A Benchmark of Clinical Bias in Large Language Models

On Context Utilization in Summarization with Large Language Models

Towards Optimizing a Retrieval Augmented Generation using Large Language Model on Academic Data

Autonomous Droplet Microfluidic Design Framework with Large Language Models

Superhuman performance in urology board questions by an explainable large language model enabled for context integration of the European Association of Urology guidelines: the UroBot study

Enhancing Reverse Engineering: Investigating and Benchmarking Large Language Models for Vulnerability Analysis in Decompiled Binaries

SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Research

ElectionSim: Massive Population Election Simulation Powered by Large Language Model Driven Agents

First Multi-Dimensional Evaluation of Flowchart Comprehension for Multimodal Large Language Models

AVSS: Layer Importance Evaluation in Large Language Models via Activation Variance-Sparsity Analysis